DISPLAY CONTROL SYSTEM, DISPLAY CONTROL METHOD, AND PROGRAM

Abstract

To provide a display control system that controls display of thumbnail images related to an event-based video recorded by a dash cam mounted on a vehicle.SOLUTION: Providing display control means for displaying a plurality of thumbnail images corresponding to different time points in a range of an event-based video, allows contents of the event-based video to be confirmed according to a plurality of thumbnail images corresponding to different time points in the range of the event-based video. As a result, a desired event-based video can be easily found according to the plurality of thumbnail images as compared with the case where the contents of the event-based video is confirmed according to one thumbnail image.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a display control system, a display control method, and a program for controlling the display of thumbnail images related to event-unit videos recorded by a drive recorder mounted in a vehicle. [Background technology]

[0002] Conventionally, in-vehicle video recording devices, so-called drive recorders, have been widely used, which capture images of the vehicle's surroundings using a camera installed in the vehicle and record the surrounding images and vehicle speed when the vehicle is subjected to an impact due to an event (phenomenon) such as sudden braking, sudden steering, or a collision. By equipping a vehicle with such a drive recorder, it is possible to verify the cause of an accident by analyzing the recorded information when an accident occurs. In addition, it is possible to improve the driver's awareness of safe driving, and the images recorded on daily driving conditions can be used for safe driving guidance, etc.

[0003] Patent documents 1 and 2 disclose a driving support device that collects driving information such as camera images, vehicle speed, and GPS (Global Positioning System) location information recorded by a drive recorder installed in a commercial vehicle such as a truck or taxi, and allows an operations manager or the like to check the contents of the driving information, analyze the driving style of each driver, and use the information in driving education for the drivers. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2010-257483 A [Patent Document 2] JP 2010-257484 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the above driving support device, the operation manager, etc., narrows down and selects the event unit video of a specific event such as sudden braking from a large number of driving information (hereinafter referred to as event unit video) recorded for each event such as sudden braking, sudden steering, and collision, by using related data such as the magnitude and waveform of acceleration recorded in each event unit video. In other words, this related data is recognized as a tag for narrowing down the event unit video of a specific event, and the event unit video is classified and narrowed down. However, in order to finally identify the event unit video of the desired event, the operation manager, etc., must view and check the contents of the camera images included in each event unit video in order to identify the event unit video.

[0006] Furthermore, the driving assistance devices disclosed in Patent Documents 1 and 2 above display thumbnail images that are reduced in size from the camera images recorded at the time a trigger (e.g., a timing signal indicating that a recording condition by a drive recorder has been met) is detected from among the multiple camera images contained in one event-unit image. However, since these thumbnail images are camera images recorded at the time the trigger was detected, which is after the time an event such as sudden braking or steering occurred, it is difficult to find the event-unit image of the desired event from these thumbnail images.

[0007] The present invention has been made in consideration of the circumstances exemplified above, and aims to provide a display control system, a display control method, and a program that enable a desired event unit video to be easily found from thumbnail images. [Means for solving the problem]

[0008] In a first aspect, the present invention provides a display control system that controls the display of thumbnail images related to event-unit video recorded by a drive recorder installed in a vehicle, characterized in that the display control system includes a display control means that displays a plurality of thumbnail images corresponding to different time points within the range of the event-unit video.

[0009] In the display control system according to the first aspect, the content of an event-unit video can be confirmed from a plurality of thumbnail images corresponding to different time points within the range of the event-unit video. This makes it easier to find a desired event-unit video from thumbnail images compared to the case where the content of the event-unit video is confirmed from a single thumbnail image.

[0010] An event may be, for example, an occurrence specified by a predetermined rule. An event unit may be, for example, a time range in units that allows a certain event to be managed separately from other events. For example, an event unit may be a predetermined period before and after the occurrence of an event, as in the configuration of the second aspect. For example, the time ranges of a certain event unit and another event unit may be set so that they do not overlap, or may be set so that they partially overlap. The event-unit image may be, for example, an image of a time range that allows a certain event to be managed by distinguishing it from other events. The event-unit image may be, for example, recorded as separate images for each event, or a certain range within one image may be treated as an event-unit image. In other words, the "event-unit image recorded by a drive recorder mounted on a vehicle" does not necessarily have to be an image recorded for each event.

[0011] When a certain range in one video is set as an event-unit video, for example, the ranges of a plurality of event-unit videos may be set so as to allow overlapping of the ranges, or the ranges of each event-unit video may be set so as not to overlap. An event-unit video may be, for example, a range in a video that may be related to an event. Furthermore, "multiple thumbnail images corresponding to different time points within the range of the event-unit video" may be, for example, "multiple thumbnail images corresponding to video other than the event-unit video at different time points within the range of the event-unit video", but it is better to say "multiple thumbnail images corresponding to the event-unit video at different time points within the range of the event-unit video". A specific example of "corresponding to" in "multiple thumbnail images corresponding to the event-unit video" is "representing". Other examples include "created from", "image-processed with", "created by image processing with", "created by applying a specified image processing", etc.

[0012] In a second aspect, the present invention is characterized in that, in the display control system according to the first aspect, the event-unit video is video spanning a predetermined period of time before and after the time point at which the event occurs, and the thumbnail images include images recorded either before or after the time point at which the event occurs, or both.

[0013] In the display control system according to the second aspect, the contents of the event-based video can be confirmed from thumbnail images corresponding to images recorded either before or after the occurrence of the event, or both. This makes it easier to find event-based videos related to events occurring before or after the occurrence of the event.

[0014] The time point at which an event occurs may be, for example, the time point at which a predetermined condition is satisfied. The time point at which an event occurs may be, for example, the time point at which a predetermined condition representative of the event is satisfied. For example, the time point at which a predetermined condition is satisfied may be set as the time point at which an event occurs, and the range of the event unit image may be determined according to the type of the event. The event may be, for example, the time point at which an incident equivalent to an accident occurs. For example, the location at which a sudden deceleration equivalent to a collision occurs may be set as the time point at which the event occurs.

[0015] There are types of drive recorders, for example, which record video before and after a "trigger indicating that a recording condition has been met," and which record video at all times (for example, all the time from when the engine is turned on to when it is turned off) and store information for enabling identification of the position of the video where the trigger has been activated. This "information for enabling identification" is, for example, information on the time when the trigger has been activated. For example, the position in which the trigger has been activated can be identified based on information on the start time of recording the video and information on the time when the trigger has been activated.

[0016] In the case of the former type of drive recorder described above, the "event-unit video" may be, for example, video recorded over a predetermined period of time before and after the occurrence of a trigger indicating that a recording condition by the drive recorder has been met. In addition, in the case of the latter type of drive recorder mentioned above, the "event unit video" may be, for example, a portion of the video recorded over a predetermined period of time before and after the trigger occurs within the video that is the recording unit (in the above example, one unit is from engine on to engine off).

[0017] The specified period may be, for example, the entire range of the recorded video (e.g., the entire period from engine on to off), but is particularly preferably a limited time range within the video. The limited time range within the video is particularly preferably a time range that includes the time point at which the event occurs. The limited time range within the video may be, for example, a fixed time range, but may also be a variable time. Furthermore, the period before the time point at which the event occurs and the period after the time point at which the event occurs that constitute the specified period may be the same time period, but are preferably different time periods. In particular, the specified period is preferably a period sufficient to enable identification of the cause of the occurrence of the event. In particular, the specified period is preferably a range that differs depending on the type of event.

[0018] In a third aspect, the present invention is characterized in that, in the display control system according to the second aspect, the thumbnail image is an image recorded at a time within the specified period which is not the time when the event occurred, but which is determined by a specified rule using information used to determine that the event occurred.

[0019] In the display control system according to the third aspect, the contents of the event-unit video can be confirmed from a thumbnail image corresponding to an image recorded at a time point within a predetermined period that is not the time point when the event occurred, but is determined by a predetermined rule using information used to determine that the event occurred (for example, the acceleration applied to the vehicle) (for example, the time point when the acceleration exceeds a predetermined value). This makes it possible to easily find an event-unit video related to the event at the time point determined by the above-mentioned predetermined rule.

[0020] In a fourth aspect, the present invention is characterized in that, in the display control system according to the second or third aspect, the thumbnail image is an image recorded within the specified period at a time determined by a specified rule using information different from information used to determine that the event has occurred.

[0021] In the display control system according to the fourth aspect, the contents of the event-unit video can be confirmed from thumbnail images corresponding to images recorded at a time point (for example, the time point of the maximum value of the vehicle's longitudinal acceleration within a predetermined period) determined by a predetermined rule using information (for example, the vehicle's longitudinal acceleration due to sudden braking) different from the information used to determine that an event has occurred (for example, the vehicle's longitudinal acceleration due to sudden steering) during a predetermined period. This makes it possible to easily find event-unit video related to the event at the time point determined by the above-mentioned predetermined rule.

[0022] In a fifth aspect, the present invention is characterized in that, in the display control system according to the third or fourth aspect, the specified rule is a rule for estimating the occurrence time of a sub-event that caused the occurrence of the event.

[0023] In the display control system according to the fifth aspect, it is possible to easily find an event unit video related to an incident at a time point determined by a rule for estimating the occurrence time point of a sub-event that caused the occurrence of an event. The predetermined rule is a rule for estimating a characteristic point related to the occurrence of an event by tracing back from the time when the event is determined to have occurred, and may be, for example, a maximum point or an inflection point of the acceleration of the vehicle within a predetermined period of time, or another characteristic point of the acceleration. Also, different rules may be used depending on the type of event. The predetermined period of time may be set to be long enough to consider the possibility of a sub-event causing an event occurring to be low.

[0024] In a sixth aspect, the present invention is characterized in that in the display control system according to any one of the second to fifth aspects, the point in time before or after the occurrence of the event, or both, are different points in time depending on the type of the event.

[0025] In the display control system according to the sixth aspect, the contents of the event-unit video can be confirmed from thumbnail images corresponding to images recorded at different times depending on the type of event, either before or after the occurrence of the event, or both. This makes it easy to find event-unit videos related to events at different times depending on the type of event.

[0026] In a seventh aspect, the present invention is characterized in that, in a display control system according to any one of the second to sixth aspects, the thumbnail image is an image recorded either immediately before or immediately after the occurrence of the event, or both.

[0027] In the display control system according to the seventh aspect, the contents of the event-unit video can be confirmed from thumbnail images corresponding to images recorded either immediately before or immediately after the occurrence of the event, or both. This makes it possible to more easily and accurately find event-unit videos related to events occurring immediately before or immediately after the occurrence of the event.

[0028] In an eighth aspect, the present invention is characterized in that, in a display control system according to any one of the second to seventh aspects, the thumbnail images are provided with images recorded both immediately before and immediately after the time point at which the event occurred, the acquisition interval for information used to determine that the event has occurred is set to an interval shorter than the recording interval for frames of the video, the image recorded immediately before the time point at which the event occurred is an image of the frame immediately before the time point at which the event was determined to have occurred, and the image recorded immediately after the time point at which the event occurred is an image of the frame immediately after the time point at which the event was determined to have occurred.

[0029] In the display control system according to the eighth aspect, the contents of the event-unit video can be confirmed from thumbnail images corresponding to images recorded both immediately before and immediately after the occurrence of the event, making it possible to more easily and accurately find event-unit videos related to events both immediately before and immediately after the occurrence of the event.

[0030] In a ninth aspect, the present invention is characterized in that, in a display control system according to any one of the first to eighth aspects, the thumbnail image is an image recorded at either the beginning or the end of the event unit video, or both.

[0031] In the display control system according to the ninth aspect, the contents of the event-based video can be confirmed from a thumbnail image corresponding to an image recorded at either the beginning or the end, or both, of the event-based video, making it possible to more easily and accurately find an event-based video related to an incident occurring at the beginning or end of the event-based video.

[0032] In a tenth aspect, the present invention provides a display control system according to any one of the second to ninth aspects, wherein the thumbnail image comprises an image recorded at the time when the event occurred.

[0033] In the display control system according to the tenth aspect, the contents of the event-unit video can be confirmed from the thumbnail image corresponding to the image recorded at the time when the event occurred. This makes it possible to more easily and accurately find the event-unit video related to the occurrence of the event.

[0034] In an eleventh aspect, the present invention is characterized in that in a display control system according to any one of the first to tenth aspects, the thumbnail image comprises an image of a specific period within the range of the event unit image, depending on the state of the vehicle when the event unit image was recorded.

[0035] In the display control system according to the eleventh aspect, the contents of the event-based video can be confirmed from thumbnail images corresponding to images of a specific period according to the state of the vehicle when the event-based video was recorded. This makes it easier to find event-based videos related to the state of the vehicle when the event-based video was recorded.

[0036] The "state of the vehicle when the event-unit video was recorded" refers to, for example, the state of the vehicle when (1) sudden braking, (2) sudden steering, or (3) the vehicle collides with something. "Images of a specific period selected from event-unit video" are, for example, (1) in the case of sudden braking, images recorded from when the brake is applied until it is released, or images recorded from when the acceleration event applied to the vehicle occurs until it ends. Also, (2) in the case of sudden steering, images recorded from when the steering wheel starts to be turned until it is turned to completion. Furthermore, (3) in the case of a vehicle colliding with something, images recorded from when the acceleration behavior of the vehicle occurs due to the reaction of the bumper, guardrail, etc., until the vehicle stops and the acceleration behavior converges.

[0037] In a twelfth aspect, the present invention is characterized in that, in a display control system according to any one of the first to eleventh aspects, the thumbnail image is provided with an image recorded at a time when acceleration applied to the vehicle exceeded a predetermined value.

[0038] In the display control system according to the twelfth aspect, the contents of the event unit video can be confirmed from the thumbnail image corresponding to the image recorded at the time when the acceleration applied to the vehicle exceeded a predetermined value. This makes it easier to find the event unit video related to the time when the acceleration applied to the vehicle exceeded a predetermined value.

[0039] In a thirteenth aspect, the present invention is characterized in that, in the display control system according to any one of the second to twelfth aspects, the occurrence of the event is specific behavior information based on information detected of the behavior of the vehicle.

[0040] In the display control system according to the thirteenth aspect, the contents of the event-unit video can be confirmed from thumbnail images corresponding to images in which specific behavior information based on information detecting the behavior of a vehicle is recorded as an event. This makes it easier to find event-unit videos in which specific behavior information is recorded as an event.

[0041] "Information detected from vehicle behavior" may be, for example, information obtained from the detection results of an acceleration sensor, gyro sensor, or air pressure sensor (or altitude sensor) mounted on the vehicle, or the results of analysis of recorded video.

[0042] In a 14th aspect, the present invention is characterized in that, in the display control system according to any one of the second to 13th aspects, the occurrence of the event is specific vehicle information based on information regarding the functional status of the vehicle.

[0043] In the display control system according to the fourteenth aspect, the contents of the event-unit video can be confirmed from thumbnail images corresponding to images in which specific vehicle information based on information on the functional state of the vehicle is recorded as an event. This makes it easier to find event-unit videos in which specific vehicle information is recorded as an event.

[0044] "Information regarding the functional status of the vehicle" includes, for example, the operation of the brake, turn signal, accelerator, steering wheel rotation, shift lever position, or handbrake while driving the vehicle, as well as information obtained from the OBD (On Board Diagnosis), which is a vehicle fault diagnosis system, and CAN (Controller Area Network), which is an in-vehicle LAN.

[0045] In a fifteenth aspect, the present invention is characterized in that, in a display control system according to any one of the first to fourteenth aspects, the multiple thumbnail images are displayed in a list on the same screen in a matrix structure in which thumbnail images of different event-unit videos form different rows and thumbnail images of the same point in time form different columns.

[0046] In the display control system according to the fifteenth aspect, a plurality of thumbnail images are displayed in a list in a visually easy-to-understand manner, organized as thumbnail images for different event-unit videos or thumbnail images for the same time point, thereby making it easier to distinguish the contents of the thumbnail images.

[0047] In a sixteenth aspect, the present invention is characterized in that, in a display control system according to any one of the first to fifteenth aspects, the multiple thumbnail images are displayed in a list on the same screen in a matrix structure in which thumbnail images for the same event unit video are arranged in chronological order from left to right or from right to left in the same row.

[0048] In the display control system according to the sixteenth aspect, a plurality of thumbnail images are displayed in a visually easy-to-understand list as thumbnail images arranged in chronological order in the same row for each event unit video, thereby making it easy to distinguish the contents of the thumbnail images.

[0049] It can be considered as an invention of a method having steps corresponding to components of the display control means according to any one of the first to sixteenth aspects. For example, in a seventeenth aspect, as an invention of a method corresponding to the first aspect, the present invention provides a display control method for controlling display of thumbnail images related to event-unit videos recorded by a drive recorder mounted on a vehicle, the display control method comprising a step of displaying a plurality of thumbnail images corresponding to different time points within a range of the event-unit videos.

[0050] In the display control method according to the seventeenth aspect, it becomes possible to confirm the contents of the event-unit video from a plurality of thumbnail images corresponding to different time points within the range of the event-unit video, so that the desired event-unit video can be easily found from the thumbnail images.

[0051] In an eighteenth aspect, the present invention can provide a program for causing a computer to realize the functions of the display control system according to any one of the first to sixteenth aspects. Effect of the Invention

[0052] According to the display control system of the present invention, it becomes possible to easily find a desired event unit video from thumbnail images. [Brief description of the drawings]

[0053] [Figure 1] 1 is a diagram showing a schematic configuration of a driving assistance system according to a first embodiment. [Diagram 2] 2 is a diagram conceptually showing the data structure of the contents recorded on a memory card 25. FIG. [Diagram 3] 10A to 10C are diagrams illustrating a state of acceleration change when an event occurs and a method of storing images and the like according to the first embodiment. [Figure 4] 11 is a flowchart showing a process of creating and displaying thumbnail images according to the first embodiment. [Diagram 5] FIG. 11 is a screen display diagram showing an example of a display mode of thumbnail images according to the first embodiment. [Figure 6] FIG. 11 is a diagram showing a change in acceleration in the case of sudden braking according to the second embodiment. [Figure 7] 13 is a flowchart showing a process of creating and displaying thumbnail images according to the second embodiment. [Figure 8] FIG. 11 is a diagram showing a change in acceleration in the case of abrupt steering according to the third embodiment. [Figure 9] 13 is a flowchart showing a process of creating and displaying thumbnail images according to the third embodiment. [Figure 10] FIG. 11 is a diagram showing a change in acceleration in the case of a vehicle collision according to the fourth embodiment. [Figure 11] 13 is a flowchart showing a process of creating and displaying thumbnail images according to a fourth embodiment. [Figure 12] FIG. 13 is a diagram showing an experimental example of acceleration change in the case of a car-to-car collision. [Figure 13] 13 is a diagram showing a display example of a thumbnail screen related to the experimental example shown in FIG. 12. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0054] A display control system according to an embodiment of the present invention will be described in detail below with reference to the drawings. Note that the present invention is not limited to this embodiment, and various changes, modifications, and improvements may be made based on the knowledge of those skilled in the art without departing from the scope of the present invention. EXAMPLES

[0055] [Example 1] <Driver assistance system configuration> FIG. 1 is a diagram showing a schematic configuration of a driving assistance system according to a first embodiment of a display control system of the present invention.

[0056] As shown in FIG. 1, the driving assistance system is composed of a drive recorder 10 mounted on a vehicle, a memory card 25 that stores images when an event occurs in the drive recorder 10, and a driving assistance device 30 for playing back the images stored in this memory card 25.

[0057] The drive recorder 10 has a first control unit 11, an acceleration sensor (G sensor) 12, a gyro sensor 13, an air pressure sensor 14, a GPS antenna 15, a GPS (Global Positioning System) receiver 16 that determines the GPS position information of the vehicle from the GPS signal received by the GPS antenna 15, a first operation unit 17 including switches, buttons, etc., a first memory 18 for temporarily storing images, a first IF (interface) 19 that has a slot for inserting a memory card 25 and for writing images to the memory card 25, a CCD camera 20 installed in the vehicle to continuously capture images in front of the vehicle at a predetermined rate, a vehicle signal acquisition unit 21, and a power supply unit 22 for supplying power to each element of the drive recorder 10.

[0058] The drive recorder 10 may be configured to cooperate with a navigation device (not shown) so as to play back images on the display of the navigation device. Although the GPS receiver 16 is not necessarily a required component, it may be configured to acquire location information received by an external device such as an AVM (Automatic Vehicle Monitoring) system or a navigation device.

[0059] The first control unit 11 is configured with a microcomputer including a CPU, a ROM, a RAM, and the like, and controls the overall operation of the drive recorder 10.

[0060] The G sensor 12 detects gravitational acceleration (hereinafter simply referred to as acceleration) in two mutually orthogonal axial directions (X-axis and Y-axis) and transmits the detected acceleration (also referred to as G data) together with time data to the first control unit 11. The first control unit 11 can obtain the G data (Gx, Gy) output from the G sensor 12 at intervals of, for example, 10 milliseconds, and determine the value (magnitude) of the acceleration from the G data.

[0061] Note that Gx indicates acceleration in the X-axis direction (front-rear direction of the vehicle) and Gy indicates acceleration in the Y-axis direction (left-right direction of the vehicle). The G sensor 12 may be a three-axis sensor including the Z-axis direction (up-down direction of the vehicle), or it may not be necessary to use data on the acceleration Gz in the Z-axis direction in a three-axis sensor.

[0062] The gyro sensor 13 detects the angular acceleration (rotation) of the vehicle, mainly detects changes in the direction of travel of the vehicle (i.e., rotation of the yaw (Z-axis) which is the vertical axis), and transmits the detected angular acceleration data together with time data to the first control unit 11. The first control unit 11 can acquire the angular acceleration data output from the gyro sensor 13 at intervals of, for example, 10 milliseconds, and determine the value (magnitude) of the angular acceleration from the angular acceleration data.

[0063] The atmospheric pressure sensor 14 detects the atmospheric pressure outside the vehicle, calculates the altitude based on the detected atmospheric pressure value, and transmits the atmospheric pressure value and altitude value (atmospheric pressure / altitude data) together with time data to the first control unit 11. The first control unit 11 can obtain the atmospheric pressure / altitude data output from the atmospheric pressure sensor 14 at intervals of, for example, 10 milliseconds, and determine the values ​​(magnitudes) of the atmospheric pressure and altitude from the atmospheric pressure / altitude data.

[0064] The first control unit 11 controls the CCD camera 20 to capture one image every 100 milliseconds, and to store the captured images in the first memory 18 in a sequential and cyclical manner together with time data (primary storage for storage in the memory card 25 described later). For example, the first memory 18 is configured to store image data of 24 seconds' worth of images (240 images) captured by the CCD camera 20 at all times. Note that the image captured by the CCD camera 20 may not be one every 100 milliseconds, but may be one every 50 milliseconds, for example. Also, the CCD camera 20 may be configured to store moving images captured by the CCD camera 20.

[0065] The vehicle signal acquisition unit 21 is connected to a fault diagnosis connector of the vehicle, acquires various signals and information (vehicle data) of the vehicle at intervals of, for example, 100 milliseconds, and transmits the acquired vehicle data together with time data to the first control unit 11. Examples of the vehicle data include, for example, [1] a signal that detects a brake operation during driving of the vehicle, [2] a signal that detects a turn signal operation, [3] a signal that detects an accelerator operation, [4] a signal that detects a steering wheel rotation, [5] a signal that detects a shift lever position, [6] a signal that detects a handbrake operation, [7] vehicle fault diagnosis information (vehicle speed, engine RPM, coolant temperature, etc.) obtained from an on-board vehicle fault diagnosis system (OBD) in the vehicle, and [8] various vehicle information (each function control data from an ECU (Electronic Control Unit) of the vehicle, communication data from an external network or other vehicles, etc.) obtained via an on-board LAN (CAN).

[0066] As an example, when the vehicle signal acquisition unit 21 acquires a signal detecting a brake operation, it transmits brake operation data indicating whether or not the brakes of the vehicle have been operated, brake operation start time data indicating the time when the brake operation started, and brake operation end time data indicating the time when the brake operation ended to the first control unit 11. That is, based on the brake operation data, brake operation start time data, and brake operation end time data from the vehicle signal acquisition unit 21, the first control unit 11 can determine whether or not the brake operation has been performed, the time when the brake operation started, and the time when the brake operation ended.

[0067] As another example, when the vehicle signal acquirer 21 acquires a signal detecting steering wheel rotation, it transmits steering wheel rotation data indicating whether the steering wheel of the vehicle has been rotated, steering wheel rotation start time data indicating the time when the steering wheel rotation started, and steering wheel rotation end time data indicating the time when the steering wheel rotation ended to the first control unit 11. That is, based on the steering wheel rotation data, steering wheel rotation start time data, and steering wheel rotation end time data from the vehicle signal acquirer 21, the first control unit 11 can determine whether the steering wheel has been rotated, the time when the steering wheel rotation started, and the time when the steering wheel rotation ended.

[0068] Some or all of the GPS antenna 15, the GPS receiver 16, the first IF 19, the CCD camera 20, the vehicle signal acquisition unit 21, etc. may be configured separately from the drive recorder 10. For example, when linked with an existing navigation device having a GPS function, the drive recorder 10 does not need the function of the GPS receiver 16, etc., and the cost of the drive recorder 10 can be kept low accordingly.

[0069] The driving assistance device 30 has a second control unit 31, a display unit 32 consisting of a display or the like, an output unit 33 consisting of a printer or the like for printing the display screen on paper, a second operation unit 34 consisting of input devices such as a keyboard and a mouse, a second memory 35 for temporarily storing images, a second IF (interface) 36 which includes a slot for inserting a memory card 25 and for reading images from the memory card 25, and an image processing unit 37 for performing predetermined image processing on the input image.

[0070] The second control unit 31 is a personal computer (PC) that includes a CPU, ROM, RAM, etc. and has driving assistance software installed. It interprets and executes the programs included in the driving assistance software to operate each component of the driving assistance device 30 and realizes various functions related to the characteristic parts of the present invention.

[0071] The driving support device 30 is one aspect of a display control system that controls display of thumbnail images related to event-unit images recorded by the drive recorder 10. In this embodiment, the event-unit images are images recorded during a predetermined period before and after the occurrence of an event. The occurrence of an event is, for example, the occurrence of an event corresponding to an accident, for example, the occurrence of an impact on the vehicle due to sudden deceleration such as sudden braking.

[0072] The memory card 25 is a rewritable non-volatile semiconductor memory card having a storage capacity of 2 GB. The memory card 25 is inserted into a slot constituting the first IF 19, and stores predetermined images (e.g., images for 12 seconds before and 12 seconds after the occurrence of an event) that are always temporarily stored in the first memory 18 in a cyclical manner during a predetermined period before and after the occurrence of an event. Thereafter, the memory card 25 is ejected from the slot constituting the first IF 19 and reinserted into the slot constituting the second IF 36, and outputs the stored images to the driving support device 30.

[0073] Although a semiconductor memory card is used as the memory card 25, the present invention is not limited to this, and semiconductor memories other than card types, portable hard disks (HDs), other storage media, etc. may be used. Also, the storage capacity of the memory card, etc. is arbitrary and can be freely determined according to the application.

[0074] When a predetermined condition is met (i.e., when an event that should be recorded by the drive recorder 10 occurs), specifically, when (a) an impact is applied to the vehicle due to the occurrence of an event (phenomenon) such as sudden braking, sudden steering, a collision, or other event equivalent to the occurrence of an accident, and the value (magnitude) of the G data output from the G sensor 12 provided inside exceeds a predetermined threshold, or when (b) the emergency switch of the first operating unit 17 is pressed, the drive recorder 10 uses the detection as a trigger to acquire various data for several to several tens of seconds before and after (for example, 12 seconds before and 12 seconds after) the event occurrence time data, together with the event occurrence time data, and records the data on the memory card 25 as a single piece of driving information.

[0075] The driving information recorded in the memory card 25 includes G data output from the G sensor 12, angular acceleration data output from the gyro sensor 13, atmospheric pressure and altitude data output from the atmospheric pressure sensor 14, GPS position information determined by the GPS receiver 16, camera image data captured by the CCD camera 20, and various vehicle signals and information acquired by the vehicle signal acquisition unit 21 (detection data such as braking operation and steering wheel rotation, vehicle speed data, etc.).

[0076] The drive recorder 10 records various driving information data in the memory card 25 in association with each of a number of camera images taken from a period of several to several tens of seconds (e.g., 12 seconds before and 12 seconds after) when an event to be recorded occurs and a trigger is detected.

[0077] <Memory card data structure> Next, the data structure of the contents recorded on memory card 25 will be described with reference to Fig. 2. Fig. 2 is a diagram conceptually showing the data structure of the contents recorded on memory card 25.

[0078] As shown in Fig. 2, memory card 25 records driving information corresponding to each occurrence of an event, classified as driving information 1, driving information 2, and driving information 3. Driving information 1 is composed of 240 camera images 1-240 corresponding to 24 seconds before and after the occurrence of the event (12 seconds before and 12 seconds after), and image-related information including other driving information other than the camera images. The image-related information includes main item data including G data and time data at the time of the event occurrence, and related data 1-240 corresponding to each of the 240 camera images 1-240. The same is true for driving information 2 and 3.

[0079] The main item data includes G data, angular acceleration data, air pressure / altitude data, and respective time data, while the image-related data includes the date and time the camera image was taken, various vehicle signals and information at the time the camera image was taken (detection data for braking operations, steering wheel rotation, etc., vehicle speed data, etc.), and the vehicle's GPS position information.

[0080] <Method of storing acceleration changes and images when an event occurs> Next, referring to FIG. 3, we will explain how the acceleration (G data) detected by the G sensor 12 (see FIG. 1) of the drive recorder 10 changes when an event occurs, such as when the vehicle is subjected to an impact, and how images, etc. are stored in the drive recorder 10.

[0081] Fig. 3(a) shows the time-series change in the G data (composite value of Gx and Gy) output from the G sensor 12, Fig. 3(b) shows an example of an image period stored in the memory card 25, and Fig. 3(c) shows an example of the selection timing of an image that is the basis of a thumbnail image to be created. The creation and display of thumbnail images will be described later.

[0082] From the time when the impact is applied to the vehicle, the value (magnitude) of the G data output from the G sensor 12 increases rapidly from almost zero. Then, as shown in Fig. 3(a), at time tp, when the value (magnitude) of the G data of the G sensor 12 reaches the threshold acceleration Gs (for example, 0.3G) (time tp), the first control unit 101 recognizes it as a trigger, judges (determines) that an event has occurred, and operates to store the image captured by the CCD camera 20 and temporarily stored in the first memory 18 in a circular manner in the memory card 25, and also to store the time tp in the memory card 25 as event occurrence judgment time data.

[0083] Specifically, as shown in FIG. 3(b), the image PA for TA seconds before time tp and the image PB for TB seconds after time tp are stored in the memory card 25. For example, TA can be 12 seconds and TB can be 12 seconds. The periods TA and TB can be freely set. For example, while displaying the set time (seconds) on a setting screen (not shown) of the drive recorder 10, the time can be set by operating the time setting button of the first operation unit 17 of the drive recorder 10, and the set information can be saved, thereby setting an arbitrary time.

[0084] When an event such as an impact being applied to the vehicle occurs and the value (magnitude) of the detected G data of the G sensor 12 exceeds a predetermined threshold value as described above, the first control unit 11 stores, for each event, the event occurrence time data (tp), the detected G data (Gx, Gy) of the G sensor 12 and its time data, the detected angular acceleration data of the gyro sensor 13 and its time data, the atmospheric pressure and altitude data of the atmospheric pressure sensor 14 and its time data, and the vehicle data and its time data for TA seconds before the time tp and TB seconds after the time tp acquired by the vehicle signal acquisition unit 21 (for example, brake operation data and its time data, steering wheel rotation data and its time data, vehicle speed data and its time data, etc.) together with image data in the memory card 25. Note that it may be configured to store only a part of the above-mentioned data in the memory card 25.

[0085] The number of events stored in the memory card 25 can be varied depending on the storage capacity of the memory card 25, but it is preferable that data for 500 events or more can be stored. Also, it is preferable that the first control unit 11 creates a folder in the memory card 25 for each event, and stores image data, event occurrence time data (tp), G data (Gx, Gy) from the G sensor 12 and its time data, angular acceleration data and its time data, atmospheric pressure / altitude data and its time data, and vehicle data and its time data.

[0086] In the above-mentioned events, exceeding the threshold acceleration Gs is set as the trigger for the occurrence of the event. However, for example, it may be determined that an event has occurred when the amount of change in acceleration per unit time exceeds a certain value (when the value (magnitude) of the G data changes by 0.1 G or more in 0.1 seconds).

[0087] <Creating and displaying thumbnail images (Example 1)> Next, the creation and display processing of thumbnail images in the driving support device 30 will be described with reference to Fig. 4. In this example, the creation and display processing operation of a thumbnail image related to one event will be described. Fig. 4 is a flowchart showing thumbnail image creation and display processing according to the first embodiment, and this thumbnail image creation and display processing is realized by the CPU executing a control program loaded from a HDD or the like into the RAM of the second control unit 31 of the driving support device 30, and is started based on an operation to start the driving support software by the second operation unit 34. Also, it is assumed that the memory card 25 on which images are stored in the drive recorder 10 is inserted into the second IF 36 constituting a slot at the time when the processing of the flowchart shown in Fig. 4 is started.

[0088] In step S11, the second control unit 31 acquires, from the data stored in the memory card 25, event occurrence determination time data (tp).

[0089] Next, in step S12, the second control unit 31 selects multiple images taken at multiple different timings from images PA taken TA seconds before time tp shown in Figure 3(b) and images PB taken TB seconds after time tp.

[0090] Specifically, the control program includes the following control processes: from among the image PA for TA seconds before the time tp shown in Fig. 3(b) and the image PB for TB seconds after the time tp shown in Fig. 3(c), select the image P1 captured at time ts TA seconds (e.g., 12 seconds) before the time tp shown in Fig. 3(c) as the "first image", select the image P2 captured at time tp1 just before the time tp (predetermined time TC seconds before, e.g., 0.2 seconds before) as the "second image", select the image P3 captured at time tp2 just after the time tp (predetermined time TC after, e.g., 0.2 seconds after) as the "third image", and select the image P4 captured at time te TB seconds (e.g., 12 seconds) after the time tp as the "fourth image". The second control unit 31 performs the selection control of the first to fourth images from the image PA and the image PB according to the above control program.

[0091] Note that time ts, TA seconds before time tp, is the time when image storage for one event starts, and the "first image" is the image taken when the event occurs. Also, time te, TB seconds after time tp, is the time when image storage for one event ends, and the "fourth image" is the image taken when the event detection ends. The predetermined time TC can be set to, for example, 0.2 seconds, but an optimal value including 0 seconds can be selected depending on the application. For example, while the set time (seconds) is displayed on a setting screen (not shown) of the driving support device 30, the time can be set by operating the time setting button of the second operation unit 34 of the driving support device 30, and the set information can be saved, thereby setting an arbitrary time.

[0092] Next, in step S13, the second control unit 201, in accordance with a control program stored in the ROM within the second control unit 201, causes the image processing unit 37 to perform image processing to create first to fourth thumbnail images from the "first to fourth images" (P1 to P4) selected in step S12.

[0093] To create thumbnail images from the selected first to fourth images, for example, the original first to fourth images are subjected to image processing to reduce the size of the images, respectively, to create thumbnail images. In addition to image processing to reduce the size of the images, thumbnail images may be created by performing other predetermined image processing, such as image processing to enlarge the selected first to fourth images or image processing to cut out a part of the images. Furthermore, the selected first to fourth images may not be subjected to any image processing, and may be used as they are as thumbnail images.

[0094] In the next step S14, the second control unit 31, in accordance with a control program stored in the ROM within the second control unit 31, causes the display processing unit 38 to perform a display process for displaying the first to fourth thumbnail images created in step S13 on the display unit 32. Specifically, as will be described later, the thumbnail images are arranged in a matrix structure and displayed as a list on the same screen. This completes the thumbnail image creation and display process for one event.

[0095] <Thumbnail image display example> Next, one aspect of a display image displayed on the display unit 32 of the driving support device 30 will be described with reference to Fig. 5. Fig. 5 is a screen display diagram showing one example of a display aspect of thumbnail images according to the first embodiment. The display mode of thumbnail images illustrated in FIG. 5 shows a state in which thumbnail images relating to a plurality of events are displayed on the display unit 32 of the driving support device 30.

[0096] 5, 16 thumbnail images A1 to D4 are arranged in a matrix structure of 4 rows vertically and 4 columns horizontally and displayed on the same screen, with each row constituting an event unit image 51, 52, 53, 54 relating to one event. That is, each of the event images 51, 52, 53, 54 constitutes four sets of thumbnail images A1 to A4, B1 to B4, C1 to C4, D1 to D4 in which four thumbnail images relating to one event are arranged and displayed in one row, and four thumbnail images relating to different events are arranged and displayed in different rows.

[0097] Note that the shooting time of the original image of each thumbnail image is displayed below the thumbnail images A1 to D4. In the illustrated example, the shooting time of the original image of each thumbnail image is displayed when the event occurrence time tp in the event unit image 51 is "11:46:14:60".

[0098] 5 constitute time-point-unit images 61, 62, 63, 64 created from images taken at the same time (more precisely, at a time point that is the same amount of time before and after the event occurrence time tp for each event) for each column. That is, the time-point-unit images 61, 62, 63, 64 constitute four sets of thumbnail images A1-D1, A2-D2, A3-D3, A4-D4 in which four thumbnail images relating to the same time point are arranged and displayed in one column, and four thumbnail images relating to different time points are arranged and displayed in different columns.

[0099] Moreover, of the 16 thumbnail images shown in FIG. 5, the first column from the left are thumbnail images created from image P1 (first image) taken at the time the event occurs (time ts), the second column are thumbnail images created from image P2 (second image) taken just before the event occurrence determination time (time tp1), the third column are thumbnail images created from image P3 (third image) taken just after the event occurrence determination time (time tp2), and the fourth column are thumbnail images created from image P4 (fourth image) taken at the time the event detection ends (time te).

[0100] 5, the four thumbnail images arranged in one row are displayed in the order of X1→X2→X3→X4 (where X is A, B, C, or D), with thumbnail images for the same event image arranged in chronological order from left to right within the same row. Note that the display order may be from right to left within the same row, rather than from left to right.

[0101] In FIG. 5, four events are displayed, but the number of events to be displayed is not limited to this, and it is possible to select a different number of events to be displayed, or to display the events together with other elements (G data, vehicle data, etc.).

[0102] As described above, the driving support device 30 of the first embodiment has the following advantages. (1) When an event occurs, such as when an impact is applied to a vehicle, a first image P1 captured TA seconds before the event occurrence time (time tp), a second image P2 captured just before time tp, a third image P3 captured just after time tp, and a fourth image P4 captured TB seconds after time tp are selected, and first to fourth thumbnail images are created from the selected first to fourth images P1 to P4 and displayed on the display unit 32. As a result, by checking the first to fourth thumbnail images corresponding to the first to fourth images P1 to P4 captured at different times among the event unit images captured for a predetermined period before and after the event occurrence, the contents of the event unit images stored for each event occurrence can be easily checked, and the cause and circumstances of the event occurrence can be easily understood.

[0103] For example, when searching for an event unit image related to a specific event from among a large number of event unit images stored for each event occurrence, the specific event unit image desired can be easily found from a thumbnail image, compared to searching for the specific event unit image by checking the contents of the event unit image from a thumbnail image at a time point related to the event unit image.

[0104] (2) As shown in the display mode of thumbnail images in FIG. 5, four thumbnail images relating to one event are displayed in one row, and four thumbnail images relating to different events are displayed in different rows, so that the four thumbnail images relating to one event can be clearly distinguished at a glance. In addition, the four thumbnail images arranged in one row are displayed in chronological order from left to right on the same row for each event, so that the chronological order of the four thumbnail images related to one event can be clearly determined at a glance.

[0105] Furthermore, by looking at the thumbnail image in the first column, you can see the state in front of the vehicle at the time the event occurs, by looking at the thumbnail image in the second column, you can see the state in front of the vehicle just before the event occurrence determination time, by looking at the thumbnail image in the third column, you can see the state in front of the vehicle just after the event occurrence determination time, and by looking at the thumbnail image in the fourth column, you can see the state in front of the vehicle at the time the event detection ends, so for example, by comparing thumbnail images in the same column, you can compare and verify the state in front of the vehicle at each of the same times when an event occurs.

[0106] [Example 2] In the second embodiment, an event example in which an impact is applied to a vehicle is caused by sudden braking. FIG. 6 is a diagram showing the change in acceleration in the case of sudden braking, and shows the time-series change in the G data (composite value of Gx and Gy) output from the G sensor 12.

[0107] 6, when the brake is suddenly applied (ON) at time t1, the G sensor 12 mainly detects the acceleration (Gx) in the forward and backward direction of the vehicle, and the acceleration changes. The acceleration (G data) of the G sensor 12 gradually increases from time t1 (i.e., the acceleration in the direction opposite to the direction in which the vehicle moves increases), and when it reaches a threshold acceleration Gs (for example, 0.3 G) (time tp), the first control unit 11 recognizes it as a trigger, determines (judges) that an event has occurred, and operates to store the image captured by the CCD camera 20 and always cyclically stored in the first memory 108 in the memory card 150, and also to store the time tp in the memory card 150 as event occurrence determination time data.

[0108] Specifically, in the second embodiment, similarly to the first embodiment, control is performed so that an image PA for TA seconds before time tp and an image PB for TB seconds after time tp are stored in the memory card 25.

[0109] After time tp, the acceleration continues to increase, reaches a maximum value, then starts to decrease gradually (i.e., the acceleration in the direction opposite to the direction in which the vehicle is moving becomes smaller), then suddenly decreases, passes through the zero point, decreases further (i.e., the acceleration in the direction in which the vehicle is moving increases), reaches a minimum value, then starts to increase again rapidly (i.e., the acceleration in the direction in which the vehicle is moving decreases), and reaches zero when the vehicle stops and the brake is released (OFF) (time t2).

[0110] In FIG. 6, the period Td from time t1 to time tp is the "period from the beginning of dangerous driving to immediately before the trigger occurrence", and the period Te from time tp to time t2 is the period of "dangerous driving behavior".

[0111] <Creating and displaying thumbnail images (Example 2)> Fig. 7 is a flowchart showing thumbnail image creation and display processing according to the second embodiment, which is realized by the CPU executing a control program loaded from a HDD or the like into the RAM of the second control unit 31 of the driving support device 30, as in the first embodiment, and is started based on an operation to start the driving support software by the second operation unit 34. Also, it is assumed that the memory card 25 on which images are stored in the drive recorder 10 is inserted into the second IF 36 constituting a slot at the time the processing of the flowchart shown in Fig. 7 is started.

[0112] In step S21, the second control unit 31 acquires event occurrence determination time data (tp) from the data stored in the memory card 25. Subsequently, in step S22, the second control unit 31 acquires the brake operation detection signal (brake operation data) output from the vehicle signal acquisition unit 21 from the data stored in the memory card 25.

[0113] Next, in step S23, the second control unit 31 selects multiple images taken at multiple different times related to the braking operation from among images PA taken TA seconds before time tp shown in Figure 3(b) and images PB taken TB seconds after time tp.

[0114] Specifically, the control program is programmed to select, from among the images PA for TA seconds before the time tp and the images PB for TB seconds after the time tp shown in Fig. 3(b), an image captured at time t1 when the brake operation is started based on brake operation start time data included in the acquired brake operation data (i.e., the start time of the appearance of the acceleration event) as a "first image", an image captured just before the time tp (before a predetermined time TC, for example, 0.2 seconds before) as a "second image", an image captured just after the time tp (after the predetermined time TC, for example, 0.2 seconds after) as a "third image", and an image captured at time t2 when the brake operation is ended based on brake operation end time data included in the acquired brake operation data (i.e., the end time of the appearance of the acceleration event) as a "fourth image". The second control unit 31 performs control to select the first to fourth images from the images PA and PB according to such a control program.

[0115] The predetermined time TC can be set to, for example, 0.2 seconds, but an optimal value, including 0 seconds, can be selected depending on the application. In addition to the above-mentioned times t1, immediately before or immediately after time tp, and time t2, images may be selected that are captured at the time when the acceleration reaches a maximum value (maximum value), or immediately before or immediately after that, or at the time when the acceleration reaches a minimum value (minimum value), or immediately before or immediately after that.

[0116] Next, in step S24, the second control unit 31, in accordance with a control program stored in the ROM within the second control unit 31, causes the image processing unit 37 to perform image processing to create first to fourth thumbnail images from the "first to fourth images" selected in step S23.

[0117] In the next step S25, the second control unit 31, in accordance with a control program stored in the ROM within the second control unit 31, causes the display processing unit 38 to perform a display process for displaying the first to fourth thumbnail images created in step S24 on the display unit 32. Specifically, as shown in Fig. 5, the thumbnail images are arranged in a matrix structure and displayed as a list on the same screen. This completes the thumbnail image creation and display process for one event.

[0118] As described above, the driving support device 30 of the second embodiment has the following advantages. In the case of sudden braking as an event example such as an impact on a vehicle, a first image captured at time t1 when a braking operation is started, a second image captured just before time tp, a third image captured just after time tp, and a fourth image captured at time t2 when the braking operation is ended are selected, and first to fourth thumbnail images are created from the selected first to fourth images and displayed on the display unit 32. In this way, in the case of sudden braking, by checking the first to fourth thumbnail images corresponding to the first to fourth images captured at different times among the event unit images captured during a predetermined period before and after the event occurrence time (time tp), particularly the time points including the time t1 when the braking operation is started and the time t2 when the braking operation is ended, it is possible to easily check the contents of the event unit images stored in the case of sudden braking as an event example, and it is easy to grasp the cause and situation of the sudden braking.

[0119] For example, when searching for an event unit image related to sudden braking from among a large number of event unit images stored for each event occurrence, the event unit image related to sudden braking can be easily found from thumbnail images compared to the case where the content of the event unit image is confirmed from a thumbnail image of a single time point related to the event unit image to search for the event unit image related to sudden braking.

[0120] Furthermore, by vertically viewing the thumbnail images in the first row from the left of the 16 thumbnail images shown in Fig. 5, it is possible to compare images at the time when the brakes were applied suddenly (when the braking operation started). By vertically viewing the thumbnail images in the second row, it is possible to compare images immediately before the time when an event was determined to have occurred due to the application of the brakes, and by vertically viewing the thumbnail images in the third row, it is possible to compare images immediately after that. Furthermore, by vertically viewing the thumbnail images in the fourth row, it is possible to compare images at the time when the brakes were released (when the braking operation ended).

[0121] [Example 3] In the third embodiment, an event example in which an impact is applied to a vehicle is caused by sudden steering. FIG. 8 is a diagram showing the change in acceleration when steering suddenly, and shows the time-series change in the G data (composite value of Gx and Gy) output from the G sensor 12.

[0122] 8, when the steering wheel starts to be turned suddenly at time t3, the G sensor 12 detects mainly the acceleration (Gy) in the left and right direction of the vehicle, and the acceleration changes. The acceleration (G data) from the G sensor 12 gradually increases from time t3 (i.e., the acceleration in the direction opposite to the direction in which the vehicle turns increases), and when it reaches a threshold acceleration Gs (for example, 0.3 G) (time tp), the first control unit 11 recognizes it as a trigger, determines (judges) that an event has occurred, and operates to store the image captured by the CCD camera 20 and always cyclically stored in the first memory 108 in the memory card 25, and also to store the time tp in the memory card 25 as event occurrence determination time data.

[0123] Specifically, in the third embodiment, similarly to the first and second embodiments, control is performed so that an image PA for TA seconds before time tp and an image PB for TB seconds after time tp are stored in the memory card 25.

[0124] After time tp, the acceleration continues to increase, reaches a maximum value, then changes to a decrease and gradually decreases (i.e., the acceleration in the direction opposite to the direction in which the vehicle is turning becomes smaller), then suddenly decreases, passes through the zero point, decreases further (i.e., the acceleration in the direction in which the vehicle is turning becomes larger), reaches a minimum value (minimum value), then changes to an increase and suddenly increases (i.e., the acceleration in the direction in which the vehicle is turning becomes smaller), and reaches zero when the vehicle has finished turning and the steering wheel has finished being turned (i.e., the steering wheel is returned to its original position) (time t4).

[0125] In FIG. 8, the period Tf from time t3 to time tp is the "period from the beginning of dangerous driving to immediately before the trigger occurrence", and the period Tg from time tp to time t4 is the period of "dangerous driving behavior".

[0126] <Creating and displaying thumbnail images (Example 3)> Fig. 9 is a flowchart showing thumbnail image creation and display processing according to the third embodiment, which is realized by the CPU executing a control program loaded from a HDD or the like into the RAM of the second control unit 31 of the driving support device 30 in the same manner as in the first and second embodiments, and is started based on an operation to start the driving support software by the second operation unit 34. Also, it is assumed that the memory card 25 on which images are stored in the drive recorder 10 is inserted into the second IF 36 constituting a slot at the time the processing of the flowchart shown in Fig. 9 is started.

[0127] In step S31, the second control unit 31 acquires event occurrence determination time data (tp) from the data stored in the memory card 25. Then, in step S32, the second control unit 31 acquires the steering wheel rotation detection signal (steering wheel rotation data) output from the vehicle signal acquisition unit 21 from the data stored in the memory card 25.

[0128] Next, in step S33, the second control unit 31 selects multiple images taken at multiple different times related to the rotation of the steering wheel from among images PA taken TA seconds before time tp shown in Figure 3(b) and images PB taken TB seconds after time tp.

[0129] Specifically, the control program includes the following control processes: from among the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in Fig. 3(b), an image captured at time t3 when the steering wheel rotation starts based on steering wheel rotation start time data included in the acquired steering wheel rotation data is selected as a "first image", an image captured just before the time tp (before a predetermined time TC, for example, 0.2 seconds before) is selected as a "second image", an image captured just after the time tp (after the predetermined time TC, for example, 0.2 seconds after) is selected as a "third image", and an image captured at time t4 when the steering wheel rotation ends based on steering wheel rotation end time data included in the acquired steering wheel rotation data is selected as a "fourth image". The second control unit 31 controls the selection of the first to fourth images from the image PA and the image PB according to the above control program.

[0130] The predetermined time TC can be set to, for example, 0.2 seconds, but an optimal value, including 0 seconds, can be selected depending on the application. In addition to the above-mentioned times t3, just before or just after time tp, and time t4, images may be selected that are captured at the time when the acceleration reaches a maximum value (maximum value), just before or just after that, or at the time when the acceleration reaches a minimum value (minimum value), or just before or just after that.

[0131] Next, in step S34, the second control unit 31, in accordance with a control program stored in the ROM within the second control unit 31, causes the image processing unit 37 to perform image processing to create first to fourth thumbnail images from the "first to fourth images" selected in step S33.

[0132] In the next step S35, the second control unit 31 causes the display processing unit 38 to perform a display process for displaying the first to fourth thumbnail images created in step S34 on the display unit 32 in accordance with a control program stored in the ROM within the second control unit 31. Specifically, the thumbnail images are arranged in a matrix structure as shown in Fig. 5 and are displayed as a list on the same screen. This completes the thumbnail image creation and display process for one event.

[0133] As described above, the driving support device 30 of the third embodiment has the following advantages. In the case of an event example caused by abrupt steering, such as an impact on the vehicle, the first image captured at time t3 when steering wheel rotation started, the second image captured just before time tp, the third image captured just after time tp, and the fourth image captured at time t4 when steering wheel rotation ended are selected, and first to fourth thumbnail images are created from the selected first to fourth images and displayed on the display unit 32. In this way, in the case of abrupt steering, by checking the first to fourth thumbnail images corresponding to the first to fourth images captured at different times among the event unit images captured during a predetermined period before and after the event occurrence time (time tp), particularly the time points including the time t3 when steering wheel rotation started and the time t4 when steering wheel rotation ended, it is possible to easily check the contents of the event unit images stored in the case of abrupt steering as an event example, and it is easy to grasp the cause and situation of the occurrence of abrupt steering.

[0134] For example, when searching for an event unit image related to abrupt steering from among a large number of event unit images stored for each event occurrence, the event unit image related to the desired abrupt steering can be easily found from the thumbnail image, as compared with the case where the content of the event unit image is confirmed from a thumbnail image at one time point related to the event unit image and the event unit image related to the abrupt steering is searched for.

[0135] Also, by vertically viewing the thumbnail images in the first row from the left of the 16 thumbnail images shown in Fig. 5, it is possible to compare images at the time when steering operation started (when steering wheel rotation started). By vertically viewing the thumbnail images in the second row, it is possible to compare images immediately before the time when an event was determined to have occurred due to steering wheel operation, and by vertically viewing the thumbnail images in the third row, it is possible to compare images immediately after that. Furthermore, by vertically viewing the thumbnail images in the fourth row, it is possible to compare images at the time when steering operation stopped (when steering wheel rotation ended).

[0136] Furthermore, creating a thumbnail image at the time when the steering wheel rotation starts as in the third embodiment is advantageous when the steering wheel operation and the acceleration event are not linked, as described below. For example, there are cases where acceleration occurs regardless of steering operation, such as when the vehicle collides or travels up a slope, and cases where acceleration occurs due to steering operation such as sudden steering. The first thumbnail image in the third embodiment (first row from the left in FIG. 5 above) is from the time when the steering wheel starts to turn, but there are cases where the steering wheel operation and the acceleration event are not linked. According to the third embodiment, it is possible to display a thumbnail image of the time when the steering wheel rotation started, which has a predetermined relationship with the occurrence of an event. Therefore, particularly in cases where the time when the steering wheel rotation started does not coincide with the time when the acceleration event started, it is possible to confirm the relationship between the time when the steering wheel rotation started and the occurrence of an event from the thumbnail image of the time when the steering wheel rotation started, rather than the thumbnail image of the time when the acceleration event started to appear, and this can be useful in understanding the cause of the event and the situation.

[0137] [Example 4] In the fourth embodiment, a vehicle collision is taken as an example of an event in which an impact is applied to a vehicle. FIG. 10 is a diagram showing the change in acceleration in the event of a vehicle collision, and shows the time-series change in the G data (a composite value of Gx and Gy) output from the G sensor 12. In FIG.

[0138] 10, when the vehicle collides with something at time t5, the G sensor 12 detects and changes the acceleration (Gx) in the forward / rearward direction and the acceleration (Gy) in the left / right direction of the vehicle. The acceleration (G data) from the G sensor 12 increases rapidly immediately after time t5, and then decreases rapidly again. When the acceleration increases rapidly and reaches a threshold acceleration Gs (for example, 0.3G) (time tp), the first control unit 11 recognizes this as a trigger, determines (judges) that an event has occurred, and stores the image captured by the CCD camera 20 and always stored in the first memory 108 in the memory card 25, and also operates to store the time tp in the memory card 25 as event occurrence determination time data.

[0139] Specifically, in the fourth embodiment as well, similarly to the first, second and third embodiments, control is performed so that an image PA for TA seconds before time tp and an image PB for TB seconds after time tp are stored in the memory card 25.

[0140] The acceleration continues to increase after time tp, reaches a maximum value, then suddenly decreases, passes through zero, reaches a minimum value, then suddenly increases, passes through zero again, reaches a maximum value again, then suddenly decreases, passes through zero again, and repeats this rapid decrease until the vehicle comes to a stop and the acceleration converges (t6), at which point it becomes zero.

[0141] In Fig. 10, the period Th from time t5 to time tp is the "period of impact before the big impact", during which a shock waveform appears due to the impact reduction effect of the vehicle bumper, guard rail, etc. Also, the period Ti from time tp to time t6 is the period of "shock behavior".

[0142] <Creating and displaying thumbnail images (Example 4)> Fig. 11 is a flowchart showing thumbnail image creation and display processing according to Example 4, which is realized by the CPU executing a control program loaded from an HDD or the like into the RAM of the second control unit 31 of the driving support device 30 in the same manner as in Examples 1, 2, and 3, and is started based on an operation to start the driving support software by the second operation unit 34. Also, it is assumed that the memory card 25 on which images are stored in the drive recorder 10 is inserted into the second IF 36 constituting a slot at the time the processing of the flowchart shown in Fig. 11 is started.

[0143] In step S41, the second control unit 31 acquires event occurrence determination time data (tp) from the data stored in the memory card 25. Then, in step S42, the second control unit 31 acquires the vehicle speed (vehicle speed data) output from the vehicle signal acquisition unit 21 from the data stored in the memory card 25. Furthermore, in step S43, the second control unit 31 acquires the detected G data (Gx, Gy) of the G sensor 12 from the data stored in the memory card 25.

[0144] Next, in step S44, the second control unit 31 selects multiple images taken at multiple different times related to the vehicle collision from among images PA taken TA seconds before time tp shown in Figure 3(b) and images PB taken TB seconds after time tp. Specifically, the control program includes the following control processes: from among the image PA for TA seconds before the time tp shown in Fig. 3(b) and the image PB for TB seconds after the time tp, the image captured at the time tp3 when the magnitude (value) of the G data immediately after the time t5 of the vehicle collision repeats rapid decreases and reaches the second maximum value (i.e., the time when the vehicle accelerates due to the reaction of the bumper, guardrail, etc.) is selected as the "first image", the image captured immediately before the time tp (before a predetermined time TC, for example, 0.2 seconds before) is selected as the "second image", the image captured immediately after the time tp (after the predetermined time TC, for example, 0.2 seconds after) is selected as the "third image", and the image captured at the time t6 when the vehicle speed becomes zero (i.e., the time when the acceleration behavior converges) is selected as the "fourth image". The second control unit 31 performs the selection control of the first to fourth images from the image PA and the image PB according to the above control program.

[0145] The predetermined time TC can be set to, for example, 0.2 seconds, but an optimal value, including 0 seconds, can be selected depending on the application. Furthermore, in addition to the above-mentioned images taken immediately after time t5, immediately before or immediately after time tp, and time t6, images may be selected that are taken at the time when the acceleration reaches a maximum value (maximum value), immediately before or immediately after that, or at the time when the acceleration reaches a minimum value (minimum value), or immediately before or immediately after that.

[0146] Next, in step S45, the second control unit 31, in accordance with a control program stored in the ROM within the second control unit 31, causes the image processing unit 37 to perform image processing to create first to fourth thumbnail images from the "first to fourth images" selected in step S44.

[0147] In the next step S46, the second control unit 31, in accordance with a control program stored in the ROM within the second control unit 31, causes the display processing unit 38 to perform a display process for displaying the first to fourth thumbnail images created in step S45 on the display unit 32. Specifically, as shown in Fig. 5, the thumbnail images are arranged in a matrix structure and displayed as a list on the same screen. This completes the thumbnail image creation and display process for one event.

[0148] As described above, the driving support device 30 of the fourth embodiment has the following advantages. In the case of a vehicle collision as an example of an event in which an impact is applied to a vehicle, a first image taken at the point in time when the G data repeatedly increases and decreases immediately after time t5 when the vehicle collided (the point in time of reactionary acceleration behavior), a second image taken just before time tp, a third image taken just after time tp, and a fourth image taken at time t6 when the vehicle speed became zero (the point in time when acceleration converged) are selected, and first to fourth thumbnail images are created from the selected first to fourth images and are controlled to be displayed on the display unit 32. As a result, in the case of a vehicle collision, by checking the first to fourth thumbnail images corresponding to the first to fourth images taken at different points in time among the event-unit images taken over a predetermined period before and after the event occurrence point (time tp), particularly at points including the point when the G data repeatedly increases and decreases rapidly immediately after time t5 when the vehicle collided (the point of reactionary acceleration behavior) and the time t6 when the vehicle speed became zero (the point when acceleration converged), it is possible to easily check the contents of the event-unit images stored in the case of a vehicle collision as an event example, and it is easy to grasp the cause and circumstances of the vehicle collision.

[0149] For example, when searching for an event unit image related to a vehicle collision from among a large number of event unit images stored for each event occurrence, the event unit image related to the desired vehicle collision can be easily found from the thumbnail image, compared to the case where the content of the event unit image is checked from a thumbnail image of a single point in time related to the event unit image to search for the event unit image related to the vehicle collision.

[0150] Moreover, by vertically viewing the thumbnail images in the first row from the left of the 16 thumbnail images shown in Fig. 5, it is possible to compare images at the time of a vehicle collision. By vertically viewing the thumbnail images in the second row, it is possible to compare images immediately before the time when an event was determined to have occurred due to a vehicle collision, and by vertically viewing the thumbnail images in the third row, it is possible to compare images immediately after that. Furthermore, by vertically viewing the thumbnail images in the fourth row, it is possible to compare images at the time when the vehicle speed became zero.

[0151] <Experimental Examples> FIG. 12 is a diagram showing an experimental example of acceleration change in the event of a vehicle-to-vehicle collision, in relation to acceleration change in the event of a vehicle collision according to Example 4 shown in FIG. 10, and shows the value of detected acceleration Gx in the X-axis direction (front-to-rear direction of the vehicle), the value of detected acceleration Gy in the Y-axis direction (left-right direction of the vehicle), and the value of detected acceleration Gz in the Z-axis direction (up-down direction of the vehicle) output from the G sensor 12 as their respective time-series changes.

[0152] In this experimental example, as shown in FIG. 12, when a vehicle collides with something at time t7, the values ​​of Gx, Gy, and Gz begin to rapidly decrease and increase in a relatively short period immediately after time t7. When the value of Gx reaches a threshold acceleration Gs (e.g., 1.0) (time tp), a trigger is recognized and it is determined that an event has occurred. After time tp, the value of Gx may become slightly larger, but eventually converges to near zero (time t8). Also, after time tp, the values ​​of Gy and Gz are relatively small, and eventually converge.

[0153] In Fig. 12, the period Tj from time t7 to time tp is the "period of impact before the big impact" like the period Th in Fig. 10, and during this period Tj, an impact waveform appears due to impact reduction caused by the effect of the vehicle bumper, guard rail, etc. Also, the period Ti from time tp to time t8 is the "impact behavior" period like the period Ti in Fig. 10, and during this period Tk, the vehicle moves in reaction after the impact.

[0154] <Display example> FIG. 13 is a diagram showing a display example of the thumbnail screen related to the experimental example shown in FIG. In this display example, the memory card 25 that is inserted into the drive recorder 10 and records driving information including camera images and image-related information is removed and displayed on the display unit 32 of the driving support device 30. In Figure 13, 16 thumbnail images are arranged in a matrix structure of 4 rows and 4 columns and displayed on the same screen, with each row displaying event-unit images 71, 72, 73, 74 relating to one event, and each column displaying time-unit images 71, 72, 73, 74 created from images taken at the same point in time (more precisely, the same point in time for each event relative to the event occurrence time tp).

[0155] Next, a method for displaying a list of thumbnail images arranged in a matrix structure as described above will be described below. First, the user selects files 91, 92, 93, and 94 of multiple events (four in this example) that he or she wishes to display from the playlist 90 in the upper right corner of the display image shown in Fig. 13 using the second operation unit 204. Next, event unit images corresponding to the files 91, 92, 93, and 94 of the selected events are loaded, and thumbnail images are created and displayed based on the loaded files in accordance with the processing procedure in the flowchart in Fig. 4, and the thumbnail images are arranged in a matrix structure and displayed in a list on the same screen.

[0156] In the display example of FIG. 13, the event-unit images 71 displayed on each row display thumbnail images created from images taken at four points in time for an event in file 91: (i.e., [1] the point in time at which the event occurs, which is TA seconds before the event occurrence time tp; [2] just before time tp (just before the event occurs); [3] just after time tp (just after the event occurs); and [4] the point at which event detection ends, which is TB seconds after time tp). Similarly, event-unit image 72 displays thumbnail images of the above four points in time for the events in file 92, event-unit image 73 displays thumbnail images of the above four points in time for the events in file 93, and event-unit image 74 displays thumbnail images of the above four points in time for the events in file 94.

[0157] In the display example of Figure 13, the time-point unit images 81 displayed in each column display thumbnail images created from images taken at the time of event occurrence, which is TA seconds before the event occurrence time tp, out of the four thumbnail images of event unit images 71, 72, 73, and 74 [1]. Similarly, the time-point unit image 82 displays [2] a thumbnail image created from an image taken just before the event occurrence time tp (just before the event occurs) out of the four thumbnail images of each of the event-unit images 71, 72, 73, and 74, the thumbnail image created from an image taken just after the event occurrence time tp (just after the event occurs) out of the four thumbnail images of each of the event-unit images 71, 72, 73, and 74, and the time-point unit image 84 displays [4] a thumbnail image created from an image taken at the end of event detection, which is TB seconds after the event occurrence time tp, out of the four thumbnail images of the event-unit images 71, 72, 73, and 74.

[0158] <Modification> The present invention is not limited to the above-described embodiment of the present invention, and various modifications are possible. For example, the following modifications may be made.

[0159] (1) In the above embodiment, the time (time tp) when the value (magnitude) of the G data output from the G sensor 12 reaches the threshold acceleration Gs is recognized as a trigger and it is determined that an event has occurred, but this is not limited thereto, and for example, the time when the value (magnitude) of the angular acceleration data output from the gyro sensor 13 or the atmospheric pressure / altitude data output from the atmospheric pressure sensor 14 reaches a predetermined value may be recognized as a trigger and it may be determined that an event has occurred. Also, it may be determined that an event has occurred based on the results of analyzing recorded video. Other examples of event occurrences include when the emergency switch of the first operating unit 17 is pressed, when a signal is input from an external port, and when a command is received via communication (e.g., RS-232C) from an external device such as an AVM-ECU (Automatic Vehicle Monitoring - Engine Control Unit).

[0160] (2) In the above embodiment, the first to fourth images taken at four time points are selected for each event such as sudden braking, sudden steering, and vehicle collision from the images stored for a predetermined period for each event, and the first to fourth thumbnail images are created, but this is not limiting, and multiple images taken at multiple different time points other than the four time points may be selected, and thumbnail images corresponding to the selected images may be created. In addition, various combinations of multiple different time points may be used depending on the type of event, but it is preferable to use a combination of time points at which the characteristics of the event appear (a specific period within the predetermined period). The combination of times at which the characteristics of an event appear can be determined by using, alone or in combination, various data such as "data detecting vehicle behavior" and "data relating to the functional status of the vehicle" stored on memory card 25 together with the image data, and based on that data, multiple images taken at appropriate times are selected and thumbnail images corresponding to the selected images are created.

[0161] The "data detecting vehicle behavior" may be, for example, acceleration data, angular acceleration data, air pressure / altitude data, video analysis data, etc. Also, the "data relating to the functional state of the vehicle" may be, for example, data relating to the operation of the brake, turn signal, accelerator, steering wheel rotation, shift lever position, or handbrake while driving the vehicle, or data obtained from the OBD (On Board Diagnosis) vehicle fault diagnosis system or the CAN (Controller Area Network) in-vehicle LAN.

[0162] (3) In the above embodiment, the occurrence of an event is determined using a composite value of the component acceleration (G data) Gx in the X-axis direction (front-rear direction of the vehicle) and the component acceleration (G data) Gy in the Y-axis direction (left-right direction of the vehicle) as G data, but this is not limiting, and the occurrence of an event may be determined using each component acceleration (Gx, Gy) individually. For example, when the change pattern of the value (magnitude) of each component takes a predetermined pattern, such as when Gx exceeds a predetermined threshold value and then Gy exceeds a predetermined threshold value within a predetermined time, a trigger may be recognized and it may be determined that an event has occurred. Furthermore, the occurrence of an event may be determined by taking into account the component acceleration Gz in the Z-axis direction (up-down direction of the vehicle) in addition to Gx and Gy.

[0163] (4) Not limited to the above-described embodiment, an image captured at the time when information (e.g., G data (Gx) in the longitudinal direction of the vehicle due to sudden braking) different from information used to determine that an event has occurred (e.g., G data (Gy) in the lateral direction of the vehicle due to sudden steering) reaches a predetermined value (e.g., a maximum value) may be selected, and a thumbnail image may be created. This makes it possible to easily find an event-unit video related to the occurrence of an event at the time when information (e.g., G data (Gx) due to sudden braking) different from information used to determine that an event has occurred (e.g., G data (Gy) due to sudden steering) reaches a predetermined value.

[0164] (5) Not limited to the above-described embodiment, thumbnail images may be created by selecting images captured at a time point from the time (time tp) when the value (magnitude) of the G data reaches the threshold acceleration Gs and it is determined that an event has occurred, to estimate the occurrence time of a sub-event that caused the event, such as the time point when the G data reaches a maximum value or a minimum value, the time point when the G data changes in time series, or the time point when the G data changes characteristically, such as repeatedly increasing and decreasing in a short period of time. This makes it possible to easily find event-unit images related to an event at a time point when the occurrence time of a sub-event that caused the event, such as the time point when the G data changes characteristically, such as a rapid increase and decrease, is estimated.

[0165] (6) In the above embodiment, the drive recorder 10 is a trigger recording type that records video before and after a "trigger indicating that a recording condition has been met," but the present invention is not limited to this. For example, the drive recorder may be a continuous recording type that records continuously from engine on to engine off and stores information that enables identification of the position of the video where the trigger has been activated. In this continuous recording type drive recorder, for example, it is possible to identify which position in which video the trigger has been activated from the video recording start time information and the trigger time information. In the case of the above-mentioned trigger recording type drive recorder, for example, the video recorded over a predetermined period before and after the occurrence of a trigger indicating that a recording condition by the drive recorder has been satisfied may be regarded as the "event-unit video." Also, in the case of the above-mentioned continuous recording type drive recorder, for example, the "event-unit video" may be a portion of the video recorded over a predetermined period before and after the occurrence of a trigger, in which one recording unit is from engine on to engine off.

[0166] (7) In the above embodiment, the image PA for TA seconds and the image PB for TB seconds before and after the time tp at which it is determined that an event has occurred are stored in the memory card 25. However, this is not limiting, and for example, images for the entire time from engine on to engine off, or images for a limited period of time within that entire time, may be stored in the memory card 25. The limited period of time within the entire time may be the time including the time tp at which it is determined that an event has occurred. The total time of TA seconds and TB seconds before and after the time tp may be a fixed time for each event occurrence, or may be a variable time. The total time of TA seconds and TB seconds should be a period sufficient to enable identification of the cause of the event occurrence. In particular, the total time of TA seconds and TB seconds should be different depending on the type of event.

[0167] (8) In the above embodiment, the TA seconds and TB seconds before and after the time tp at which it is determined that an event has occurred are the same (in the embodiment, 12 seconds before and 12 seconds after), but this is not limiting and, for example, different times are acceptable. In particular, it is acceptable to lengthen the TA seconds before time tp and shorten the TB seconds after (for example, 15 seconds before and 5 seconds after).

[0168] (9) In the above-described embodiment, the first to fourth images taken TA seconds before, just before (TC seconds before), just after (TC after) and TB seconds after the time tp determined to be an event occurrence are selected from the images PA within TA seconds and the images PB within TB seconds before and after the time tp determined to be an event occurrence, and the first to fourth thumbnail images are created from the selected first to fourth images. However, this is not limited to the above, and for example, a combination of two or three images from the first to fourth images may be selected, or any number of images from one to four from the first to fourth images may be selected in combination with one or more images from other points in time, and a thumbnail image may be created from the selected images.

[0169] (10) In the above-described embodiment, an image taken before or after the time tp at which it is determined that an event has occurred is selected. However, this is not limited to this. An image taken at time tp may be selected and combined with images taken before or after time tp.

[0170] (11) In the above-mentioned embodiment, as in the example of the display mode of thumbnail images shown in FIG. 5, 16 thumbnail images are arranged to form an event unit image for one event for each row, and a time-point unit image for the same time for each column. However, this is not limited to this, and the rows and columns may be interchanged to form an event unit image for each column, and a time-point unit image for each row. Also, when an event unit image for one event is formed for each row (or column), the event unit images in one row (or column) may be arranged in chronological order, and images may be formed according to the time point of the event, rather than the same time for each column. Furthermore, the images may be arranged in a matrix structure with other combinations of the number of rows and columns, such as 5 rows x 5 columns or 3 rows x 3 columns, and displayed on the same screen. Furthermore, when the images cannot be displayed on the screen, it is preferable to scroll the matrix as a whole, rather than scrolling each event left and right.

[0171] (12) In the above embodiment, the display control system of the present invention has been described as an example of a driving assistance system (driving assistance device 30), but it may be implemented as a function of various electronic devices. For example, it may be incorporated as a function of a navigation device, a drive recorder, a radar detector, and a car audio device.

[0172] (13) Not limited to the above-described embodiment, a control program pre-stored in the ROM of the second control unit 31 of the driving assistance device 30 may be downloaded to a portable terminal such as a general-purpose personal computer, a mobile phone, a smartphone, or a portable game console, and a computer mounted on the portable terminal may be caused to execute the control processing of the second control unit 31, read images and various data stored in the memory card 25, and display thumbnail images created from the read images and various data.

[0173] (14) Although each function of the above embodiment is realized by writing the function in a computer-readable programming language and having the computer of the second control unit 31 execute the program, this is not limited thereto. For example, the program may be distributed among multiple computers for distributed processing. [Explanation of symbols]

[0174] 10. Drive recorder 11 First Control Section 12 Acceleration sensor (G sensor) 13 Gyro sensor 14 Barometric pressure sensor 15 GPS antenna 16 GPS receiver 17 1st operation section 18 First Memory 19 1st IF (Interface) 20 CCD camera 21 Vehicle signal acquisition unit 22 Power supply section 25 Memory Card 30 Driving assistance device 31 Second Control Section 32 Display section 33 Output section 34 2nd operation section 35 Second Memory 36 2nd IF (Interface) 37 Image Processing Section 38 Display processing section 51~54,71~74 Event unit images 61~64,81~84 Time unit images 90 Playlists Files 91-94

Claims

1. A display control system for controlling display of thumbnail images related to video recorded by an electronic device mounted on a vehicle, comprising: A function for arranging a plurality of thumbnail images in a matrix structure with a predetermined number of rows and columns based on the recorded video and displaying them on the same screen in a list, a function of displaying thumbnail images created based on the video images relating to different events in each of a plurality of rows, and displaying thumbnail images created based on the video images taken in relation to the same event in each row; When there are more thumbnail images than can be displayed on the screen, the matrix is ​​scrolled as a whole, rather than scrolling for each event. A display control system comprising:

2. A display control system for controlling display of thumbnail images related to video recorded by an electronic device mounted on a vehicle, comprising: A function for arranging a plurality of thumbnail images in a matrix structure with a predetermined number of rows and columns based on the recorded video and displaying them on the same screen in a list, a function of displaying thumbnail images created based on the video images relating to different events in each of a plurality of rows, and displaying thumbnail images created based on the video images taken in relation to the same event in each column; When there are more thumbnail images than can be displayed on the screen, the matrix is ​​scrolled as a whole, rather than scrolling for each event. A display control system comprising:

3. The plurality of thumbnail images include an image showing a state in front of the vehicle at the time when the event occurred, The image includes an image showing the state in front of the vehicle immediately before the event occurrence determination time, an image showing the state in front of the vehicle immediately after the event occurrence determination time, and an image showing the state in front of the vehicle at the end of the event detection. The display control system according to claim 1 .

4. The display function creates and displays the thumbnail image based on video analysis data of the recorded video. The display control system according to claim 1 .

5. A program for causing a computer to realize the functions of the display control system according to any one of claims 1 to 4.

Images