Recording / playback control device and recording / playback control method

Abstract

To allow a user to properly refer to recorded data of an event which is likely to be neglected or overlooked by a user.SOLUTION: A recording / reproducing control device comprises: a photographic data acquisition unit for acquiring photographic data captured by a camera that captures a video in a vehicle; an event detection unit for detecting an event with respect to the vehicle based on an acceleration applied to the vehicle; a recording control unit for storing photographic data of a first time period based on the detection of the event as event recording data together with acceleration information when the event detection unit detects the event; and an output control unit for outputting a plurality of event record data in order of magnitudes of acceleration added to the plurality of event record data when reproducing the plurality of event record data that occur within a predetermined period.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a recording and reproduction control device and a recording and reproduction control method. [Background technology]

[0002] Some drive recorders detect events equivalent to accidents as well as situations that are not accidents but are called near misses, and save these as event record data.

[0003] For example, Patent Document 1 discloses a drive recorder that records and plays back potential dangers such as near misses. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-175220 A Summary of the Invention [Problem to be solved by the invention]

[0005] Although the driver rarely actively refers to the event record data that records conditions such as near misses that are not accidents, it is useful for the driver to refer to it in order to drive safely. In addition, when the driver or the like is absent and the event record data is recorded while the vehicle is parked, the driver may not notice that an event has occurred when the driver ends parking and starts using the vehicle. Therefore, even with the technology described in Patent Document 1, if the playback of the event record data is left up to the user, there is a possibility that the event record data cannot be effectively utilized. In addition, there is a possibility that an event that is actually an accident but is not noticed by the driver may be left unattended.

[0006] An object of the present invention is to provide a recording / playback control device and a recording / playback control method that allow a user to appropriately refer to event record data that is likely to be left unattended or overlooked by the user. [Means for solving the problem]

[0007] The recording and playback control device of the present invention comprises a shooting data acquisition unit that acquires shooting data captured by a camera that captures video in a vehicle; an event detection unit that detects an event with respect to the vehicle based on acceleration applied to the vehicle; a recording control unit that, when the event detection unit detects an event, saves the shooting data of a first period based on the detection of the event as event record data together with acceleration information; and an output control unit that, when playing back multiple event record data that have occurred within a specified period, outputs the multiple event record data in order of the magnitude of the acceleration added to them.

[0008] Another aspect of the recording and playback control device of the present invention includes an imaging data acquisition unit that acquires imaging data captured by a camera that captures video in a vehicle, an event detection unit that detects an event for the vehicle, a recording control unit that, when the event detection unit detects an event, stores the imaging data for a first period based on the detection of the event as event record data, a vehicle information acquisition unit that acquires power on or off information for the vehicle, and an output control unit that, when the vehicle information acquisition unit acquires the power on or off information for the vehicle, if the number of event record data stored based on events occurring in an operating period prior to the power on or off point is less than a predetermined number, outputs the event record data stored based on events occurring in the operating period so as to play the first period of the recording period of the event record data, and if the number of event record data stored based on events occurring in the operating period prior to the power on or off point is equal to or greater than a predetermined number, outputs the event record data stored based on events occurring in the operating period so as to play a second period of the recording period of the event record data, which is shorter than the first period.

[0009] Another aspect of the recording and playback control device of the present invention includes an imaging data acquisition unit that acquires imaging data captured by a camera that captures video in a vehicle, an event detection unit that detects an event based on acceleration applied to the vehicle, a recording control unit that, when the event detection unit detects an event, stores the imaging data of a first period based on the detection of the event as event record data, a vehicle information acquisition unit that acquires power on or off information of the vehicle, and an output control unit that, when the vehicle information acquisition unit acquires the power on or off information of the vehicle, outputs the event record data stored based on an event that occurred in the operation period prior to the power on or off time so as to play the first period of the recording period of the event record data if the acceleration at the time of event detection of the event record data stored based on an event that occurred in the operation period prior to the power on or off time is a steeply rising acceleration, and outputs the event record data stored based on an event that occurred in the operation period so as to play the second period of the recording period of the event record data, which is shorter than the first period, if the acceleration at the time of event detection of the event record data stored based on an event that occurred in the operation period prior to the power on or off time is a gradual rising acceleration.

[0010] The recording and playback control method of the present invention includes a recording and playback control device which executes the following steps: a shooting data acquisition step of acquiring shooting data captured by a camera that captures video on a vehicle; an event detection step of detecting an event with respect to the vehicle based on acceleration applied to the vehicle; a recording control step of, if an event is detected in the event detection step, saving the shooting data for a first period based on the detection of the event as event record data together with acceleration information; and an output control step of, when playing back multiple event record data that have occurred within a specified period, outputting the multiple event record data in order of the magnitude of acceleration added to them.

[0011] In another aspect of the recording and playback control method of the present invention, a recording and playback control device executes the following steps: a shooting data acquisition step of acquiring shooting data captured by a camera that captures video in a vehicle; an event detection step of detecting an event for the vehicle; a recording control step of saving the shooting data for a first period based on the detection of the event as event record data if an event is detected in the event detection step; a vehicle information acquisition step of acquiring power-on information or off information for the vehicle; and, when the power-on information or off information for the vehicle is acquired in the vehicle information acquisition step, if the number of event record data stored based on events occurring in an operation period prior to the power-on or off time point is less than a predetermined number, an output control step of outputting the event record data stored based on events occurring in the operation period so as to play the first period of the recording period of the event record data, and, if the number of event record data stored based on events occurring in the operation period prior to the power-on or off time point is equal to or greater than the predetermined number, an output control step of outputting the event record data stored based on events occurring in the operation period so as to play a second period of the recording period of the event record data, which is shorter than the first period.

[0012] A recording and reproducing control method according to another aspect of the present invention includes a photographing data acquisition step of acquiring photographed data captured by a camera that captures video in a vehicle, an event detection step of detecting an event based on acceleration applied to the vehicle, a recording control step of saving photographed data of a first period based on the detection of the event as event record data when an event is detected in the event detection step, a vehicle information acquisition step of acquiring power-on information or power-off information of the vehicle, and, when the power-on information or power-off information of the vehicle is acquired in the vehicle information acquisition step, saving the event record data based on an event that occurred during an operating period prior to the power-on or power-off point. The recording and playback control device executes an output control step of outputting the event record data stored based on an event occurring during the operating period so as to play back the first period of the recording period of the event record data if the acceleration at the time of event detection is a steeply rising acceleration, and outputting the event record data stored based on an event occurring during the operating period so as to play back the second period of the recording period of the event record data, which is a period shorter than the first period, if the acceleration at the time of event detection of the event record data stored based on an event occurring during the operating period is a gradual rising acceleration. Effect of the Invention

[0013] According to the present invention, it is possible to allow a user to appropriately refer to event record data that is likely to be neglected or overlooked by the user. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a block diagram showing the configuration of a recording and reproducing control system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating an example of additional information associated with event record data. [Diagram 3] FIG. 3 is a diagram for explaining a playback period of the event record data. [Figure 4]FIG. 4 is a diagram for explaining the playback period of the event record data. [Diagram 5] FIG. 5 is a flowchart showing an example of the process flow of the recording and reproduction control device according to the first embodiment of the present invention. [Figure 6] FIG. 6 is a flowchart showing an example of the process flow of the recording and reproduction control device according to the second embodiment of the present invention. [Figure 7] FIG. 7 is a flowchart showing an example of the process flow of the recording and reproduction control device according to the third embodiment of the present invention. [Figure 8] FIG. 8 is a flowchart showing an example of the process flow of the recording and reproduction control device according to the fourth embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the embodiment, and when there are multiple embodiments, the present invention also includes a configuration in which each embodiment is combined. [First embodiment] The configuration of a recording and reproducing control system according to an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of a recording and reproducing control system according to an embodiment of the present invention.

[0016] 1, the recording and reproducing control system 1 includes a camera 10, a microphone 20, a storage unit 30, an operation unit 40, a display unit 50, a sensor unit 60, a GPS receiving unit 70, a communication unit 80, a battery 90, and a recording and reproducing control device 100. Such a recording and reproducing control system 1 can be applied to, for example, a drive recorder mounted on a vehicle.

[0017] The camera 10 captures video of the surroundings of the vehicle. For example, the camera 10 captures video of the surroundings of the vehicle while it is running and while it is parked. For example, the camera 10 captures video of the area in front of the vehicle. The camera 10 may add information such as a time stamp and latitude and longitude information to the captured video data so as to identify the date, time, and location of the capture. The camera 10 may be realized, for example, by a camera mounted on a drive recorder. The camera 10 outputs the captured video data to the capture data acquisition unit 121.

[0018] The microphone 20 detects sounds inside and outside the vehicle. For example, the microphone 20 acquires vehicle collision sounds in a traffic accident or the like occurring around the vehicle, and the voices of people. The microphone 20 may add time-related information, such as a timestamp, to the detected voice data so that the date and time of detection can be specified. The microphone 20 can be realized by a general microphone. The microphone 20 outputs the acquired voice to the voice data acquisition unit 122.

[0019] The storage unit 30 stores, for example, a program for implementing each unit of the recording and playback control device 100. The storage unit 30 can be implemented, for example, by a semiconductor memory element such as a random access memory (RAM), a read only memory (ROM), or a flash memory, or a storage device such as a hard disk, a solid state drive, or an optical disk. The storage unit 30 may be configured with a plurality of different memories. The storage unit 30 stores, for example, map information 32 and a recognition dictionary 33, and when an event is detected, saves event record data 31. The event record data may be saved as data that cannot be overwritten. When the storage unit 30 is constantly recording the photographic data captured by the camera 10, the storage unit 30 records the constantly recorded photographic data in an overwritable manner. The map information 32 may utilize map information stored in a navigation device or another device.

[0020] The event record data 31 is image data stored based on a detected event. Specifically, the event record data 31 is image data stored when an event is determined based on, for example, the acceleration applied to the vehicle. In addition, the event record data 31 is not limited to an event based on the acceleration applied to the vehicle, and may be image data stored based on the proximity of another vehicle or person to the vehicle.

[0021] The map information 32 includes, for example, information relating to roads and facilities.

[0022] The recognition dictionary 33 is dictionary data for the recording and reproduction control device 100 to recognize various objects contained in the video data. That is, the recording and reproduction control device 100 detects various objects from the video data using the recognition dictionary 33. Specifically, the recording and reproduction control device 100 detects various objects contained in the video data by comparing shape data contained in the recognition dictionary 33 with the shapes of the objects contained in the video data. For example, the recording and reproduction control device 100 recognizes vehicles and people contained in the video data using the recognition dictionary 33. Note that the method by which the recording and reproduction control device 100 detects other vehicles is not limited to this. The recording and reproduction control device 100 may detect objects using other well-known methods.

[0023] The operation unit 40 accepts various operations from a user to the recording and playback control device 100. The operation unit 40 can be realized, for example, by a physical operation means, a touch panel provided on the display unit 50, a remote control device, or the like.

[0024] The display unit 50 displays various images. For example, when the event record data 31 stored in the storage unit 30 is output, that is, reproduced, by the output control unit 125, the display unit 50 displays the reproduced event record data 31. For example, the display unit 50 is a display including a liquid crystal display (LCD) or an organic electro-luminescence (OLED) display. However, the display unit 50 is not limited to these.

[0025] The sensor unit 60 detects various types of information about the host vehicle. The sensor unit 60 is, for example, an acceleration sensor, and detects acceleration applied to the host vehicle. The sensor unit 60 is, for example, a gyro sensor, and detects information about the attitude of the host vehicle. The sensor unit 60 outputs the detection result to the event detection unit 128.

[0026] The GPS receiving unit 70 is composed of a GPS receiving circuit, a GPS receiving antenna, etc., and receives the PS signal. The GPS receiving unit 70 outputs the received GPS signal to the current position calculation unit 12. Output to 9.

[0027] The communication unit 80 communicates information with an external information processing device via a wired or wireless network (not shown). The communication unit 80 communicates information, for example, between the recording / playback control device 100 and a terminal device owned by a user (for example, a driver). Specifically, the communication unit 80 transmits the event record data 31 output by the output control unit 125 to the terminal device owned by the user. Here, examples of the terminal device include, but are not limited to, a PC (Personal Computer), a smartphone, and a tablet terminal.

[0028] The battery 90 is a power source for operating the recording and reproduction control system 1. For example, when the power of the vehicle is on, the recording and reproduction control system 1 is supplied with power from the vehicle. Here, when the power of the vehicle is on, power is supplied to the battery 90 to charge the battery 90. Then, when the power of the vehicle is off, the battery 90 supplies power to the recording and reproduction control system 1. Note that the recording and reproduction control system 1 does not necessarily need to be provided with the battery 90 if power can be secured by a method other than the battery 90 when the power of the vehicle is off.

[0029] The recording and reproducing control device 100 is mounted on the vehicle and controls the functions of the recording and reproducing control system 1, such as reproducing the event recording data 31 including detecting an event. The recording and reproducing control device 100 includes an image data acquisition unit 121, an audio data acquisition unit 122, a vehicle information acquisition unit 123, a storage control unit 124, an output control unit 125, an operation control unit 126, a display control unit 127, an event detection unit 128, and a current position calculation unit 129. The image data acquisition unit 121, the audio data acquisition unit 122, the vehicle information acquisition unit 123, the storage control unit 124, the output control unit 125, the operation control unit 126, the display control unit 127, the event detection unit 128, and the current position calculation unit 129 are each connected via a bus 110. The recording and reproducing control device 100 can be realized, for example, by an electronic circuit including a CPU (Central Processing Unit).

[0030] The image capturing data acquisition unit 121 acquires image capturing data from an external source. For example, the image capturing data acquisition unit 121 acquires, from the camera 10, video data captured by the camera 10. Note that the image capturing data acquired by the image capturing data acquisition unit 121 is not limited to this.

[0031] The voice data acquisition unit 122 acquires voice data from an external source. For example, the voice data acquisition unit 122 acquires voice data detected by the microphone 20 from the microphone 20. Note that the voice data acquired by the voice data acquisition unit 122 is not limited to this.

[0032] The data such as the event record data 31 stored in the storage unit 30 may be video data acquired by the shooting data acquisition unit 121, and may also include audio data acquired by the audio data acquisition unit 122. The data such as the event record data 31 stored in the storage unit 30 will be described as shooting data, regardless of the presence or absence of audio data.

[0033] The vehicle information acquisition unit 123 acquires various vehicle information related to the vehicle. For example, the vehicle information acquisition unit 123 acquires on information or off information, which is a switching signal between an on state and an off state of the power of the vehicle, as the vehicle information. In this case, the vehicle information acquisition unit 123 outputs, for example, a power information signal indicating the on information or off information to the output control unit 125. For example, the vehicle information acquisition unit 123 acquires various information related to the vehicle from a CAN (Controller Area Network) or the like.

[0034] The vehicle information acquisition unit 123 determines whether the power of the host vehicle is on or off based on the presence or absence of power supply from the host vehicle to the recording and reproduction control system 1. For example, when the recording and reproduction control system 1 is connected so as to be able to receive power from an accessory power source in the host vehicle, the vehicle information acquisition unit 123 determines whether the power of the host vehicle is on or off based on the presence or absence of power supply from the accessory power source.

[0035] For example, when the vehicle information acquisition unit 123 receives a signal indicating that the engine has switched from on to off, the vehicle information acquisition unit 123 determines that the power has switched from on to off, and outputs a power control signal to the output control unit 125. In this case, when the vehicle information acquisition unit 123 can determine that the position information received from the current position calculation unit 129 indicates that the vehicle is waiting for a traffic light, waiting for a traffic jam, or temporarily stopping near an intersection, the vehicle information acquisition unit 123 may not output a power control signal to the output control unit 125. In other words, when the vehicle information acquisition unit 123 determines that the power of the vehicle is switched from on to off, it means that the vehicle is parked in a parking lot or the like and the driver may leave the vehicle for a predetermined period of time. Note that the conditions for determining that the power has switched from on to off are not limited to these.

[0036] For example, when the engine is turned on from off, the vehicle information acquisition unit 123 determines that the power has been switched from an off state to an on state, and outputs a power control signal to the output control unit 125. For example, when the accessory power is turned on with the engine off, the vehicle information acquisition unit 123 may determine that the power has been switched from an off state to an on state, and output a power control signal to the output control unit 125. For example, when the vehicle information acquisition unit 123 detects that the driver has sat in the driver's seat or fastened the seat belt, the vehicle information acquisition unit 123 may determine that the power has been switched from an off state to an on state, and output a power control signal to the output control unit 125. For example, when a predetermined time has not elapsed since the power was turned off, the vehicle information acquisition unit 123 may not output a power control signal to the output control unit 125.

[0037] The vehicle information acquisition unit 123 may determine that the engine has switched from on to off and that the engine has switched from off to on based on preset current location information in addition to the power supply from the accessory power source being on or off. For example, by setting the home location in advance, the event record data stored during the operation period from when the vehicle leaves the home until when the vehicle returns home can be referenced every time the vehicle returns home. Also, by setting the location of the company or a designated parking lot in advance, the event record data stored during the operation period from when the vehicle leaves the company until when the vehicle returns home can be referenced every time the vehicle returns home.

[0038] The storage control unit 124 stores various information in the storage unit 30. The storage control unit 124 stores the shooting data acquired by the shooting data acquisition unit 121 and the audio data acquired by the audio data acquisition unit 122 in the storage unit 30. Specifically, when an event is detected by the event detection unit 128 from the shooting data and the audio data, the storage control unit 124 saves the shooting data for a predetermined period based on the detection of the event as event recording data 31 in the storage unit 30.

[0039] More specifically, when the event detection unit 128 detects an event, the storage control unit 124 stores at least the photographed data for a first period based on the detection of the event as the event record data 31. Here, the first period is, for example, a period including photographed data for a predetermined period before the event is detected and photographed data for a predetermined period after the event is detected, so as to include the time point of the event detection, when continuous recording is performed during the operation period or parking period of the vehicle. An example of the first period in this case is a period of 20 seconds consisting of 10 seconds before the event is detected and 10 seconds after the event is detected. Another example of the first period is a period in which continuous recording is not performed during the parking period of the vehicle, and the event detection is used as a trigger to store the data as the event record data. An example of the first period in this case is a period of 10 seconds from the start of recording due to the detection of the event.

[0040] The storage control unit 124 may add, for example, the acceleration applied to the vehicle when the event occurred, that is, the acceleration information acquired by the event detection unit 128 from the sensor unit 60, to the event record data 31.

[0041] The output control unit 125 outputs the event record data by reproducing the event record data stored in the storage unit 30. The output control unit 125 starts outputting the event record data stored in the storage unit 30 by operating the operation unit 40. In addition, the output control unit 125 outputs the event record data 31 of the first period stored in the storage unit 30 according to a power control signal received from the vehicle information acquisition unit 123. For example, the output control unit 125 outputs the event record data 31 of the first period to the display control unit 127. For example, the output control unit 125 transmits the event record data 31 of the first period to an external terminal device via the communication unit 80. The output control unit 125 may output the event record data 31 of the first period to both the communication unit 80 and the display control unit 127, or may output it to either one of them. When outputting the event record data via the communication unit 80, the output control unit 125 includes a function as a communication control unit that controls the transmission of data by the communication unit 80. For example, when the driver drives to work or school and the driving time is almost fixed, the output control unit 125 may output the event record data 31 to the outside only when the power control signal is received at a time close to the driver's home time. The output control unit 125 outputs the event record data 31 to the display control unit 127 based on the map information 32, for example, to display route guidance according to the current position.

[0042] More specifically, when the output control unit 125 receives a power control signal from the vehicle information acquisition unit 123, it outputs event record data 31 related to an event that occurred before the power was switched on or off. For example, when the output control unit 125 receives a power control signal indicating an OFF state from the vehicle information acquisition unit 123, it outputs event record data 31 related to an event that occurred during an operation period before the power was switched off. For example, when the output control unit 125 receives a power control signal indicating an ON state from the vehicle information acquisition unit 123, it outputs event record data 31 related to an event that occurred during a parking period before the power was switched on. The output control unit 125 may output the event record data 31 for a second period that is shorter than the first period saved as the event record data.

[0043] When a plurality of event record data 31 are stored, the output control unit 125 may output the event record data 31 in the order of the magnitude of the acceleration applied to the host vehicle, which is added to each event record data 31. In this case, the output control unit 125 may output a predetermined number of event record data, for example, instead of outputting all of the event record data 31. When a plurality of event record data 31 are stored, the output control unit 125 may output, for example, event record data in which the magnitude of the acceleration applied to the host vehicle exceeds a predetermined threshold value.

[0044] The additional information associated with the event record data 31 will now be described with reference to Fig. 2. Fig. 2 is a correspondence table showing an example of the additional information associated with the event record data 31.

[0045] FIG. 2 is an example of a correspondence table of event record data stored when the vehicle's power is on, i.e., during the operating period. In FIG. 2, Event No. 1, Event No. 2, ..., Event No. N each indicate event record data 31. As shown in FIG. 3, each event record data is associated with, for example, date and time, location information, and acceleration information. Although a specific location name is shown as the location information, it may be latitude and longitude information. Event No. 1 to Event No. N have the same configuration, so the following description will be given using Event No. 1 as an example.

[0046] The date and time means the time when the event was detected. The location information is information about the location where the event occurred. The acceleration information is information including the magnitude of the acceleration applied to the vehicle and the cause of the acceleration. The cause of the acceleration includes a situation in which a large acceleration is applied, such as sudden braking or sudden acceleration. In this embodiment, a case in which the acceleration exceeds a first threshold is detected as an event, and the event record data is stored.

[0047] When referring to the date and time column, it is shown that Event No. 1 was an event detected at the time of "September 12, 2018, 14:36:12". When referring to the location information column, it is shown that Event No. 1 was an event detected in the "parking lot of Store A". When referring to the acceleration information column, it is shown that acceleration information 1 is associated with Event No. 1.

[0048] Therefore, the output control unit 125 identifies the magnitude of the acceleration applied to the vehicle when the event occurred by referring to the acceleration information. Then, for example, when the power is turned off, the output control unit 125 determines whether or not to output each event record data based on the identified magnitude of the acceleration.

[0049] For example, the output control unit 125 may be configured to sequentially output the event record data of the event number associated with the acceleration information having a large acceleration based on each acceleration information. For example, the output control unit 125 may be configured to set a second threshold value that is larger than a first threshold value for detecting an event, and output only the event record data associated with the acceleration information exceeding the second threshold value.

[0050] For example, if the detected event is an event based on an accident that occurred during the operation period, and the driver, etc., recognizes the occurrence of the event, the driver, etc. will respond to the accident, and output processing of the event record data as in this embodiment is not necessary. However, as in the case of event No. 1 shown in FIG. 2, when the driver, etc., is not present in the vehicle during temporary parking during the operation period and the vehicle is hit and run, the driver, etc., does not notice the occurrence of the event even though the event is detected, as the event record data is output when the power of the vehicle is turned off, so that the driver, etc. can know the occurrence of the event. In addition, the event record data based on the event detected based on the proximity that may have contacted another vehicle or person, in addition to the sudden braking, sudden acceleration, and sudden steering, which are so-called near misses rather than accidents, is useful for reviewing one's own driving and grasping dangerous places, as the event record data is output when the power of the vehicle is turned off.

[0051] The playback period of the event record data 31 will be described with reference to Fig. 3 and Fig. 4. Fig. 3 and Fig. 4 are schematic diagrams for explaining the playback period of the event record data 31.

[0052] FIG. 3 is a diagram showing a playback period of event record data stored based on an event in the case of continuous recording. In FIG. 3, when the detection time of the event is t0, the case is shown where the shooting data of the first period from the time t0-t1 before t0 by t1 to the time t0+t1 after t0 by t1 is stored as the event record data 31. In this case, for example, the storage unit 30 stores shooting data of periods of 10 seconds each before and after the event detection time as the event record data 31. That is, when the output control unit 125 outputs the event record data 31 of the first period, the video of 10 seconds each before and after the occurrence of the event is played. Here, the output control unit 125 may output the second period from the time t0-t2 before t0 by t2 shorter than t1 to the time t0+t2 after t0 by t2 shorter than t1, for the event record data of the first period. In this case, the output control unit 125 outputs the event record data 31 that is shortened to, for example, 3 seconds before and after the event detection time. In this case, video footage of 3 seconds before and after the event is detected will be played.

[0053] FIG. 4 is a diagram showing a playback period of event record data stored by starting recording based on event detection. In FIG. 4, when the event detection time is t0, the captured image data of the first period from t0 to t0+t1, which is t1 after t0, is stored as event record data 31. In this case, for example, the captured image data of the period of 10 seconds after the event detection is stored as event record data 31 in the storage unit 30. That is, when the output control unit 125 outputs the event record data 31 of the first period, a video of 10 seconds after the occurrence of the event is played. Here, the output control unit 125 may output a second period from t0 to t0+t2, which is t2 before t2, which is shorter than t1, for the event record data of the first period. In this case, the output control unit 125 outputs the event record data 31 that is shortened to, for example, 3 seconds after the event detection time. In this case, a video of 3 seconds after the event detection is played.

[0054] Although the event record data is useful information for verification when an accident occurs, if the user wishes to check the event record data at the start or end of driving, there is little need to check the event record data for the first period. This is particularly noticeable when there are multiple event record data. For this reason, by outputting the event record data for the second period, it is possible to check the event record data for at least the required period including the time point at which the event was detected. The output control unit 125 may determine whether to output the event record data 31 for the first period or the second period based on the following conditions. For example, if the number of event record data to be checked at the start or end of driving is, for example, about 1 to 2, the event record data is output for the first period, and if it is more than that, the event record data is output for the second period. Alternatively, the event record data based on the acceleration at the time when the event was detected, which is a steep acceleration indicating a collision such as a hit-and-run, may be output for the first period, and the event record data based on the acceleration which rises more slowly than a collision such as a sudden brake, sudden acceleration, or sudden steering may be output for the second period.

[0055] After the output control unit 125 outputs the event record data 31, the storage control unit 124 may delete the event record data 31, or may store the event record data 31 for a predetermined period of time and then delete the event record data 31. Furthermore, the storage control unit 124 may delete the event record data 31 after receiving an operation signal from the user to delete the event record data 31, for example.

[0056] The operation control unit 126 receives, for example, an operation signal for the recording and playback control device 100 received by the operation unit 40 from the user. The operation control unit 126 causes the output control unit 125 to output the event record data 31 based on, for example, the operation signal. The operation control unit 126 also receives an operation signal related to an event recording instruction received by the operation unit 40 from the user. When the operation control unit 126 receives an operation signal related to an event recording instruction, the storage control unit 124 stores video data including the event occurrence time in the storage unit 30 as the event record data 31, taking the time point at which the operation signal related to the event recording instruction was received as the event occurrence time.

[0057] The display control unit 127 displays various images on the display unit 50. The display control unit 127 displays the event record data 31 on the display unit 50 under control of the output control unit 125, for example.

[0058] The event detection unit 128 detects events such as accidents involving the vehicle. The event detection unit 128 detects, for example, various occurrences called near misses that were not actually accidents but could have led to accidents as events.

[0059] For example, when the host vehicle is traveling, the event detection unit 128 detects an event based on the acceleration applied to the host vehicle detected by the sensor unit 60. In this case, the event detection unit 128 detects an event when the sensor unit 60 detects an acceleration of a predetermined magnitude or more caused by sudden braking, sudden acceleration, sudden steering, or the like.

[0060] For example, even when the host vehicle is parked, the event detection unit 128 detects an event based on the acceleration applied to the host vehicle detected by the sensor unit 60. In this case, the event detection unit 128 detects an event when, for example, another vehicle collides with the host vehicle while parked and a predetermined or greater acceleration is applied to the host vehicle.

[0061] For example, when the vehicle is parked, the event detection unit 128 detects a near miss based on the photographed data acquired by the photographed data acquisition unit 121. In this case, the event detection unit 128 detects people around the vehicle based on the recognition dictionary 33. Then, the event detection unit 128 detects a theft accident or a near miss as an event when it detects, for example, someone stealing something from the vehicle or someone trying to open the door even though nothing has been stolen.

[0062] For example, when the vehicle is traveling or parked, the event detection unit 128 detects an event when another vehicle or person comes close enough to the vehicle that there is a possibility of contact with the vehicle, using the photographing data captured by the photographing data acquisition unit and a proximity sensor as the sensor unit 60.

[0063] The event detection unit 128 may detect, for example, an accident occurring in another vehicle, a sudden deceleration of another vehicle, etc., as an event. For example, the event detection unit 128 detects, as an event, a sudden deceleration due to a collision or sudden braking based on the movement transition of the other vehicle captured in the shooting data acquired by the shooting data acquisition unit 121. In this case, the event detection unit 128 calculates, for example, the acceleration based on the movement transition of the other vehicle, and detects the other vehicle as an event related to the other vehicle based on the calculated acceleration.

[0064] The current position calculation unit 129 acquires a GPS signal from the GPS receiving unit 70. The current position calculation unit 129 calculates the current position of the vehicle based on, for example, the GPS signal. The current position calculation unit 129 outputs the calculated current position to the memory control unit 124, for example.

[0065] The processing of the recording and reproduction control device 100 according to the first embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of the flow of processing of the recording and reproduction control device 100 according to the first embodiment. The processing shown in Fig. 5 shows the processing of the recording and reproduction control device 100 when power is switched from on to off.

[0066] 5, in step S101, the recording and reproduction control device 100 determines whether or not the power of the host vehicle has been turned off. Specifically, based on the vehicle information of the host vehicle acquired by the vehicle information acquisition unit 123, it determines whether or not the power of the host vehicle has been turned off.

[0067] If the vehicle's power is not turned off ("No" in step S101), the recording and reproduction control device 100 executes the process of step S101 until the vehicle's power is turned off. On the other hand, if the vehicle's power is turned off ("Yes" in step S101), the recording and reproduction control device 100 proceeds to step S102.

[0068] In step S102, the recording / reproduction control device 100 determines whether or not an event has occurred during the operation period when the power is on. Specifically, the recording / reproduction control device 100 determines whether or not an event has occurred based on whether or not an event has been detected by the event detection unit 148 during the operation period of the host vehicle, or whether or not event record data has been stored during the operation period.

[0069] If no event has occurred during the operation period ("No" in step S102), the recording and playback control device 100 ends the process in Fig. 5. On the other hand, if an event has occurred during the operation period ("Yes" in step S102), the recording and playback control device 100 proceeds to step S103.

[0070] Then, the recording and reproduction control device 100 outputs the event record data 31 of the event that occurred during the operation period of the host vehicle (step S103). Specifically, the recording and reproduction control device 100 outputs the event record data 31 by the output control unit 125.

[0071] As described above, in the first embodiment, when the power of the vehicle is switched from on to off, the event record data generated during the operation period of the vehicle is output. In this way, the first embodiment allows the driver to appropriately refer to the event record data generated during the operation period of the vehicle. [Second embodiment] The process of the recording and reproduction control device 100 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the process flow of the recording and reproduction control device 100 according to the second embodiment. The process shown in Fig. 6 shows the process of the recording and reproduction control device 100 when the power is switched from off to on.

[0072] 6, in step S201, the recording and reproduction control device 100 determines whether the power of the host vehicle is turned on. Specifically, based on the vehicle information of the host vehicle acquired by the vehicle information acquisition unit 123, it determines whether the power of the host vehicle is turned on.

[0073] If the vehicle's power is not on ("No" in step S201), the recording and reproduction control device 100 executes the process of step S201 until the vehicle's power is on. On the other hand, if the vehicle's power is on ("Yes" in step S201), the recording and reproduction control device 100 proceeds to step S202.

[0074] In step S202, the recording / reproduction control device 100 determines whether an event has occurred during the parking period when the power is off. Specifically, the recording / reproduction control device 100 determines whether an event has occurred based on whether an event has been detected by the event detection unit 148 during the parking period of the vehicle, or whether event record data has been saved during the parking period.

[0075] If no event has occurred during the parking period ("No" in step S202), the recording and reproduction control device 100 ends the process in Fig. 6. On the other hand, if an event has occurred during the parking period ("Yes" in step S202), the recording and reproduction control device 100 proceeds to step S203.

[0076] Then, the recording and reproduction control device 100 outputs the event record data 31 of the event that occurred while the host vehicle was parked (step S203). Specifically, the recording and reproduction control device 100 outputs the event record data 31 by the output control unit 125.

[0077] As described above, in the second embodiment, when the power of the vehicle is switched from off to on, the event record data that occurred while the vehicle was parked is output. This allows the driver to appropriately refer to the event record data that occurred while the vehicle was parked. [Third embodiment] The processing of the recording and playback control device 100 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing an example of the processing flow of the recording and playback control device 100 according to the third embodiment. The processing shown in Fig. 7 shows processing of the recording and playback control device 100 that shortens and outputs the event record data 31 when the power is switched from on to off. Note that, although the processing when the power is switched from on to off will be described below, it can be similarly applied to the case where the power is switched from off to on.

[0078] Steps S301 and S302 shown in Fig. 7 are similar to steps S101 and S102 shown in Fig. 5, respectively, and therefore will not be described. This embodiment is also applicable to the second embodiment shown in Fig. 6.

[0079] After "Yes" in step S302, the recording and playback control device 100 shortens and outputs the event record data 31 of the event that occurred during the operation period (step S303). Specifically, the recording and playback control device 100 shortens and outputs the event record data 31 by the output control unit 125. Then, the recording and playback control device 100 ends the process in Fig. 7. As described above, the process of step S303 outputs event record data consisting of shooting data for a first period for a second period that is shorter than the first period.

[0080] As described above, in the third embodiment, the event record data is output with a shorter recording time than the event record data, which allows the driver to efficiently refer to the event record data that occurred while the vehicle was traveling or parked in a short time. [Fourth embodiment] The process of the recording and reproduction control device 100 according to this embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the process flow of the recording and reproduction control device 100 according to this embodiment. The process shown in Fig. 8 shows the process of the recording and reproduction control device 100 that determines whether or not multiple events have occurred when the power is switched from on to off. Note that, although the process when the power is switched from on to off will be described below, it can be similarly applied to the case where the power is switched from off to on.

[0081] Steps S401 and S402 shown in Fig. 8 are similar to steps S101 and S102 shown in Fig. 5, respectively, and therefore will not be described. This embodiment is also applicable to the second embodiment shown in Fig. 6.

[0082] After "Yes" in step S402, the recording and reproduction control device 100 determines in step S403 whether a plurality of events have occurred.

[0083] If the number of events that have occurred is not multiple ("No" in step S403), the recording and playback control device 100 proceeds to step S404. In this case, the recording and playback control device 100 outputs one event record data captured while the host vehicle was in operation (step S404), as in step S103 shown in Fig. 5. Then, the recording and playback control device 100 ends the process in Fig. 8.

[0084] On the other hand, if multiple events have occurred ("Yes" in step S403), the recording and playback control device 100 proceeds to step S405. In this case, the recording and playback control device 100 outputs in sequence the multiple pieces of event record data 31 stored while the vehicle was in operation (step S405). Specifically, the recording and playback control device 100 outputs in sequence the multiple pieces of event record data 31 via the output control unit 125. Then, the recording and playback control device 100 ends the process in FIG. 8.

[0085] As described above, in the fourth embodiment, when multiple events occur while the vehicle is traveling, the event record data is output in sequence when the power of the vehicle is switched from on to off. In this way, in the fourth embodiment, when multiple events occur, the driver can efficiently refer to the event record data that occurred while the vehicle was traveling.

[0086] In addition, in the fourth embodiment, when multiple events occur, the event record data of the events in which the acceleration applied to the vehicle at the time of event detection was large can be output in order. In this way, the fourth embodiment allows the driver to preferentially refer to the event record data in which the risk level was high. In addition, when multiple events occur, the event record data of the events in which the acceleration applied to the vehicle at the time of event detection was equal to or greater than a threshold value can be selectively output.

[0087] Although the embodiments of the present invention have been described above, the embodiments are not limited to the contents of these embodiments. The above-mentioned components include those that a person skilled in the art can easily imagine, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-mentioned components can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-mentioned embodiments. [Explanation of symbols]

[0088] 1 Recording and playback control system 10. Camera 20 Microphones 30 Storage section 31 Event Record Data 32 Map Information 33 Recognition Dictionary 40 Control section 50 Display section 60 Sensor section 70 GPS receiver 80 Communications Department 90 Battery 100 Recording / playback control device 110 Bus 121 Shooting data acquisition unit 122 Voice data acquisition unit 123 Vehicle Information Acquisition Department 124 Memory control unit 125 Output control section 126 Operation control section 127 Display control section 128 Event Detector 129 Current position calculation unit

Claims

1. an image capturing data acquiring unit that acquires image capturing data captured by a camera that captures images in the vehicle; an event detection unit that detects an event with respect to the vehicle based on an acceleration applied to the vehicle; a recording control unit that, when the event detection unit detects an event, stores photographed data for a first period based on the detection of the event as event recording data together with acceleration information; an output control unit that outputs a plurality of event record data generated within a predetermined period of time in the order of magnitude of acceleration added to the plurality of event record data; A recording and playback control device comprising:

2. an image capturing data acquiring unit that acquires image capturing data captured by a camera that captures images in the vehicle; an event detection unit that detects an event for the vehicle; a recording control unit that, when the event detection unit detects an event, stores photographed data of a first period based on the detection of the event as event recording data; a vehicle information acquisition unit that acquires power-on information or power-off information of the vehicle; an output control unit which, when the vehicle information acquisition unit acquires power-on information or power-off information of the vehicle, outputs the event record data stored based on the events occurring in the operation period before the power-on or power-off time so as to play the first period of the recording period of the event record data if the number of event record data stored based on the events occurring in the operation period is less than a predetermined number, and outputs the event record data stored based on the events occurring in the operation period so as to play the second period of the recording period of the event record data, which is a period shorter than the first period, if the number of event record data stored based on the events occurring in the operation period before the power-on or power-off time is equal to or greater than a predetermined number; A recording and playback control device comprising:

3. an image capturing data acquiring unit that acquires image capturing data captured by a camera that captures images in the vehicle; an event detection unit that detects an event based on an acceleration applied to the vehicle; If the event detection unit detects an event, a recording control unit that stores the photographed data as event record data; a vehicle information acquisition unit that acquires power-on information or power-off information of the vehicle; an output control unit which, when the vehicle information acquisition unit acquires power-on information or power-off information of the vehicle, outputs the event record data stored based on the event occurring in the operation period so as to play the first period of the recording period of the event record data if the acceleration at the time of event detection of the event record data stored based on the event occurring in the operation period prior to the power-on or power-off point is a steeply rising acceleration, and outputs the event record data stored based on the event occurring in the operation period so as to play the second period of the recording period of the event record data, which is a period shorter than the first period, if the acceleration at the time of event detection of the event record data stored based on the event occurring in the operation period prior to the power-on or power-off point is a gradual rising acceleration; A recording and playback control device comprising:

4. a photographing data acquisition step of acquiring photographing data captured by a camera that captures video in the vehicle; an event detection step of detecting an event with respect to the vehicle based on an acceleration applied to the vehicle; a recording control step of storing, when an event is detected in the event detection step, photographing data for a first period based on the detection of the event as event recording data together with acceleration information; an output control step of outputting the plurality of event record data in order of magnitude of acceleration added to the plurality of event record data when the plurality of event record data generated within a predetermined period is reproduced; The recording and reproducing control method is executed by a recording and reproducing control device.

5. a photographing data acquisition step of acquiring photographing data captured by a camera that captures video in the vehicle; an event detection step of detecting an event for the vehicle; a recording control step of storing, when an event is detected in the event detection step, photographing data for a first period based on the detection of the event as event recording data; a vehicle information acquisition step of acquiring power-on information or power-off information of the vehicle; an output control step of outputting the event record data stored based on the events occurring in the operation period prior to the power-on or power-off time so as to reproduce the first period of the event record data recording period when the number of event record data stored based on the events occurring in the operation period prior to the power-on or power-off time is less than a predetermined number when the vehicle information acquisition step acquires power-on or power-off information of the vehicle; and outputting the event record data stored based on the events occurring in the operation period so as to reproduce the second period of the event record data recording period, which is a period shorter than the first period, when the number of event record data stored based on the events occurring in the operation period prior to the power-on or power-off time is equal to or greater than the predetermined number. The recording and reproducing control method is executed by a recording and reproducing control device.

6. a photographing data acquisition step of acquiring photographing data captured by a camera that captures video in the vehicle; an event detection step of detecting an event based on an acceleration applied to the vehicle; a recording control step of storing, when an event is detected in the event detection step, photographing data for a first period based on the detection of the event as event recording data; a vehicle information acquisition step of acquiring power-on information or power-off information of the vehicle; an output control step of outputting, when power-on information or power-off information of the vehicle is acquired in the vehicle information acquisition step, the event record data stored based on an event occurring in an operation period prior to the power-on or power-off time so as to reproduce the first period of the recording period of the event record data if the acceleration at the time of event detection of the event record data stored based on an event occurring in the operation period is a steeply rising acceleration, and outputting, when the acceleration at the time of event detection of the event record data stored based on an event occurring in the operation period prior to the power-on or power-off time is a gradual rising acceleration, the event record data stored based on an event occurring in the operation period so as to reproduce a second period of the recording period of the event record data, which is a period shorter than the first period; The recording and reproducing control method is executed by a recording and reproducing control device.

Images