Video recording control apparatus and video recording method

Abstract

To facilitate retrieval of a captured video.SOLUTION: A control apparatus 100 comprises: an imaging data acquisition unit 111 which controls a camera used in a vehicle and acquires imaging data captured by the camera; a biological information detection unit 114 which detects biological information of a passenger of the vehicle and variation in the biological information; an imaging data processing unit 113 which generates an imaging file to be associated with the thumbnail image, from the imaging data; a thumbnail image generation unit 120 which, when the biological information detection unit 114 detects the variation in the biological information, generates the thumbnail image from a video at the time of the detection; and a recording control unit 122 which associates the imaging file generated by the imaging data processing unit 113 and the thumbnail image generated by the thumbnail image generation unit 120 and records them in a recording unit 212.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a video recording control device and a video recording method. [Background technology]

[0002] Drive recorders that mainly capture images of the outside of a vehicle are in widespread use, and generate and record image files at predetermined intervals, for example, every 60 seconds. When an event such as an accident is detected, images for a predetermined period including the time of the event detection are saved as event data. For example, Patent Document 1 discloses a drive recorder that records event data and displays thumbnail images corresponding to the event data, thereby allowing the event data to be selected and played back. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-141170 A Summary of the Invention [Problem to be solved by the invention]

[0004] In a video recording device that continuously generates and records a video file, such as a drive recorder, the thumbnail image may be used to record the video of the surroundings while the vehicle is traveling, in addition to the video when an accident is detected as an event. Such thumbnail images are generated from the first frame image of the video file or event data (event file), and the thumbnail images are displayed in a list to select each file. In such a case, the event to be confirmed may not be captured in the displayed thumbnail image, and even if the thumbnail image for each file is displayed, it may be difficult to find the desired video based on the displayed thumbnail image.

[0005] The present disclosure has been made in consideration of the above, and aims to make it easier to search for captured video. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objective, the video recording control device of the present disclosure comprises an image capture data acquisition unit that controls a camera used in a vehicle and acquires image capture data captured by the camera, a biometric information detection unit that detects biometric information of an occupant of the vehicle and fluctuations in the biometric information, an image capture data processing unit that generates, from the image capture data, an image capture file to which a thumbnail image is to be associated, a thumbnail image generation unit that, when the biometric information detection unit detects a fluctuation in the biometric information, generates a thumbnail image from the video at the time of detection, and a recording control unit that associates the image capture file generated by the image capture data processing unit with the thumbnail image generated by the thumbnail image generation unit and records them in a recording unit.

[0007] The video recording method according to the present disclosure is executed by a video recording device, and includes a shooting control step of controlling a camera used in a vehicle and acquiring shooting data captured by the camera, a biometric information detection step of detecting biometric information of an occupant of the vehicle and fluctuations in the biometric information, a shooting data processing step of generating, from the shooting data, a shooting file to which a thumbnail image is to be associated, a thumbnail image generation step of generating, if a fluctuation in the biometric information is detected in the biometric information detection step, a thumbnail image from the video at the time of detection, and a recording control step of associating the shooting file generated in the shooting data processing step with the thumbnail image generated in the thumbnail image generation step and recording them in a recording unit. Effect of the Invention

[0008] According to the present disclosure, it is possible to easily search for captured video. [Brief description of the drawings]

[0009] [Figure 1]FIG. 1 is a block diagram showing an example of the configuration of a video recording device having a control device according to the first embodiment. [Diagram 2] FIG. 2 is a diagram for explaining a captured file. [Diagram 3] FIG. 3 is a flowchart showing an example of a flow of a general capture file generation process in the control device according to the first embodiment. [Figure 4] FIG. 4 is a flowchart showing an example of the flow of processing for associating thumbnail images in the control device according to the first embodiment. [Diagram 5] FIG. 5 is a diagram for explaining the shooting file and the event data. [Figure 6] FIG. 6 is a flowchart showing an example of a process flow for associating thumbnail images in the control device according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a video recording control device and a video recording method according to the present disclosure will be described in detail below with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiment.

[0011] [First embodiment] <Video Recording Device> Fig. 1 is a block diagram showing an example of the configuration of a video recording device 10 having a video recording control device (hereinafter referred to as "control device") 100 according to a first embodiment. The video recording device 10 is a so-called drive recorder that records events that occur in a vehicle. The video recording device 10 records a captured file in association with a thumbnail image.

[0012] The video recording device 10 may be a device installed in a vehicle, or may be a portable device that can be used in a vehicle. The video recording device 10 may also be realized by including the functions or configurations of a device previously installed in a vehicle, a navigation system, etc. The video recording device 10 has a first camera 210, a second camera 211, a recording unit 212, an operation unit 213, an acceleration sensor 214, a GNSS (Global Navigation Satellite System) receiving unit 215, a display unit 216, and a control device 100. In this embodiment, the second camera 211 is not an essential component, and may be, for example, a sensor capable of detecting biometric information such as the heart rate, facial expression, or facial expression fluctuation of a vehicle occupant, or a portable electronic device worn by the occupant.

[0013] The first camera 210 is a camera provided in the vehicle. The first camera 210 is a camera that captures the surroundings of the vehicle. The first camera 210 may be a group of multiple cameras. The first camera 210 is disposed, for example, at a position in the front of the vehicle interior where it can capture the front of the vehicle. In this embodiment, the first camera 210 captures video at all times while the accessory power of the vehicle is ON. The first camera 210 outputs the captured image data to the image data acquisition unit 111 of the control device 100. The captured image data is, for example, a moving image composed of images of 27.5 frames per second.

[0014] The second camera 211 is a camera provided in the vehicle. The second camera 211 is a camera that captures an occupant of the vehicle. The second camera 211 is a camera that captures an image capable of detecting biometric information of the occupant. The second camera 211 is, for example, a camera that can detect the heart rate of the occupant as biometric information. The second camera 211 is, for example, a camera that can detect the facial expression of the occupant as biometric information. The second camera 211 may be a group of multiple cameras. The second camera 211 is, for example, disposed at a position that can capture an image of an occupant in each seat of the vehicle. In this embodiment, the second camera 211 captures an image at all times while the accessory power of the vehicle is ON. The second camera 211 outputs the captured image data to the image data acquisition unit 111 of the control device 100. The image data is, for example, a moving image composed of images of 27.5 frames per second.

[0015] The recording unit 212 is used for temporary storage of data in the video recording device 10. The recording unit 212 is, for example, a recording unit such as a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a memory card. Alternatively, the recording unit 212 may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 212 records continuous recording data (normal files) or captured files that are event data, based on a control signal output from the recording control unit 122 of the control device 100.

[0016] The operation unit 213 can accept various operations on the video recording device 10. The operation unit 213 is, for example, a touch panel provided on the display unit 216. For example, the operation unit 213 can accept an operation to manually save captured image data in the recording unit 212 as event data. For example, the operation unit 213 can accept an operation to play back the continuous recording data or event data recorded in the recording unit 212. For example, the operation unit 213 can accept an operation to erase the event data recorded in the recording unit 212. For example, the operation unit 213 can accept an operation to end the continuous recording. The operation unit 213 outputs operation information to the operation control unit 116 of the control device 100.

[0017] The acceleration sensor 214 is a sensor that detects acceleration occurring with respect to the vehicle. The acceleration sensor 214 outputs a detection result to the event detection unit 117 of the control device 100. The acceleration sensor 214 is a sensor that detects acceleration in, for example, three axial directions. The three axial directions are the forward / rearward direction, the left / right direction, and the up / down direction of the vehicle.

[0018] The GNSS receiving unit 215 is configured with a GNSS receiver that receives GNSS signals from GNSS satellites, etc. The GNSS receiving unit 215 outputs the received position information signal to the position information acquisition unit 118 of the control device 100.

[0019] The display unit 216 is, for example, a display device specific to the video recording device 10, or a display device shared with other systems including a navigation system. The display unit 216 may be formed integrally with the first camera 210. The display unit 216 is, for example, a display including a liquid crystal display or an organic EL (Electro-Luminescence) display. In this embodiment, the display unit 216 is disposed in front of the driver of the vehicle on a dashboard, an instrument panel, a center console, or the like. The display unit 216 displays an image based on a video signal output from the display control unit 119 of the control device 100. The display unit 216 displays an image captured by the first camera 210 or an image recorded in the recording unit 212.

[0020] <Video Recording Control Device> The control device 100 is an arithmetic processing device (control device) configured with, for example, a CPU (Central Processing Unit) and the like. The control device 100 loads a stored program into a memory and executes instructions included in the program. The control device 100 includes an internal memory (not shown), which is used for temporary storage of data in the control device 100. The control device 100 includes an image data acquisition unit 111, a buffer memory 112, an image data processing unit 113, a biometric information detection unit 114, an operation control unit 116, an event detection unit 117, a position information acquisition unit 118, a display control unit 119, a thumbnail image generation unit 120, a playback control unit 121, and a recording control unit 122.

[0021] The imaging data acquisition unit 111 controls the first camera 210 and the second camera 211 used in the vehicle, and acquires imaging data captured by the first camera 210 and the second camera 211. The imaging data acquisition unit 111 outputs the acquired imaging data to the buffer memory 112.

[0022] The buffer memory 112 is an internal memory included in the control device 100, and is a memory for temporarily recording the image capture data for a certain period of time acquired by the image capture data acquisition unit 111 while updating it.

[0023] The shooting data processing unit 113 generates a shooting file for each predetermined time from the shooting data. The shooting data processing unit 113 generates a shooting file to which a thumbnail image is to be associated from the shooting data. The shooting data processing unit 113 converts the shooting data temporarily stored in the buffer memory 112 into an arbitrary file format, such as MP4 format, encoded with an arbitrary codec, such as H.264 or MPEG-4 (Moving Picture Experts Group). The shooting data processing unit 113 generates a shooting file for a certain period of time from the shooting data temporarily stored in the buffer memory 112. As a specific example, the shooting data processing unit 113 generates a shooting file from the shooting data temporarily stored in the buffer memory 112, by using 60 seconds of shooting data in the order of recording. The shooting data processing unit 113 outputs the generated shooting file to the recording control unit 122. The shooting data processing unit 113 also outputs the generated shooting file to the display control unit 119 after decoding the image through the playback control unit 121. The duration of the generated shooting file is set to 60 seconds as an example, but is not limited to this. The shooting data referred to here may be data including audio in addition to the video captured by the first camera 210.

[0024] The biometric information detection unit 114 acquires biometric information and variations in the biometric information of a vehicle occupant. The biometric information detection unit 114 detects, as a variation in the biometric information, that the biometric information has changed from a normal state to an abnormal state. In this embodiment, the biometric information detection unit 114 detects that the biometric information has changed from a normal state to an abnormal state during a normal recording period during which a normal recording process is being performed.

[0025] When the biometric information to be detected is a heart rate, the biometric information detection unit 114 detects the heart rate of the vehicle occupant from the image of the second camera 211 capturing the vehicle occupant. The biometric information detection unit 114 detects the heart rate of the vehicle occupant based on, for example, a change in the wavelength of the green band absorbed by hemoglobin in the blood of the face of the vehicle occupant captured by the second camera 211. The biometric information detection unit 114 can apply any other heart rate detection method. The biometric information detection unit 114 detects the heart rate information of the vehicle occupant and detects, as a change in the heart rate, an increase in the heart rate from a normal heart rate as an abnormal state. For example, when the heart rate of the vehicle occupant is detected to be between 60 beats / min and 70 beats / min on average, for example, when the heart rate increases to 100 beats / min or more in a period of less than 5 seconds, the biometric information detection unit 114 detects, as an abnormal state from a normal state. In this embodiment, the biological information detection unit 114 detects that the heart rate has increased from the normal heart rate during the normal recording period. The biological information detection unit 114 may store in advance the average heart rate in the normal state for each vehicle occupant, and detect that the normal state has changed to an abnormal state based on the variation of the heart rate from the average heart rate.

[0026] When the biometric information to be detected is facial expression, the biometric information detection unit 114 detects the facial expression of the vehicle occupant from the image of the second camera 211 capturing the vehicle occupant. The biometric information detection unit 114 detects the captured face of the occupant, and detects the movement of each part constituting the face, particularly the opening degree of the eyes, and detects a change in facial expression using an expression judgment model that has been machine-learned to learn various facial expressions. The biometric information detection unit 114 detects the facial expression of the vehicle occupant, and detects that the facial expression has changed from a normal facial expression to an expression expressing surprise as a change in the facial expression as an abnormal state. The biometric information detection unit 114 detects that the facial expression has changed from an expression other than an expression expressing surprise to an expression expressing surprise, particularly a change in a period of less than one second as a change from a normal state to an abnormal state. In this embodiment, the biometric information detection unit 114 detects that the facial expression has changed from a normal facial expression to an expression expressing surprise during the normal recording period.

[0027] The operation control unit 116 acquires operation information of an operation accepted by the operation unit 213. For example, the operation control unit 116 acquires playback operation information indicating a playback operation or erase operation information indicating an erase operation, and outputs a control signal. For example, the operation control unit 116 acquires end operation information indicating an operation to end continuous recording, and outputs a control signal.

[0028] The event detection unit 117 detects an event based on the acceleration applied to the vehicle. More specifically, the event detection unit 117 detects an event based on the detection result of the acceleration sensor 214. The event detection unit 117 detects that an event has occurred when the acceleration information acquired from the acceleration sensor 214 is equal to or greater than a threshold value.

[0029] The position information acquisition unit 118 acquires position information indicating the current position of the vehicle. The position information acquisition unit 118 calculates the position information of the current position of the vehicle based on the GNSS signal received by the GNSS receiving unit 215 by a known method.

[0030] Display control unit 119 controls the display on display unit 216. Display control unit 119 outputs a video signal that causes continuous recording data, event data, or the like to be output to display unit 216. More specifically, display control unit 119 outputs a video signal that displays the video captured by first camera 210, or the continuous recording data or event data recorded in recording unit 212 by playing back the video.

[0031] The thumbnail image generating unit 120 generates thumbnail images from the images that make up the captured file.

[0032] The thumbnail image generating unit 120 assigns a thumbnail image to the captured file. More specifically, the thumbnail image generating unit 120 normally assigns a thumbnail image starting from the image of the first frame in the video constituting the captured file.

[0033] When the biometric information detection unit 114 detects a change in the biometric information, the thumbnail image generation unit 120 generates a thumbnail image from the video at the time of detection. More specifically, when the biometric information detection unit 114 detects that the biometric information has changed from a normal state to an abnormal state, the thumbnail image generation unit 120 generates a thumbnail image from the video at the time of detection. The video for which the thumbnail image generation unit 120 generates a thumbnail image may be set to any time point within about 2 to 5 seconds before or after the time point at which the change in the biometric information is detected.

[0034] When there is a change in the biometric information during the normal recording period, the thumbnail image generating unit 120 generates a thumbnail image based on the image at the time of the change in the biometric information. More specifically, the thumbnail image generating unit 120 assigns an image of a frame captured at the time of the change in the biometric information as a thumbnail image of the normal file (normal recording data). There is a high possibility that the thumbnail image generated in this way captures an event around the vehicle that caused the change in the biometric information of the occupant.

[0035] A shooting file as a normal file will be described with reference to Fig. 2. Fig. 2 is a diagram for explaining a shooting file. In the example shown in Fig. 2, a shooting file as a normal file is generated, for example, every 60 seconds from shooting data captured by the first camera 210. As for the normal file, shooting continues at all times while the vehicle is in operation, and the normal file is generated and recorded. The normal recording file is a file that can be overwritten.

[0036] The shooting file F-1 is generated from shooting data from time T-1 to time T. It is assumed that no variation in biological information is detected from time T-1 to time T. In this case, the thumbnail image of the shooting file F-1 is generated from the image at time T-1, in other words, the image of the first frame of the shooting file F-1. The normal recording period of the shooting file F-1 is the period from time T-1 to time T.

[0037] The shooting file F is generated from shooting data from time T to time T+1. It is assumed that a variation in biometric information is detected at time Tb1 within the period from time T to time T+1. In this case, the thumbnail image of the shooting file F is generated from the image at time Tb1, not the image at time T. The normal recording period of the shooting file F is the period from time T to time T+1.

[0038] The playback control unit 121 controls playback of the continuous recording data or event data recorded in the recording unit 212, based on a playback operation control signal output from the operation control unit 116. The playback control unit 121 includes a decoder (not shown), and plays back various types of data by decoding the compressed data supplied thereto.

[0039] The recording control unit 122 records the shooting data acquired by the shooting data acquisition unit 111. In the embodiment, the recording control unit 122 controls the recording unit 212 to record the shooting file filed by the shooting data processing unit 113. During a period in which a continuous recording process is performed, such as when the accessory power of the vehicle is ON, the recording control unit 122 records the shooting file filed by the shooting data processing unit 113 in the recording unit 212 as an overwritable shooting file. More specifically, during a period in which a continuous recording process is performed, the recording control unit 122 continues to record the shooting file generated by the shooting data processing unit 113 in the recording unit 212, and when the capacity of the recording unit 212 becomes full, the recording control unit 122 overwrites the oldest shooting file with a new shooting file.

[0040] When an event is detected by the event detection unit 117, the recording control unit 122 saves event data, which is shooting data corresponding to the detection of the event. The event data is a shooting file of an event recording period, which is a predetermined period in the shooting file generated by the shooting data processing unit 113. The recording control unit 122 saves the shooting file corresponding to the detection of the event in the recording unit 212 as event data that is prohibited from being overwritten. When an event is detected by the event detection unit 117, the recording control unit 122 copies the shooting file of a predetermined period, for example, about 10 seconds before and after the time when the event is detected, from the buffer memory 112 and saves it as event data.

[0041] The recording control unit 122 records the captured file generated by the captured data processing unit 113 and the thumbnail image generated by the thumbnail image generating unit 120 in association with each other in the recording unit 212 .

[0042] <Information processing in video recording control device> Next, the flow of processing in the control device 100 will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a flowchart showing an example of the flow of general captured file generation processing in the control device 100 according to the first embodiment. Fig. 4 is a flowchart showing an example of thumbnail image association processing in the control device 100 according to the first embodiment.

[0043] The recording process will be described with reference to Fig. 3. While the video recording device 10 is in operation, the process of the flowchart shown in Fig. 3 is executed.

[0044] The control device 100 starts normal recording and event detection (step S101) when the process of Fig. 3 starts, and continues normal recording by the recording control unit 122 and event detection by the event detection unit 117 while the process of Fig. 3 is being executed, in other words, while the video recording device 10 is operating. The control device 100 proceeds to step S102.

[0045] The control device 100 starts detecting the biometric information when the process of Fig. 3 starts (step S102), and continues detecting the biometric information while the process of Fig. 3 is being executed, in other words, while the video recording device 10 is operating. More specifically, the control device 100 acquires the biometric information of the vehicle occupant and a change in the biometric information by the biometric information detection unit 114. More specifically, the control device 100 detects, for example, an increase in heart rate from a normal heart rate as an abnormal state by the biometric information detection unit 114. The control device 100 detects, for example, a change in facial expression from a normal facial expression to a facial expression expressing surprise as an abnormal state by the biometric information detection unit 114. The control device 100 proceeds to step S103.

[0046] The control device 100 continues the normal recording process while the process of Fig. 3 is being executed (step S103). The control device 100 proceeds to step S104.

[0047] The control device 100 determines whether an event has been detected (step S104). More specifically, the control device 100 detects that an event has occurred when the acceleration information acquired by the event detection unit 117 from the acceleration sensor 214 is equal to or greater than a threshold value. When the control device 100 determines that an event has been detected (Yes in step S104), the control device 100 proceeds to step S105. When the control device 100 does not determine that an event has been detected (No in step S104), the control device 100 proceeds to step S106.

[0048] When it is determined that an event has been detected (Yes in step S104), the control device 100 executes an event recording process (step S105). The control device 100 proceeds to step S106.

[0049] In the event recording process in step S105, the control device 100 causes the recording control unit 122 to store the captured video data as event data in the recording unit 212 while prohibiting overwriting. The event data is captured data including the time before and after the event detection time.

[0050] When it is not determined that an event has been detected (No in step S104), the control device 100 proceeds to step S106 while continuing the normal recording process.

[0051] In the normal recording process, the control device 100 causes the recording control unit 122 to store the captured image data in the recording unit 212 as an overwritable normal file.

[0052] The control device 100 determines whether or not to end the process (step S106). For example, the control device 100 determines to end the process when the vehicle's power source or motive power is turned off, the operation unit 213 is operated, or the like. If the control device 100 determines to end the process (Yes in step S106), it ends this process. If the control device 100 does not determine to end the process (No in step S106), it proceeds to step S103. In other words, normal recording, event detection, and biological information detection are continued.

[0053] Next, the normal recording process shown in step S103 of Fig. 3, that is, the process of adding a thumbnail image to a normal file when performing normal recording, will be described with reference to Fig. 4. The process of the flowchart shown in Fig. 4 is executed in the normal recording process.

[0054] The control device 100 judges whether or not there is a change in the biological information during the normal recording period (step S111). More specifically, the control device 100 judges whether or not the biological information has changed from a normal state to an abnormal state as a change in the biological information during the normal recording period based on the detection result of the biological information detection unit 114. More specifically, the control device 100 judges whether or not the heart rate has increased from a normal state heart rate to an abnormal state during the normal recording period based on the biological information detection unit 114. The control device 100 judges whether or not there is an abnormal state as a change in facial expression during the normal recording period based on the change in facial expression from a normal state to a facial expression expressing surprise based on the biological information detection unit 114. When the control device 100 judges that there is a change in the biological information during the normal recording period (Yes in step S111), the process proceeds to step S112. When the control device 100 does not judge that there is a change in the biological information during the normal recording period (No in step S111), the process proceeds to step S113.

[0055] When it is determined that there is a variation in the biometric information during the normal recording period (Yes in step S111), the control device 100 generates a thumbnail image based on the image at the time of the variation in the biometric information (step S112). More specifically, the control device 100 assigns, by the thumbnail image generating unit 120, an image of a frame captured at the time of the variation in the biometric information as a thumbnail image of the normal file. The control device 100 proceeds to step S114. In the example of FIG. 2, a variation in the biometric information is detected at time Tb1 during the normal recording period (from time T to time T+1) when the captured file F, which is a normal file, is generated. Therefore, the image of the frame captured at time Tb1 is assigned as the thumbnail image of the captured file F.

[0056] If it is not determined that there is a change in the biometric information during the normal recording period (No in step S111), the control device 100 generates a thumbnail image based on the first image of the normal file (step S113). More specifically, the control device 100 assigns the image of the first frame of the shooting file as the thumbnail image of the normal file by the thumbnail image generating unit 120. The control device 100 proceeds to step S114. In the example of FIG. 2, no change in the biometric information is detected during the normal recording period (from time T-1 to time T) when the shooting file F-1, which is a normal file, is generated. Therefore, the image of the first frame of the shooting file F-1, which was shot at time T-1, is assigned as the thumbnail image of the shooting file F-1.

[0057] The control device 100 associates the thumbnail image with the normal file and records it (step S114). More specifically, the control device 100 causes the recording control unit 122 to associate the captured file as a normal file generated by the captured data processing unit 113 with the thumbnail image generated by the thumbnail image generating unit 120 and record them in the recording unit 212.

[0058] In this way, the control device 100 normally records a thumbnail image from the image of the first frame in the video constituting the shooting file. When there is a change in the biometric information during the normal recording period, the control device 100 normally records a thumbnail image based on the image at the time of the change in the biometric information.

[0059] <Effects> As described above, in this embodiment, when a variation in biometric information is detected, a thumbnail image based on the image at the time the variation was detected can be added and recorded. In this embodiment, when a variation in biometric information is detected during a normal recording period, a thumbnail image based on the image at the time of the variation in the biometric information can be added and recorded. According to this embodiment, it is possible to add and record a thumbnail image that is likely to capture an event around the vehicle that caused the variation in the biometric information of the occupant. According to this embodiment, it is possible to easily search for captured normal files.

[0060] In this embodiment, when it is detected that the biometric information has changed from a normal state to an abnormal state, a thumbnail image can be generated from the video at the time of detection.

[0061] In this embodiment, when the heart rate rises from the normal heart rate during the normal recording period, a thumbnail image based on the image at the time of the change in the biological information can be added and recorded.

[0062] In this embodiment, when the facial expression changes from a normal facial expression to a surprised facial expression during the normal recording period, it is possible to record the change by adding a thumbnail image based on the image at the time of the change in the biometric information.

[0063] [Second embodiment] The video recording device 10 according to this embodiment will be described with reference to Figs. 5 and 6. Fig. 5 is a diagram for explaining a captured file and event data. Fig. 6 is a flow chart showing an example of a process flow for associating thumbnail images in the control device 100 according to the second embodiment. The basic configuration of the video recording device 10 is similar to that of the video recording device 10 of the first embodiment. In the following description, components similar to those of the video recording device 10 are given the same or corresponding reference numerals, and detailed description thereof will be omitted. In this embodiment, the process in the biometric information detection unit 114 is different from that in the first embodiment.

[0064] In this embodiment, the biological information detection unit 114 detects that the biological information has changed from a normal state to an abnormal state during an event recording period during which an event recording process was performed before the event was detected.

[0065] In this embodiment, when the detected biological information is a heart rate, the biological information detection section 114 detects that the heart rate has increased from a normal heart rate during an event recording period before the event is detected.

[0066] In this embodiment, when the detected biological information is facial expression, the biological information detection section 114 detects that the facial expression has changed from a normal facial expression to a facial expression expressing surprise during the event recording period before the event is detected.

[0067] The thumbnail image generating unit 120 assigns a thumbnail image to a captured file that is event data. More specifically, the thumbnail image generating unit 120 normally assigns a thumbnail image to an image of the first frame in a video that constitutes the captured file that is event data.

[0068] When there is a change in the biometric information during an event recording period before the event is detected, the thumbnail image generating unit 120 generates a thumbnail image based on an image of the biometric information at the time of the change. More specifically, the thumbnail image generating unit 120 assigns an image of a frame captured at the time of the change in the biometric information as a thumbnail image of the event data.

[0069] The event data and the captured files will be described with reference to Fig. 5. The captured file F-1, the captured file F, and the captured file F+1 are the same as those in the first embodiment. The event data is captured data for a predetermined period before and after the event is detected, and is saved as overwrite-prohibited event data.

[0070] For example, if an event is detected at time Ti, the captured data from time Ti1 to time Ti2 is saved as event data If01. If an event is detected at time Ti, for example, if no variation in the biological information is detected from time Ti1 to time Ti, the thumbnail image of the event data If01 is generated from the image of the first frame of the event data If01, in other words, the image at time Ti1. If an event is detected at time Ti, and a variation in the biological information is detected at time Tb2 within the period from time Ti1 to time Ti, the thumbnail image of the event data If01 is generated from the image at time Tb2, not the image at time Ti1. The event recording period before the event detection of the event data If01 is the period from time Ti1 to time Ti.

[0071] Next, the event recording process shown in step S105 of Fig. 3, that is, the process of adding a thumbnail image to event data when an event is recorded, will be described with reference to Fig. 6. The process of step S122 is the same as the process of step S112 of the flowchart shown in Fig. 4. The process of the flowchart shown in Fig. 6 is executed in the event recording process.

[0072] The control device 100 judges whether or not there is a change in the biological information during the event recording period before the event detection (step S121). More specifically, the control device 100 judges whether or not the biological information has changed from a normal state to an abnormal state as a change in the biological information during the event recording period before the event detection, based on the detection result of the biological information detection unit 114. More specifically, the control device 100 judges whether or not the heart rate has increased from a normal state heart rate to an abnormal state during the event recording period before the event detection, based on the biological information detection unit 114. The control device 100 judges whether or not there is an abnormal state in which the facial expression has changed from a normal state expression to a surprised expression during the event recording period before the event detection, based on the biological information detection unit 114 as a change in facial expression during the event recording period before the event detection. When the control device 100 judges that there is a change in the biological information during the event recording period before the event detection (Yes in step S121), the process proceeds to step S122. When the control device 100 does not judge that there is a change in the biological information during the event recording period before the event detection (No in step S121), the process proceeds to step S123.

[0073] If it is not determined that there is a change in the biological information during the event recording period before the event is detected (No in step S121), the control device 100 generates a thumbnail image based on the first image of the event data (step S123). More specifically, the control device 100 assigns the image of the first frame of the event data as the thumbnail image of the event data by the thumbnail image generating unit 120. The control device 100 proceeds to step S124. In the example of FIG. 5, if no change in the biological information is detected during the event recording period (from time Ti1 to time Ti) before the event is detected in the event data If01, the image of the first frame of the event data If01 captured at time Ti1 is assigned as the thumbnail image of the event data If01.

[0074] 5, a change in biological information is detected at time Tb2 during the event recording period (from time Ti1 to time Ti) before the event is detected in the event data If01. Therefore, the image of the frame captured at time Tb2 is assigned as the thumbnail image of the event data If01.

[0075] The control device 100 associates the thumbnail image and stores the event data (step S124). More specifically, the control device 100 causes the recording control unit 122 to record in the recording unit 212 the shooting file as event data generated by the shooting data processing unit 113 and the thumbnail image generated by the thumbnail image generating unit 120 in association with each other.

[0076] In this way, the control device 100 normally records a thumbnail image from the image of the first frame in the video constituting the shooting file. If there is a change in the biometric information during the event recording period before the event detection, the control device 100 records the thumbnail image based on the image at the time of the change in the biometric information.

[0077] <Effects> As described above, according to this embodiment, it is possible to easily search for photographed event data.

[0078] The video recording device according to the present disclosure may be embodied in various different forms other than the embodiment described above.

[0079] Each component of the illustrated video recording device is a functional concept, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of the device may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0080] The configuration of the video recording device is realized, for example, as software, by a program loaded into a memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms by hardware alone, software alone, or a combination of both.

[0081] The above-mentioned components include those that a person skilled in the art can easily imagine and those that are substantially the same. Furthermore, the above-mentioned configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the scope of the present invention.

[0082] Although the above description has been given assuming that the second camera 211 is provided, the detection of the heart rate of the vehicle occupant is not limited to this. The detection of the heart rate of the vehicle occupant is not limited to detection using the image of the second camera 211, and various methods such as various sensors provided on the vehicle seat or a smart watch can be applied. [Explanation of symbols]

[0083] 10 Video recording device 100 Control device (video recording control device) 111 Shooting data acquisition section 112 Buffer Memory 113 Shooting data processing section 114 Biometric information detection unit 116 Operation control section 117 Event detection unit 118 Location information acquisition unit 119 Display control section 121 Playback control section 122 Recording control section 120 Thumbnail image generator 210 First Camera 211 Second Camera 212 Recording Department 213 Operation section 214 Acceleration Sensor 215 GNSS receiver 216 Display section

Claims

1. an image data acquisition unit that controls a camera used in the vehicle and acquires image data captured by the camera; a biometric information detection unit that detects biometric information of a vehicle occupant and a change in the biometric information; a photographic data processing unit that generates, from the photographic data, a photographic file to which a thumbnail image is to be associated; a thumbnail image generating unit that generates a thumbnail image based on an image of the biometric information at the time of the change when the biometric information detecting unit detects a change in the biometric information; a recording control unit that associates the captured image file generated by the captured image data processing unit with the thumbnail image generated by the thumbnail image generating unit and records them in a recording unit; A video recording control device comprising:

2. the biological information detection unit detects, as a change in the biological information, that the biological information has changed from a normal state to an abnormal state; the thumbnail image generation unit generates a thumbnail image from the video at the time when the biometric information detection unit detects that the biometric information has changed from a normal state to an abnormal state; The video recording control device according to claim 1 .

3. the biological information detection unit detects heart rate information of the vehicle occupant, and detects an increase in the heart rate from a normal heart rate as the abnormal state. The video recording control device according to claim 2 .

4. the biological information detection unit detects a facial expression of the vehicle occupant, and detects a change in the facial expression from a normal expression to an expression of surprise as the abnormal state. The video recording control device according to claim 2 .

5. an imaging control step of controlling a camera used in the vehicle and acquiring imaging data captured by the camera; a biometric information detection step of detecting biometric information of an occupant of the vehicle and a change in the biometric information; a photographic data processing step of generating, from the photographic data, a photographic file to which a thumbnail image is to be associated; a thumbnail image generating step of generating a thumbnail image based on an image of the biometric information at the time of the change, when a change in the biometric information is detected in the biometric information detecting step; a recording control step of recording the captured image file generated in the captured image processing step and the thumbnail image generated in the thumbnail image generating step in a recording unit in association with each other; A video recording method performed by a video recording device.

Images