Recording control device, recording control method and storage medium

By shooting around the vehicle to obtain images and recording them as motion picture files, users can indicate the playback immediately before, solving the problem in the existing technology that any part of the recording process cannot be immediately played back, and realizing flexible image playback in vehicle shooting.

CN114731386BActive Publication Date: 2025-09-12JVC KENWOOD CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202080078334.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-01-06
Filing Date
2020-11-20
Publication Date
2025-09-12
Estimated Expiration
2040-11-20

AI Technical Summary

Technical Problem

In the prior art, the tracking playback function can only play back the video from the beginning of the recording, and cannot immediately play back any part of the recording process, especially the non-beginning part of the video taken while the vehicle is moving.

Method used

By shooting around the vehicle to obtain images, recording them as motion picture files, setting specified unit division and recording, the user can instruct the previous playback through the operation receiving unit, the recording control unit changes the recording destination and closes the original recording file, and the display control unit plays back from the end of the original file.

Benefits of technology

It enables immediate reproduction of the immediately preceding image when shooting around the vehicle, meeting user needs, reducing the impact of file management, and improving operational flexibility and practicality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114731386B_ABST
    Figure CN114731386B_ABST
Patent Text Reader

Abstract

In a recording control device, an image acquisition unit (12) acquires an image being shot while shooting the surroundings of a vehicle. A recording control unit (20) sets a motion image file for dividing and recording the image being shot acquired by the image acquisition unit (12) into each prescribed unit, and records the image being shot in the motion image file until the prescribed unit is satisfied. A display control unit (28) reproduces the image recorded in the motion image file. An operation receiving unit (26) receives an operation input from a user. When the operation receiving unit (26) receives an instruction from the user to reproduce the immediately preceding portion of the image in the recording, the recording control unit (20) sets a subsequent motion image file as a new recording destination of the image and changes the recording destination, and closes the previous motion image file that was previously the recording destination, and the display control unit (28) starts to reproduce from a time point that is a prescribed time back from the end of the previous motion image file.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a recording control device, a recording control method and a recording control program for recording images. Background Art

[0002] In recording devices for television broadcasting, a chase playback function is common, that is, a program is recorded and played back from the beginning. There are also examples of such a function being applied to driving recorders (for example, see Patent Document 1).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2015-8483. Summary of the Invention

[0006] Problems to be solved by the invention

[0007] However, the tracking playback is based on the premise of playing back the video from the beginning of the recording, not on the premise of immediately playing back any part other than the beginning. In addition, for the occupants of the vehicle, the content they want to play back immediately while shooting is not necessarily the beginning of the video they have taken.

[0008] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a recording control device capable of reproducing the immediately preceding image during imaging of the surroundings of a vehicle.

[0009] Means for solving problems

[0010] To address the aforementioned issues, a recording control device according to one embodiment of the present invention includes: an image acquisition unit for acquiring an image being captured while capturing the surroundings of a vehicle; a recording control unit for setting a moving image file for dividing and recording the image being captured by the image acquisition unit into predetermined units, and recording the image being captured into the moving image file until the predetermined units are met; a display control unit for reproducing the image recorded in the moving image file; and an operation receiving unit for receiving a user input. When the operation receiving unit receives a user instruction to reproduce the immediately preceding portion of the recorded image, the recording control unit sets a subsequent moving image file as the new recording destination for the image, changes the recording destination, closes the previous moving image file that was previously the recording destination, and the display control unit starts playback from a point in time a predetermined time back from the end of the previous moving image file.

[0011] Another aspect of the present invention is a recording control method. The method includes the following steps: capturing an image being captured while capturing the surroundings of a vehicle; creating a moving image file for dividing and recording the image being captured into predetermined units; recording the image being captured into the moving image file until the predetermined units are met; reproducing the image recorded in the moving image file; upon receiving a user instruction to reproduce the immediately preceding portion of the recorded image, creating a subsequent moving image file as a new recording destination for the image, changing the recording destination, and closing the previous moving image file that was previously the recording destination; and reproducing the image from a point in time a predetermined time back from the end of the previous moving image file.

[0012] Furthermore, any combination of the above-described constituent elements, or substitutions between constituent elements or expressions in methods, apparatuses, systems, programs, and the like of the present invention may also be practiced as additional modes of the present invention.

[0013] Effects of the Invention

[0014] According to the present invention, it is possible to provide a recording control device capable of reproducing the immediately preceding image during imaging of the surroundings of a vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a block diagram schematically showing the functional structure of a drive recorder.

[0016] Figure 2 1 is a diagram showing a first example of the temporal relationship between the image recording process and the reproduction process.

[0017] Figure 3 2 is a diagram illustrating a second example of the temporal relationship between the image recording process and the playback process.

[0018] Figure 4 This is a flowchart showing the image recording and playback processes. DETAILED DESCRIPTION

[0019] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. The specific numerical values ​​and the like shown in the embodiments are merely examples for facilitating understanding of the invention and, except where otherwise specified, do not limit the present invention. In addition, in this specification and the accompanying drawings, elements having substantially the same function and structure are marked with the same reference numerals and repeated descriptions are omitted. In addition, elements not directly related to the present invention are omitted from illustration. In the embodiments described below, a driving recorder and a navigation device are mainly illustrated as examples of the recording control device.

[0020] Figure 1This is a block diagram schematically illustrating the functional structure of the drive recorder 10. Each illustrated functional block can be implemented in hardware through components such as a computer CPU and memory, or mechanical devices, and in software through computer programs, etc. Here, the functional blocks are described as being implemented through the collaboration of these components. Therefore, those skilled in the art will appreciate that these functional blocks can be implemented in various forms through a combination of hardware and software.

[0021] The dashcam 10 includes an image acquisition unit 12, a sound acquisition unit 14, a vehicle information acquisition unit 16, an event detection unit 18, a recording control unit 20, a temporary storage unit 22, a communication unit 24, an operation reception unit 26, an image processing unit 50, a display control unit 28, and a sound output unit 29. The image acquisition unit 12 may be configured as part of the vehicle information acquisition unit 16, or the image acquisition unit 12 may be included in the vehicle information acquisition unit 16. The dashcam 10 is mounted on a vehicle. The communication unit 24 transmits and receives information to and from external devices via wireless communication. The operation reception unit 26 receives user input. The display control unit 28 controls the display of the captured image on the display device 49. The display device 49 is a monitor provided by the navigation device 11. However, as a modified example, the display device 49 may be built into the dashcam 10, or may be displayed as an overlay or interrupt on a display device (not shown) equipped in the vehicle, such as an infotainment system, an electronic mirror, or a head-up display. The sound output unit 29 controls the output of sound to a speaker 47, which outputs recorded sound, warning sounds, and other sounds. The speaker 47 is a speaker included in the navigation device 11 or the vehicle, but as a variation, the speaker 47 may be built into the drive recorder 10. The connection between the drive recorder 10 and the navigation device 11 may be wireless communication via the communication unit 24 or wired communication such as a UART (Universal Asynchronous Receiver / Transmitter) or a USB (Universal Serial Bus).

[0022] The image acquisition unit 12 acquires the image being captured while capturing the surroundings of the vehicle. The image acquisition unit 12 acquires images captured by the front camera 40 and the rear camera 42 installed in the vehicle. The front camera 40 is configured to capture the surroundings of the vehicle, in particular, the front of the vehicle. The rear camera 42 is configured to capture the surroundings of the vehicle, in particular, the rear of the vehicle. The front camera 40 can be configured to capture both the front of the vehicle and the interior of the vehicle, or it can be configured to capture the entire front, sides, and interior of the vehicle, and can be composed of a single omnidirectional camera capable of capturing 360 degrees of the surroundings, or it can be composed of multiple cameras that capture the front, back, and sides. The front camera 40 and the rear camera 42 can be built into the driving recorder 10 or can be separate from the driving recorder 10. The rear camera 42 is a camera that also transmits rearward images to the navigation device 11, and serves as a camera for both the driving recorder 10 and the navigation device 11.

[0023] The image acquisition unit 12 can acquire images captured by the front camera 40 and the rear camera 42 as vehicle information related to vehicle travel, and the image acquisition unit 12 can also be considered part of the vehicle information acquisition unit 16. The image acquisition unit 12 acquires the image from the front camera 40 and, regardless of whether vehicle information indicating that the gear position is in reverse gear is acquired, acquires the image from the rear camera 42. While acquiring vehicle information indicating that the gear position is in a gear other than drive or park, the display control unit 28 displays the image from the front camera 40 on the display device 49. While acquiring vehicle information indicating that the gear position is in reverse gear, the display control unit 28 displays the image from the rear camera 42 on the display device 49. As a modified example, the image from the rear camera 42, as well as the image from the front camera 40, can also be displayed on the display device 49 at all times, regardless of whether vehicle information indicating that the gear position is in reverse gear is acquired.

[0024] The sound acquisition unit 14 acquires sound data acquired by a microphone 44 installed in the vehicle. The microphone 44 is configured to collect sound from inside and outside the vehicle. The microphone 44 can be built into the driving recorder 10, can be separated from the driving recorder 10, or can be integrated with the front camera 40 or the rear camera 42. Alternatively, it can be built into the navigation device 11. When built into the navigation device 11, the microphone 44 is used for the sound recognition operation of the navigation device 11. The sound acquisition unit 14 can acquire sound as vehicle information related to the driving of the vehicle through the microphone 44, or the sound acquisition unit 14 can be regarded as a part of the vehicle information acquisition unit 16.

[0025] The vehicle information acquisition unit 16 acquires vehicle information related to the vehicle's travel from an onboard device 46 installed in the vehicle. Specific examples of the onboard device 46 include, but are not limited to, a vehicle speed sensor, a steering angle sensor, an accelerator operation amount sensor, a brake operation amount sensor, an acceleration sensor, a gyroscope sensor, a radar sensor, a LiDAR (Light Detection and Ranging), a position information sensor (e.g., a GNSS (Global Navigation Satellite System)), and a passenger seating sensor. The vehicle information acquisition unit 16 can acquire vehicle information via various control ECUs (Electronic Control Units) or via the navigation device 11. Alternatively, the vehicle information acquisition unit 16 can acquire position information from a position information sensor built into the navigation device 11. Alternatively, the vehicle information acquisition unit 16 can acquire information detected by various sensors, such as an acceleration sensor, a gyroscope sensor, and a position information sensor, built into a terminal such as a user's mobile phone, via the communication unit 24. Alternatively, the vehicle information acquisition unit 16 can acquire information related to the vehicle's travel from sensors built into the drive recorder 10. For example, the drive recorder 10 may include sensors such as an acceleration sensor and a position information sensor. In addition, the front camera 40 , the rear camera 42 , and the microphone 44 may be considered as one of the vehicle-mounted devices, and the vehicle information acquisition unit 16 may be configured to include the image acquisition unit 12 and the sound acquisition unit 14 .

[0026] The vehicle information acquisition unit 16 acquires, for example, information related to the vehicle's status, information related to vehicle operations, information related to the vehicle's speed, information related to the vehicle's position, information related to obstacles around the vehicle, and information related to the operating status of the vehicle's driving assistance functions from the onboard device 46. The various information acquired by the vehicle information acquisition unit 16 is different from the detection of objects around the vehicle by image recognition by the image processing unit 50, described later, and is information detected by sensors other than cameras. The vehicle information acquisition unit 16 may also acquire, for example, information indicating the open or closed status of doors or windows as information related to vehicle status. The vehicle information acquisition unit 16 may also acquire, for example, information indicating the presence of instructions to open or close doors or windows as information related to vehicle operations. The vehicle information acquisition unit 16 may also acquire, as information related to obstacles around the vehicle, information indicating the presence of other vehicles within a certain range around the vehicle, or information indicating the presence of obstacles such as pedestrians, bicycles, fallen objects, or buildings in the lane in which the vehicle is traveling. The vehicle information acquisition unit 16 may also acquire information indicating the presence of passengers in the vehicle. As information related to the operating status of the vehicle's driving assistance functions, the vehicle information acquisition unit 16 may also acquire information related to whether the autonomous driving function or remote operation function is enabled or disabled, or information related to whether a specific driving assistance function is enabled or disabled. Examples of driving assistance functions include, but are not limited to, adaptive cruise control (ACC) and lane keeping assist system (LKAS).

[0027] The event detection unit 18 detects the occurrence of various predetermined events (hereinafter referred to as “trigger events”) based on the video data acquired by the image acquisition unit 12 , the audio data acquired by the audio acquisition unit 14 , and the vehicle information acquired by the vehicle information acquisition unit 16 .

[0028] Trigger events are assumed to be major events such as vehicle accidents and disputes. These are events that, when detected or detected, trigger the storage of image data as data that prohibits overwriting. The event detection unit 18 detects, for example, accidents such as vehicle collisions, contact, rollovers, and falls, as well as disputes such as aggressive behavior or dangerous driving by drivers of surrounding vehicles as trigger events. The event detection unit 18 can also detect the occurrence of accidents or disputes through image recognition and voice recognition based on predetermined recognition patterns, using image data captured by the front camera 40 and rear camera 42 and audio data captured by the microphone 44. The event detection unit 18 can also detect the occurrence of trigger events by identifying sudden changes in vehicle behavior, such as sudden starts, sudden stops, and sharp turns, based on information such as vehicle speed and acceleration, and accelerator, brake, and steering wheel operation. The event detection unit 18 can also detect the occurrence of trigger events by identifying, based on predetermined recognition patterns, proximity to surrounding objects or lane departure from the vehicle, based on image data from the front camera 40 and rear camera 42 and information from the vehicle's radar sensors. When the operation accepting unit 26 receives a press of a save start button provided in the drive recorder 10 or a voice instruction indicating the start of save, the event detecting unit 18 may detect this as the occurrence of a trigger event.

[0029] The image processing unit 50 pre-stores image recognition patterns for detecting various objects from images and, based on these patterns, uses a predetermined image recognition algorithm to detect objects reflected in the images. Image recognition patterns can be defined through machine learning, such as deep learning. In particular, they can be image recognition patterns specifically tailored to objects captured by the dashcam camera, such as four-wheeled vehicles, two-wheeled vehicles, pedestrians, road features, and other objects that may be present on and around the road. The image processing unit 50 further identifies white lines and lanes on the road. Among the objects detected in the image captured by the rear camera 42, the image processing unit 50 detects vehicles such as four-wheeled vehicles and two-wheeled vehicles as surrounding vehicles.

[0030] The recording control unit 20 temporarily stores, in the temporary storage unit 22, image data constantly captured by the front camera 40 or the rear camera 42 and acquired by the image acquisition unit 12, sound data constantly collected by the microphone 44 and acquired by the sound acquisition unit 14, and vehicle information acquired by the vehicle information acquisition unit 16. The recording control unit 20 records the image data and sound data stored in the temporary storage unit 22 on the recording medium 48 in a ring buffer format.

[0031] The temporary storage unit 22 may also be a buffer memory composed of a non-volatile memory such as a flash memory or a solid state drive (SSD), or a volatile memory such as a DRAM. The recording medium 48 is, for example, a memory card such as an SD card (registered trademark), which is configured to be inserted into a slot provided in the driving recorder 10 for use and can be removed from the driving recorder 10. The recording medium 48 may be composed of an auxiliary storage device such as a solid state hard disk or a hard disk drive, or the auxiliary storage device built into the navigation device 11 may be used as such an auxiliary storage device. In addition, the sound data stored in the temporary storage unit 22 and the sound data recorded in the recording medium 48 are stored or recorded in the form of a motion image file synthesized with the image data. However, depending on the mode selected by the user, a motion image file is sometimes stored and recorded as silent image data that does not contain sound data. Therefore, in the concept of "motion image file" described below, although not specifically stated, there may be cases where sound data is included and cases where sound data is not included.

[0032] The video data stored in temporary storage unit 22 may also be stored as a moving image file in a streaming format such as MPEG2-TS, which is divided into predetermined time periods. The video data recorded on recording medium 48 and the moving image file stored in temporary storage unit 22 may be in the same format or different formats, such as a format with a higher compression rate such as MP4.

[0033] Since the recording control unit 20 records the moving image files in the temporary storage unit 22 and the recording medium 48 in a ring buffer format, when the data stored in the temporary storage unit 22 and the recording medium 48 reaches capacity, the data is overwritten starting with the oldest data. The recording control unit 20 temporarily records the moving image files in the temporary storage unit 22 and the recording medium 48 with an overwrite-enabled attribute.

[0034] When the event detection unit 18 detects the occurrence of a trigger event, the recording control unit 20 sets a non-overwrite storage format for the motion image file recorded on the recording medium 48, including at least the period of time during which the trigger event was detected. The overwrite / non-overwrite attribute can be set, for example, by writing a predetermined flag to the motion image file, or by writing the overwrite / non-overwrite attribute to a management file, such as an index, that is independent of the motion image file. When the overwrite / non-overwrite attribute is written to the original motion image file itself, for example, information indicating the start and end positions of the non-overwriteable storage period can also be written to the original motion image file. In this case, when the portion not to be saved, i.e., the overwriteable portion, is later overwritten with different data, the portion from the start to the end of the saved portion is cut out and left as a separate file. Alternatively, the distinction between overwrite / non-overwrite is made by cutting out the portion to be saved from the original motion image file and saving it as a separate file. If the portion to be saved spans multiple motion image files, a concatenated file cut out from each of the motion image files can be saved. When saving data in a separate file, a method may be adopted in which data is recorded in a specific area, such as a specific folder, different from the area where overwritable data is recorded, to distinguish between overwritable and non-overwritable data. Data with the non-overwritable attribute set remains in the overwritable state until it is changed to the deletable or overwritable attribute by explicit user operation.

[0035] The recording control unit 20 sets a motion image file as a container for dividing and recording the image being shot acquired by the image acquisition unit 12 into each prescribed unit. The prescribed unit is, for example, 1 minute, and a new motion image file is set by dividing the frame images of the motion image file into each 1 minute. The recording control unit 20 records the multiple frame images constituting the image being shot into the motion image file until the prescribed unit (for example, 1 minute) is met. When the recording control unit 20 newly sets a subsequent motion image file, it changes the recording destination of the image in the subsequent motion image file and closes the previous motion image file that was the recording destination. The recording control unit 20 can use the motion image file as the object of reproduction by adding information indicating the end to the end of the file when closing the motion image file. The display control unit 28 reproduces the image recorded in the motion image file.

[0036] Sometimes, a driver may want to revisit scenes they missed or objects they passed while driving. For example, consider situations where a driver might want to revisit traffic information displays, road guidance displays, road signs, billboards, accident scenes, destinations, planned bends, parking lot availability, lines at restaurants, or the appearance of people or animals. In such situations, even if the dashcam 10 records footage, the scene they missed or passed by cannot be immediately replayed, requiring verification only after it is saved to a memory card. In this embodiment, a button (hereinafter referred to as the "immediately previous playback button") is provided on the dashcam 10 or the like for instructing the user to replay the immediately preceding portion (hereinafter also referred to as the "immediately previous playback button"). This allows the user to operate the immediately preceding playback button to immediately replay the immediately preceding portion, even while filming. The immediately preceding playback button can be provided on the dashcam 10 body, for example, as a dedicated button or as a button that functions in conjunction with the normal playback button. In the case of a dual-purpose button, for example, when pressed once, it becomes a normal playback instruction, or it can function as a previous playback button only when a long press or two or more consecutive presses are performed. In addition, the rewind time to the playback start timing can be extended by 10 seconds each time according to the length of the long press time or the number of consecutive presses. In a modified example, it is also possible to reversely play back the GOP (Group Of Pictures) immediately before the point in recording while the previous playback button is long pressed, and play back the images in sequence from the time when the long press is released. In this case, reverse playback can also be performed by displaying only the key frames contained in the GOP, such as rewinding. The previous playback button can be displayed on a touch panel of a display device 49 included in an information terminal, and can be operated by the user. The information terminal is included in the driving recorder 10, the navigation device 11 or the mobile phone, etc. Alternatively, the operation receiving unit 26 can also receive an instruction for previous playback by voice input via the microphone 44.

[0037] When the operation receiving unit 26 receives an instruction from the user to reproduce the immediately preceding image in the recording, the recording control unit 20 sets the subsequent motion image file as the new recording destination of the image, changes the recording destination, and closes the previous motion image file that was previously the recording destination. The display control unit 28 starts the reproduction from a time point of a predetermined time, for example, 20 seconds, backtracking from the end of the closed previous motion image file, and ends the reproduction when the recording position of the time point indicating the immediately preceding reproduction is reached. As a modified example, the reproduction may also be performed at a time point of a predetermined time, such as 10 seconds after the time point indicating the immediately preceding reproduction. When the time point of the predetermined time is included in a motion image file that is earlier than the preceding motion image file and is earlier than a predetermined reference, the recording control unit 20 does not change the recording destination to the subsequent motion image file triggered by the instruction to reproduce the immediately preceding portion. More specifically, in a case where the time point of the predetermined time is included in a motion image file that is earlier than the previous motion image file, and in a case where the recording of the previous motion image file can be ended before the reproduction starts from the time point of the predetermined time and reaches the end of the previous motion image file, the recording destination of the subsequent motion image file triggered by the instruction to reproduce the immediately preceding portion is not changed. In the case of a method of dividing motion image files into 1-minute intervals, in a case where the time of the predetermined time of the backward movement for the immediately preceding reproduction is 1 minute or more equal to the length of the motion image file, the immediately preceding portion included in the previous motion image file can be reproduced without changing the recording destination of the subsequent motion image file. Details are in Figure 3 To be discussed later.

[0038] When the recording control unit 20 changes the recording destination to a subsequent moving image file in response to an instruction to play back the immediately preceding portion, it combines the preceding moving image file with the subsequent moving image file after finishing playing back the immediately preceding portion. The length of the subsequent moving image file is determined to be less than the one-minute length corresponding to the length of the preceding moving image file, that is, the length obtained by subtracting the length of the preceding moving image file from one minute, so that the combined moving image file becomes a one-minute file. In this modified example, assuming that the preceding and subsequent moving image files are not combined after the immediately preceding playback, the subsequent moving image file can also be a one-minute file as usual.

[0039] The recording control unit 20 sets a non-overwrite storage format for the moving image file that was the target of the immediately preceding playback. In this case, the entire moving image file that was the target of the immediately preceding playback can be non-overwritten, or only the portion that was the target of the immediately preceding playback can be set to non-overwrite, or only that portion can be cut out of the original moving image file and saved in a non-overwrite format. The event detection unit 18 can also detect a user instruction to play back the immediately preceding playback as a trigger event and set a non-overwrite storage format for the moving image file that was the target of the immediately preceding playback triggered by this detection. Furthermore, an upper limit can be set for the number of moving image files that can be set to non-overwrite format when the file was the target of the immediately preceding playback. The upper limit can be, for example, 10. The user can also select whether to set the moving image file that was the target of the immediately preceding playback to non-overwrite format. For example, a "Save?" message can be displayed on the screen at the end of the immediately preceding playback. Alternatively, the file can be set to non-overwrite format only if the user selects Save. Alternatively, the file that is to be saved in a non-overwrite format among the moving image files that were the target of the immediately preceding playback can be a still image file rather than a moving image file. In this case, the user can also specify a scene to be saved as a static image file. For example, the playback can be temporarily stopped at a user-specified position during the previous playback, the user-specified area can be enlarged and displayed, and the enlarged area can be cut out and saved as a static image file.

[0040] Figure 2The first example of the temporal relationship between image recording and playback processing is shown. The upper portion of the figure shows the state up to the playback instruction, while the lower portion shows the state after the playback instruction. Recording begins at the left end, and the right end indicates the position during recording. As shown in the upper portion of the figure, the recording control unit 20 begins recording the image with the first motion image file 60a as the recording destination (t1). After one minute, the motion image file is split (t2), and the second motion image file 60b is set as the new recording destination, continuing recording with this file as the new recording destination. Furthermore, after one minute, the motion image file is split (t3), and the third motion image file 60c is set as the new recording destination, continuing recording with this file as the new recording destination. At any time t5 during image recording, if the user instructs immediate playback, as shown in the lower portion, the recording control unit 20 closes the third motion image file 60c, adds information indicating the end, and sets the fourth motion image file 60d as the new recording destination, continuing recording with this file as the new recording destination. At the same time, as shown in the lower section, the display control unit 28 plays back the portion 61 immediately preceding the playback instruction timing t5, that is, the 20-second portion from timing t4 to t5, which is 20 seconds ahead of t5. While the display control unit 28 plays back the immediately preceding portion 61, the recording control unit 20 also continues recording the video to the fourth moving image file 60d. However, the remaining recording time of the fourth moving image file 60d is determined so that the third moving image file 60c and the fourth moving image file 60d are combined from behind to form a one-minute file. When this recording time has elapsed (t6), the fifth moving image file 60e is set as the new recording destination, and recording continues with this file as the new recording destination (t7).

[0041] After playback of the immediately preceding portion 61 and recording to the fourth moving image file 60d are complete, the recording control unit 20 combines the third moving image file 60c and the fourth moving image file 60d into a single moving image file (t3-t6). Furthermore, this moving image file is set to a storage format that prevents overwriting. Consequently, all moving image files, regardless of whether they have a playback instruction, ultimately have a length of one minute. Alternatively, as a variation, the subsequent moving image files including the fourth moving image file 60d can also be one-minute moving image files, provided that the immediately preceding playback instruction and the subsequent moving image files are not combined. In this case, the third moving image file 60c instructed to be played back as a moving image file shorter than one minute remains after playback completes. Alternatively, as a variation, if the time point preceding the immediately preceding playback instruction t5 is included in the previous second moving image file 60b, playback can be started without closing the third moving image file 60c currently being recorded and without setting a subsequent moving image file as a new recording destination. In this case, when the playback position approaches the end of the second moving image file 60b, the subsequent moving image file is set as the new recording destination, the recording destination is changed, and the third moving image file 60c is closed. However, such processing is performed only when the method of backtracking less than 1 minute is instructed for the immediately preceding playback. In the case of backtracking more than 1 minute, as described later, Figure 3 Control it that way.

[0042] Figure 3A second example of the temporal relationship between image recording and playback processing is shown. The upper portion of the figure shows the state up to the playback instruction, while the lower portion shows the state after the playback instruction. Recording begins at the left end, and the right end indicates the position during recording. This figure illustrates an example where playback is started one minute back in time when playback is instructed immediately before. As shown in the upper portion of the figure, the recording control unit 20 begins recording the image with the sixth moving image file 62a as the recording destination (t11). One minute later, the moving image file is divided (t12), and the seventh moving image file 62b is set as the new recording destination, continuing recording with this file as the new recording destination. Furthermore, one minute later, the moving image file is divided (t14), and the eighth moving image file 62c is set as the new recording destination, continuing recording with this file as the new recording destination. At any time t15 during image recording, if the user instructs playback immediately before, as shown in the lower portion, the one-minute preceding portion 63 is played back one minute back from time t15, i.e., at time t13. Here, the position t13 is included in the seventh moving image file 62b immediately preceding the eighth moving image file 62c in the recorded video. Therefore, in order to play back the seventh moving image file 62b from t13, there is no need to specifically close the eighth moving image file 62c. Recording to the eighth moving image file 62c can continue even after the playback instruction at t15 (t16). Furthermore, the time α from the start of playback at t13 to the end of the seventh moving image file 62b, t14, is equal to the time β from the playback instruction timing t15 to the scheduled end timing t17 of the eighth moving image file 62c. In other words, recording to the eighth moving image file 62c can be completed and closed before playback of the seventh moving image file 62b, which started at t13, ends. In this way, when replaying by more than one minute from the playback instruction timing t15, the previous seventh motion picture file 62b can be played back without closing the eighth motion picture file 62c being recorded, and the portion from t14 to t15 also spans the recording end timing of the eighth motion picture file 62c and playback continues from the seventh motion picture file 62b. Figure 3 In the above description, the example of playback is explained as starting from a point in time that is one minute ahead. However, the same control can be applied even when playback is started from a point in time that is longer than one minute ahead. For example, if the user is instructed to play back two minutes to the previous point in time at any time t15 during video recording, the video can be played back from the point in time that is two minutes ahead of the eighth moving image file 62c currently being recorded to the sixth moving image file 62a two minutes ahead as the previous point.

[0043] Figure 4This is a flowchart showing the image recording and playback processes. The image acquisition unit 12 acquires an image (S10). If there is no setting for a motion image file as the recording destination of the image ("No" in S12), the recording control unit 20 sets a new motion image file (S14) and records the image in the motion image file (S16). If there is a setting for a motion image file in S12, S14 is skipped ("Yes" in S12) and the image is recorded in the motion image file (S16). If 1 minute has passed since the image was recorded in the motion image file ("Yes" in S18), the recording control unit 20 resets the subsequent motion image file (S20), changes the recording destination of the image to the subsequent motion image file (S22), and closes the previous motion image file (S24). If 1 minute has not passed in S18, S20 to S24 are skipped ("No" in S18). Here, if there is an instruction from the user to play back the immediately preceding portion ("Yes" in S26), the recording control unit 20 resets the subsequent motion image file (S28), changes the recording destination of the image to the subsequent motion image file (S30), closes the previous motion image file (S32), and the display control unit 28 rewinds the specified time and starts playback (S34). If there is no playback instruction in S26, S28 to S34 are skipped ("No" in S26). If the playback position reaches the end of the immediately preceding portion ("Yes" in S36), the immediately preceding playback is ended (S38). If the motion image files need to be combined ("Yes" in S40), the preceding motion image file and the subsequent motion image file are combined (S42). If combination is not required, S42 is skipped ("No" in S40). If the end of the immediately preceding portion has not been reached in S36, S38 to S42 are skipped ("No" in S36). The process of this figure is exited and returns to the beginning, and the process of this figure is repeated.

[0044] As described above in the embodiment, the immediately preceding image can be immediately reproduced during filming of the vehicle's surroundings. Thus, if a scene that the driver missed or an object passed by while the vehicle was moving occurs and they want to revisit it, the preceding image can be immediately reproduced and confirmed with a simple operation. Furthermore, even if a motion image file is split to reproduce the immediately preceding portion, the impact of the mid-stage reproduction on file management can be minimized by combining it with subsequent motion image files. Furthermore, by adjusting the reproduction method for the immediately preceding portion, unnecessary splitting of the motion image file can be eliminated, minimizing the impact on file management.

[0045] While the present invention has been described above based on the embodiments, those skilled in the art will appreciate that the embodiments are merely illustrative and that various modifications of the combinations of the constituent elements and processing steps are possible, and that such modifications are also within the scope of the present invention.

[0046] Explanation of symbols

[0047] 10 : driving recorder, 12 : image acquisition unit, 20 : recording control unit, 26 : operation receiving unit, 28 : display control unit, 49 : display device.

[0048] Industrial Applicability

[0049] The present invention relates to a recording control device, a recording control method and a recording control program for recording images.

Claims

1. A recording control device, characterized in that: include: An image acquisition unit that acquires an image being captured while capturing the surroundings of the vehicle; a recording control unit configured to set a moving image file for dividing and recording the image being captured by the image capturing unit into predetermined time units, and recording the image being captured into the moving image file until the predetermined time unit is satisfied; a display control unit for reproducing the image recorded in the motion image file; as well as An operation receiving unit for receiving user operation input; When the operation accepting unit accepts an instruction from the user to reproduce the immediately preceding portion of the recorded video, The recording control unit sets a new subsequent moving image file and changes the recording destination of the video to the subsequent moving image file regardless of whether the predetermined time unit has elapsed, and closes the previous moving image file that was previously the recording destination. The display control unit starts playback from a time point a predetermined time back from the end of the previous moving image file.

2. The recording control device according to claim 1, wherein When the time point of the specified time is included in a motion image file that is one or more previous motion image files and is before a specified benchmark, the recording control unit does not change the recording destination to the subsequent motion image file based on the instruction to reproduce the immediately previous part.

3. The recording control device according to claim 1, wherein When the recording destination is changed to the subsequent moving image file in response to an instruction to play back the immediately preceding portion, the recording control unit combines the preceding moving image file with the subsequent moving image file after finishing playing back the immediately preceding portion.

4. A recording control method, characterized in that: The following processes are included: Acquiring an image during shooting of the surroundings of the vehicle; Setting a moving image file for dividing and recording the image being shot into predetermined time units; recording the captured image into the motion image file until the specified time unit is met; reproducing the image recorded in the motion image file; When receiving an instruction from the user to reproduce the immediately preceding portion of the video during recording, regardless of whether the predetermined time unit has elapsed, a subsequent moving image file is newly set and the recording destination of the video is changed to the subsequent moving image file, and the preceding moving image file that was previously the recording destination is closed; Reproduction is started from a point in time a predetermined time after the end of the preceding moving image file.

5. A computer-readable storage medium storing a recording control program, characterized in that: The recording control program enables the computer to implement the following functions: Acquiring an image during shooting of the surroundings of the vehicle; Setting a moving image file for dividing and recording the image being shot into predetermined time units; recording the captured image into the motion image file until the specified time unit is met; reproducing the image recorded in the motion image file; When receiving an instruction from the user to reproduce the immediately preceding portion of the recorded video, Regardless of whether the prescribed time unit has elapsed, the recording function newly sets a subsequent moving image file and changes the recording destination of the image to the subsequent moving image file, and closes the previous moving image file that was previously the recording destination, and The playback function starts playback from a time point traced back a predetermined time from the end of the previous moving image file.

Citation Information

Patent Citations

  • Image recording device for vehicle, reproducing apparatus, and program

    JP2015008483A

  • Method of filming high dynamic range videos

    CN104349062A

  • Driving information recording device, driving information display processing system, driving information recording method, display processing method, and program

    CN110100266A