Video recording control apparatus and video recording method
Patent Information
- Application Number
- JP2022193433
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-12-02
- Publication Date
- 2025-10-07
AI Technical Summary
Existing video recording systems, such as drive recorders, face issues where the position information associated with thumbnail images does not match the actual location of the recorded video due to differences in driving speed, leading to incorrect mapping and destination settings.
A video recording control device that associates photographic data with location information by generating thumbnail images from specific frames and recording this information together, ensuring accurate position data is linked to the selected files.
Enables precise association of location information with thumbnail images, allowing correct mapping and destination settings even when the recorded video is from a moving vehicle.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a video recording control device and a video recording method. [Background technology]
[0002] Video captured by a drive recorder is recorded as a shooting file, for example, every 60 seconds, and a thumbnail image is added to each shooting file. The shooting file also stores location information at the time of shooting. Generally, the thumbnail image of the shooting file is generated from the image of the first frame constituting the shooting file, and the location information of the shooting file is set to the location information at the time the shooting file is generated, that is, the location information at the time the image of the first frame constituting the shooting file is captured. A drive recorder that records event data and displays a thumbnail image corresponding to the event data, thereby allowing the event data to be selected and played back, has been disclosed (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2020-141170 A Summary of the Invention [Problem to be solved by the invention]
[0004] For example, by selecting a shooting file based on a display screen of thumbnail images based on footage continuously recorded by a drive recorder while the vehicle is operating, a location on a map can be displayed or set as the vehicle's destination in the navigation system based on the location information of the selected shooting file.
[0005] In such a case, if the thumbnail image of the selected shooting file is generated from the image of the first frame of the shooting file, the location information of the selected thumbnail image and the shooting file will match. On the other hand, if the thumbnail image is generated from an image other than the image of the first frame of the shooting file, the location information of the selected thumbnail image and the shooting file will not match.
[0006] For example, if the selected shooting file is a video taken while the vehicle is running, the location information of the selected shooting file and the location where the thumbnail image was taken may differ by several hundred meters depending on the running speed, etc. In such a case, the display on the map or the destination setting will not be set to the intended location.
[0007] The present disclosure has been made in consideration of the above, and has an object to appropriately associate location information with a captured file displayed as a thumbnail image. [Means for solving the problem]
[0008] In order to solve the above-mentioned problems and achieve the objective, the video recording control device of the present disclosure comprises a shooting data acquisition unit that acquires shooting data captured by a camera mounted on a moving object, a location information acquisition unit that acquires location information indicating the location of the moving object, a shooting data processing unit that generates shooting files for each specified time from the shooting data, a thumbnail image generation unit that generates thumbnail images from images that constitute the shooting files, and a recording control unit that records the shooting files and the thumbnail images in association with each other, and records location information acquired when the shooting file is selected based on the thumbnail image in association with the location information corresponding to the thumbnail image in the shooting file.
[0009] The video recording control device of the present disclosure includes a shooting data acquisition unit that acquires shooting data captured by a camera mounted on a mobile body, a shooting data processing unit that generates shooting files for each specified time from the shooting data, a highlight extraction unit that extracts highlights in the shooting data, a thumbnail image generation unit that generates thumbnail images from highlight images extracted by the highlight extraction unit in images that constitute the shooting file, a map information reference unit that acquires location information corresponding to the highlights from which the thumbnail image was generated by referring to map information, and a recording control unit that records the shooting file in association with the thumbnail image and records the location information acquired when the shooting file is selected based on the thumbnail image as location information corresponding to the highlights in the shooting file.
[0010] The video recording method according to the present disclosure is executed by a video recording device, comprising: a shooting data acquisition step of acquiring shooting data captured by a camera mounted on a moving object; a location information acquisition step of acquiring location information of the moving object; a shooting data processing step of generating shooting files for each predetermined time from the shooting data; a thumbnail image generation step of generating thumbnail images from images constituting the shooting files; and a recording control step of recording the shooting files and the thumbnail images in association with each other and recording location information acquired when the shooting file is selected in association with the location information corresponding to the thumbnail image in the shooting file.
[0011] The video recording method according to the present disclosure includes a video recording device executing a shooting data acquisition step of acquiring shooting data captured by a camera mounted on a moving body, a shooting data processing step of generating shooting files for each predetermined time from the shooting data, a highlight extraction step of extracting highlights in the shooting data, a thumbnail image generation step of generating thumbnail images from images of highlights extracted in the highlight extraction step in images constituting the shooting file, a map information reference step of acquiring location information corresponding to the highlights from which the thumbnail image was generated by referring to map information, and a recording control step of recording the shooting file and the thumbnail image in association with each other and recording location information obtained when the shooting file is selected based on the thumbnail image as location information corresponding to the highlights in the shooting file. Effect of the Invention
[0012] According to the present disclosure, it is possible to provide an effect of appropriately associating location information with a captured file displayed as a thumbnail image. [Brief description of the drawings]
[0013] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a video recording device having a control device according to the first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a thumbnail image in a captured file. [Diagram 3] FIG. 3 is a schematic diagram for explaining the location where the photographed file in FIG. 2 was photographed. [Figure 4] FIG. 4 is a flowchart showing an example of a flow of a general capture file generation process in the control device according to the first embodiment. [Diagram 5] FIG. 5 is a flowchart showing an example of a process flow for associating thumbnail images with position information in the control device according to the first embodiment. [Figure 6]FIG. 6 is a flowchart showing an example of a process flow for setting a destination from a thumbnail image in the control device according to the first embodiment. [Figure 7] FIG. 7 is a block diagram showing an example of the configuration of a video recording device having a control device according to the second embodiment. [Figure 8] FIG. 8 is a flowchart showing an example of a process flow for setting a destination from a thumbnail image in the control device according to the second embodiment. [Figure 9] FIG. 9 is a block diagram showing an example of the configuration of a video recording device having a control device according to the third embodiment. [Figure 10] FIG. 10 is a flowchart showing an example of a process flow for setting a destination from a thumbnail image in the control device according to the third embodiment. [Figure 11] FIG. 11 is a block diagram showing an example of the configuration of a video recording device having a control device according to the fourth embodiment. [Figure 12] FIG. 12 is a flowchart showing an example of a process flow for setting a destination from a thumbnail image in the control device according to the fourth embodiment. [Figure 13] FIG. 13 is a block diagram showing an example of the configuration of a video recording device having a control device according to the fifth embodiment. [Figure 14] FIG. 14 is a flowchart showing an example of a process flow for setting a destination from a thumbnail image in the control device according to the fifth embodiment. [Figure 15] FIG. 15 is a flowchart showing an example of a process flow for setting a destination from a thumbnail image in the control device according to the sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, an embodiment of a video recording control device and a video recording method according to the present disclosure will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiment. In the following description, a vehicle will be described as an example of a moving object. The moving object is not limited to a vehicle, and can also be applied to a two-wheeled vehicle or the like.
[0015] [First embodiment] <Video Recording Device> FIG. 1 is a block diagram showing an example of the configuration of a video recording device 10 having a video recording control device (hereinafter referred to as the "control device") 100 according to the first embodiment. The video recording device 10 is a so-called drive recorder that records events that occur in a vehicle. The video recording device 10 records a captured file displayed as a thumbnail image by associating the position information of the thumbnail image with the captured file. In this embodiment, the video recording device 10 may work in conjunction with a navigation system to set the position information associated with the thumbnail image of the captured file as a destination or waypoint for route guidance.
[0016] The video recording device 10 may be a device installed in a vehicle, or may be a portable device that can be used in a vehicle. The video recording device 10 may also be realized by including the functions or configurations of a device that is pre-installed in a vehicle, a navigation system, etc. The video recording device 10 includes a camera 211, a recording unit 212, an operation unit 213, an acceleration sensor 214, a GNSS (Global Navigation Satellite System) receiving unit 215, a display unit 216, and the control device 100.
[0017] The camera 211 is a camera provided in the vehicle. The camera 211 is a camera that captures the surroundings of the vehicle. The camera 211 may be a group of multiple cameras. The camera 211 is arranged, for example, at a position in the front of the vehicle interior where it can capture the view in front of the vehicle. In this embodiment, the camera 211 captures video at all times while the accessory power of the vehicle is ON. The camera 211 outputs the captured image data to the image data acquisition unit 111 of the control device 100. The image data is, for example, a moving image composed of images of 27.5 frames per second.
[0018] The recording unit 212 is used for temporary storage of data in the video recording device 10. The recording unit 212 is, for example, a recording unit such as a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a memory card. Alternatively, the recording unit 212 may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 212 records a shooting file that is continuous recording data or event recording data based on a control signal output from the recording control unit 122 of the control device 100.
[0019] The operation unit 213 can accept various operations on the video recording device 10. The operation unit 213 is, for example, a touch panel provided on the display unit 216. For example, the operation unit 213 can accept an operation to manually save the captured image data in the recording unit 212 as event recording data. For example, the operation unit 213 can accept an operation to display a list of continuous recording data or event recording data on the display unit 216. For example, the operation unit 213 can accept an operation to play the continuous recording data or event recording data recorded in the recording unit 212. For example, the operation unit 213 can accept an operation to erase the event recording data recorded in the recording unit 212. For example, the operation unit 213 can accept an operation to end the continuous recording. The operation unit 213 can accept an operation to select a captured file by touching a list of continuous recording data or event recording data displayed on the display unit 216. The operation unit 213 can accept an operation of selecting an image of any frame of a captured file displayed on the display unit 216 as a thumbnail image of the captured file, for example, by touching the image of the frame. The operation unit 213 outputs operation information to the operation control unit 116 of the control device 100.
[0020] The operation unit 213 can accept an operation to select an image of any frame of a shooting file and set it as a thumbnail image of the shooting file. More specifically, when an event or object that the user wants to pay attention to, refer to later, or set as a destination later is shot, the operation unit 213 can accept an operation to select an image of a frame in which such an event or object is shot and set it as a thumbnail image of the shooting file.
[0021] In this embodiment, the operation unit 213 can accept an operation to set a destination or a stop on route guidance using a thumbnail image of a shooting file in cooperation with a navigation system. More specifically, the operation unit 213 can accept an operation to set the location information associated with a thumbnail image as a destination. For example, the operation unit 213 can accept an operation to further set a shooting file as a destination or a stop on route guidance when the shooting file is selected.
[0022] The list of continuous recorded data or event recorded data is a list of thumbnail images corresponding to the continuous recorded data or event recorded data.
[0023] The acceleration sensor 214 is a sensor that detects acceleration occurring with respect to the vehicle. The acceleration sensor 214 outputs a detection result to the event detection unit 117 of the control device 100. The acceleration sensor 214 is a sensor that detects acceleration in, for example, three axial directions. The three axial directions are the forward / rearward direction, the left / right direction, and the up / down direction of the vehicle.
[0024] The GNSS receiving unit 215 is configured with a GNSS receiver that receives GNSS signals from GNSS satellites, etc. The GNSS receiving unit 215 outputs the received position information signal to the position information acquisition unit 118 of the control device 100.
[0025] The display unit 216 is, for example, a display device specific to the video recording device 10, or a display device shared with other systems including a navigation system. The display unit 216 may be formed integrally with the camera 211. The display unit 216 is, for example, a display including a liquid crystal display or an organic EL (Electro-Luminescence) display. In this embodiment, the display unit 216 is disposed in front of the driver of the vehicle on a dashboard, an instrument panel, a center console, or the like. The display unit 216 displays an image based on a video signal output from the display control unit 119 of the control device 100. The display unit 216 displays an image captured by the camera 211 or an image recorded in the recording unit 212.
[0026] <Video Recording Control Device> The control device 100 is an arithmetic processing device (control device) configured with, for example, a CPU (Central Processing Unit) and the like. The control device 100 loads a stored program into a memory and executes instructions included in the program. The control device 100 includes an internal memory (not shown), which is used for temporary storage of data in the control device 100, and the like. The control device 100 includes an image data acquisition unit 111, a buffer memory 112, an image data processing unit 113, an operation control unit 116, an event detection unit 117, a position information acquisition unit 118, a display control unit 119, a thumbnail image generation unit 120, a playback control unit 121, and a recording control unit 122.
[0027] The image capturing data acquisition unit 111 acquires image capturing data captured by the camera 211 capturing an image of the periphery of the vehicle. The image capturing data acquisition unit 111 outputs the acquired image capturing data to the buffer memory 112.
[0028] The buffer memory 112 is an internal memory included in the control device 100, and is a memory for temporarily recording the image capture data for a certain period of time acquired by the image capture data acquisition unit 111 while updating it.
[0029] The shooting data processing unit 113 generates a shooting file for each predetermined time from the shooting data. The shooting data processing unit 113 converts the shooting data temporarily stored in the buffer memory 112 into an arbitrary file format, such as MP4 format, encoded with an arbitrary codec such as H.264 or MPEG-4 (Moving Picture Experts Group). The shooting data processing unit 113 generates a shooting file for a certain period of time from the shooting data temporarily stored in the buffer memory 112. As a specific example, the shooting data processing unit 113 generates 60 seconds of shooting data in the order of recording as a shooting file from the shooting data temporarily stored in the buffer memory 112. The shooting data processing unit 113 outputs the generated shooting file to the recording control unit 122. In addition, the shooting data processing unit 113 outputs the generated shooting file to the display control unit 119 after decoding the image through the playback control unit 121. The period of the generated shooting file is set to 60 seconds as an example, but is not limited to this. The photographed data referred to here may be data that includes audio in addition to the video captured by the camera 211.
[0030] The operation control unit 116 acquires operation information of an operation accepted by the operation unit 213. For example, the operation control unit 116 acquires playback operation information indicating a playback operation or erase operation information indicating an erase operation, and outputs a control signal. For example, the operation control unit 116 acquires end operation information indicating an operation to end continuous recording, and outputs a control signal.
[0031] The operation control unit 116, for example, acquires operation information indicating an operation of selecting a captured file from a list of continuous recording data or event recording data, and outputs a control signal. For example, when a captured file is selected, the operation control unit 116 may further acquire operation information indicating an operation on the captured file, such as playback or deletion, and output a control signal.
[0032] The operation control unit 116 acquires operation information indicating an operation of selecting an image of any frame of a shooting file, setting it as a thumbnail image of the shooting file, and outputs a control signal. More specifically, when an event or object that the user wants to pay attention to, refer to later, or set as a destination later is shot, the operation control unit 116 acquires operation information indicating an operation of selecting an image of a frame in which such an event or object is shot, and setting it as a thumbnail image of the shooting file, and outputs a control signal.
[0033] In this embodiment, the operation control unit 116 may work in conjunction with a navigation system to acquire operation information indicating an operation of setting a thumbnail image of a shooting file as a destination or a stopover point for route guidance, and output a control signal. More specifically, the operation control unit 116 may, for example, acquire operation information indicating an operation of setting location information associated with a thumbnail image as a destination, and output a control signal. For example, the operation control unit 116 may acquire operation information indicating an operation of further setting a shooting file as a destination or a stopover point in a state where the shooting file is selected, and output a control signal.
[0034] For example, when a thumbnail image of a desired captured file is selected by the operation control unit 116, options showing commands for the selected thumbnail image are displayed on the display unit 216. Examples of commands for the selected thumbnail image are displayed so that they can be selected, such as play, save, delete, change thumbnail image, and set destination (stopover).
[0035] The event detection unit 117 detects an event based on the acceleration applied to the vehicle. More specifically, the event detection unit 117 detects an event based on the detection result of the acceleration sensor 214. The event detection unit 117 detects that an event has occurred when the acceleration information acquired by the event detection unit 117 from the acceleration sensor 214 is equal to or greater than a threshold value.
[0036] The position information acquisition unit 118 acquires position information indicating the current position of the vehicle. The position information acquisition unit 118 calculates the position information of the current position of the vehicle based on the GNSS signal received by the GNSS receiving unit 215 by a known method.
[0037] The display control unit 119 controls the display on the display unit 216. The display control unit 119 outputs a video signal that causes the display unit 216 to output the continuous recording data, the event recording data, or the like. More specifically, the display control unit 119 outputs a video signal that displays the video captured by the camera 211, or the continuous recording data or the event recording data recorded in the recording unit 212 by playing back the video.
[0038] The display control unit 119 outputs a video signal for displaying a list of continuous recording data or event recording data as thumbnail images, a video signal for displaying operation items for the displayed thumbnail images, and the like.
[0039] The thumbnail image generating unit 120 generates thumbnail images from the images that make up the captured file.
[0040] The thumbnail image is usually set to the image of the first frame of the shooting file. For example, if an event or object that the user wants to pay attention to, refer to later, or set as a destination later is shot during the shooting file generation period, the user can select an image of a frame in which such an event or object is shot and set it as the thumbnail image of the shooting file.
[0041] The thumbnail image generating unit 120 assigns a thumbnail image to a shooting file. More specifically, the thumbnail image generating unit 120 normally assigns a thumbnail image starting from the image of the first frame in the video constituting the shooting file. The thumbnail image generating unit 120 assigns an image of a frame selected by the user in the video constituting the shooting file as a thumbnail image of the shooting file.
[0042] The thumbnail image generating unit 120 assigns the location information acquired when a captured file is selected based on a thumbnail image to the captured file in association with the thumbnail image as location information corresponding to the thumbnail image in the captured file.
[0043] The playback control unit 121 performs control so as to play back the continuous recording data or event recording data recorded in the recording unit 212, based on a playback operation control signal output from the operation control unit 116. The playback control unit 121 includes a decoder (not shown), and plays back various types of data by decoding the supplied compressed data.
[0044] The recording control unit 122 records the shooting data acquired by the shooting data acquisition unit 111. In the embodiment, the recording control unit 122 controls the recording unit 212 to record the shooting file filed by the shooting data processing unit 113. During a period in which a continuous recording process is performed, such as when the accessory power of the vehicle is ON, the recording control unit 122 records the shooting file filed by the shooting data processing unit 113 in the recording unit 212 as an overwritable shooting file. More specifically, during a period in which a continuous recording process is performed, the recording control unit 122 continues to record the shooting file generated by the shooting data processing unit 113 in the recording unit 212, and when the capacity of the recording unit 212 becomes full, the recording control unit 122 overwrites the oldest shooting file with a new shooting file.
[0045] When an event is detected by the event detection unit 117, the recording control unit 122 stores event record data, which is shooting data corresponding to the detection of the event. The event record data is a shooting file of a predetermined period in the shooting file generated by the shooting data processing unit 113. The recording control unit 122 stores the shooting file corresponding to the detection of the event in the recording unit 212 as event record data that is prohibited from being overwritten. When an event is detected by the event detection unit 117, the recording control unit 122 copies a shooting file of a predetermined period, for example, about 10 seconds before and after the time the event is detected, from the buffer memory 112 and stores it as event record data.
[0046] The recording control unit 122 associates thumbnail images with the shooting files and event recording data and records them. More specifically, the recording control unit 122 associates thumbnail images generated by the thumbnail image generating unit 120 with the shooting files and event recording data and records them in the recording unit 212. In the following explanation, thumbnail images recorded in association with shooting files are used as an example, but the same applies to thumbnail images recorded in association with event recording data.
[0047] The recording control unit 122 records the captured file in association with the thumbnail image, and also records the location information obtained when the captured file is selected based on the thumbnail image in association with the location information corresponding to the thumbnail image in the captured file.
[0048] When the thumbnail image generation unit 120 generates a thumbnail image based on the image of the first frame in the video that constitutes the shooting file, the recording control unit 122 records the location information obtained when the shooting file is selected as the location information at the time of shooting the image of the first frame of the shooting file.
[0049] When the thumbnail image generating unit 120 generates a thumbnail image based on a frame image other than the first frame image in the video constituting the shooting file, the recording control unit 122 records the location information obtained when the shooting file is selected as the location information of the shooting time of the changed thumbnail image, rather than the shooting time of the first frame image of the shooting file.
[0050] The location information associated with the thumbnail image will be described with reference to FIG. 2 and FIG. 3. FIG. 2 is a diagram showing an example of the relationship between the shooting file and the thumbnail image. FIG. 3 is a schematic diagram showing the location where the shooting file of FIG. 2 was shot. In the example shown in FIG. 2, a vehicle equipped with the video recording device 10 passes through the points A, B, and C in order, and records data continuously. At the point A, the generation of the shooting file F-1 is completed. Then, the generation of the shooting file F is started at the point A, and the generation of the shooting file F is completed at the point C. Furthermore, the generation of the file F+1 is started at the point C. The image Im11 is an image of the first frame of the shooting file F shot at the point A. The image Im12 is an image of the middle frame of the shooting file F shot at the point B. The image Im13 is an image of the first frame of the shooting file F+1 shot at the point C.
[0051] When the thumbnail image of the shooting file F has not been changed, the thumbnail image of the shooting file F is generated based on the image Im11 which is the first frame image of the shooting file F. In this case, the location information associated with the shooting file F is the location information indicating the point A which is the location information at the time when the image Im11 was shot.
[0052] For example, when the thumbnail image of the shooting file F is changed to a frame image Im12 of a structure Ob1 captured at point B by a user operation or audio information at the time of shooting, the thumbnail image of the shooting file F is generated based on the image Im12. In this case, the location information associated with the shooting file F is location information indicating point B, which is the location information at the time of shooting the image Im12.
[0053] <Information processing in video recording control device> Next, the flow of processing in the control device 100 will be described with reference to Fig. 4 to Fig. 6. Fig. 4 is a flowchart showing an example of a general capture file generation processing flow in the control device 100 according to the first embodiment. Fig. 5 is a flowchart showing an example of a processing flow for associating thumbnail images with position information in the control device 100 according to the first embodiment. Fig. 6 is a flowchart showing an example of a processing flow for setting a destination from a thumbnail image in the control device 100 according to the first embodiment.
[0054] A typical process for generating a captured file will be described with reference to Fig. 4. While the video recording device 10 is in operation, the process shown in the flowchart of Fig. 4 is executed.
[0055] 4 is being executed, in other words, while the video recording device 10 is operating, the control device 100 starts detecting acceleration using the acceleration sensor 214 at a set acceleration threshold. The control device 100 starts event detection based on the detected acceleration using the event detection unit 117. A description of event detection based on acceleration detection will be omitted here.
[0056] The control device 100 starts generating a shooting file (step S101). More specifically, the control device 100 generates a shooting file for each predetermined time, for example, every 60 seconds, from the shooting data by the shooting data processing unit 113. The control device 100 proceeds to step S102.
[0057] The control device 100 assigns the image of the first frame of each shooting file as a thumbnail image for each generated shooting file (step S102). More specifically, the control device 100 assigns the image of the first frame of the shooting file as a thumbnail image of the shooting file by the thumbnail image generating unit 120. The control device 100 proceeds to step S103.
[0058] The control device 100 assigns the position information of the first frame image of each shooting file at the time of shooting as the position information of the shooting file (step S103). More specifically, the control device 100 assigns the position information of the first frame image of each shooting file at the time of shooting in association with the thumbnail image in the shooting file by the thumbnail image generating unit 120. The control device 100 proceeds to step S104.
[0059] The control device 100 records the captured file (step S104). More specifically, the control device 100 records the captured file and the thumbnail image in association with each other by the recording control unit 122, and records location information at the time of capturing the thumbnail image in association with the captured file as location information to be acquired when the captured file is selected based on the thumbnail image in the recording unit 212. The control device 100 proceeds to step S105.
[0060] The control device 100 determines whether or not to end the process (step S105). For example, the control device 100 determines to end the process when the power or motive power of the vehicle is turned off or the operation unit 213 is operated. If the control device 100 determines to end the process (Yes in step S105), it ends this process. If the control device 100 does not determine to end the process (No in step S105), it executes the process of step S101 again.
[0061] In this way, when generating shooting files every 60 seconds from shooting data, the control device 100 records the first image of each shooting file as a thumbnail image for each shooting file. Also, for each shooting file, the control device 100 records the location information of the time when the first image of each shooting file was shot as the location information of each shooting file.
[0062] Next, the thumbnail image change process will be described with reference to Fig. 5. The thumbnail image change process is executed when the user wants to change the thumbnail image. In the following description, as an example, a case where a destination or a waypoint is set from a list of continuous recording data will be described. The same process is executed when a destination or a waypoint is set from a list of event recording data.
[0063] The control device 100 judges whether or not a captured file whose thumbnail image is to be changed has been selected (step S111). More specifically, the control device 100 judges whether or not the operation control unit 116 has accepted an operation to select a captured file whose thumbnail image is to be changed by touching a list of captured files, which are constantly recorded data, displayed on the display unit 216. If the control device 100 judges that a captured file whose thumbnail image is to be changed has been selected (Yes in step S111), the control device 100 proceeds to step S112. If the control device 100 does not judge that a captured file whose thumbnail image is to be changed has been selected (No in step S111), the process ends.
[0064] When it is determined that a captured file for which a thumbnail image is to be changed has been selected (Yes in step S111), the control device 100 determines whether or not to change the thumbnail image (step S112). More specifically, the control device 100 determines whether or not an operation to select an image of any frame of the captured file displayed on the display unit 216 as a thumbnail image of the captured file has been accepted by the operation control unit 116. When an operation to select the image as a thumbnail image has been accepted by the operation control unit 116, the control device 100 determines that the thumbnail image is to be changed. When it is determined that the thumbnail image is to be changed (Yes in step S112), the control device 100 proceeds to step S113. When it is determined that the thumbnail image is not to be changed (No in step S112), the control device 100 ends the process.
[0065] When it is determined that the thumbnail image is to be changed (Yes in step S112), the control device 100 changes the location information of the shooting file to the location information at the time when the thumbnail image was shot (step S113). More specifically, the control device 100 generates an image of a frame selected by the user in the video constituting the shooting file as a thumbnail image of the shooting file by the thumbnail image generating unit 120. The control device 100 assigns the location information acquired when the shooting file is selected based on the thumbnail image by the thumbnail image generating unit 120 in association with the location information indicating the shooting time of the changed thumbnail image. The control device 100 records the location information acquired when the shooting file is selected in the recording unit 212 by the recording control unit 122 as the location information at the shooting time of the changed thumbnail image, not the shooting time of the image of the first frame of the shooting file.
[0066] In this way, the control device 100 changes the thumbnail image of the captured file and records the changed thumbnail image in association with location information indicating the time of capture as the location information to be acquired when the captured file is selected based on the thumbnail image.
[0067] Next, a process for setting a vehicle's destination from a thumbnail image in conjunction with a navigation system will be described with reference to Fig. 6. In the following description, as an example, a case where a destination or a waypoint is set from a list of continuous recording data will be described. The same process is also performed when a destination or a waypoint is set from a list of event recording data.
[0068] The control device 100 displays a list of the captured files, which are the continuous recording data (step S121). More specifically, the control device 100 outputs a video signal that displays the list of the continuous recording data as thumbnail images, by the display control unit 119. The control device 100 proceeds to step S122.
[0069] The control device 100 determines whether or not a thumbnail image has been selected (step S122). More specifically, the control device 100 determines whether or not an operation to select a thumbnail image from the list, in other words, an operation to select a captured file, has been accepted by the operation control unit 116. The control device 100 determines whether or not an operation to set a captured file as a destination or a stopover has been accepted by the operation control unit 116 after the captured file has been selected. If the control device 100 determines that a thumbnail image has been selected (Yes in step S122), it proceeds to step S123. If the control device 100 does not determine that a thumbnail image has been selected (No in step S122), it ends this process.
[0070] When it is determined that a thumbnail image has been selected (Yes in step S122), the control device 100 sets the location information of the selected photographic file as a destination or a stopover point (step S123). More specifically, the control device 100 acquires the location information of the selected photographic file. Then, the control device 100 transmits a control signal to the navigation system to set the location information of the selected photographic file as a destination or a stopover point.
[0071] By such processing, for example, when a thumbnail image of a shooting file F is generated based on an image Im11, the location information to be set as a destination by selecting the thumbnail image is set to point A. For example, when a thumbnail image of a shooting file F is generated based on an image Im12, the location information to be set as a destination by selecting the thumbnail image is set to point B, not point A.
[0072] <Effects> As described above, in this embodiment, the shooting file and the thumbnail image are recorded in association with each other, and the location information acquired when the shooting file is selected based on the thumbnail image is recorded in association with the location information corresponding to the thumbnail image in the shooting file. In this way, according to this embodiment, the location information can be appropriately associated with the shooting file displayed by the thumbnail image.
[0073] In this embodiment, when a thumbnail is generated based on an image other than the first frame image constituting the shooting file, the location information acquired when the shooting file is selected is recorded as the location information at the time when the thumbnail image was shot. According to this embodiment, when a user selects a shooting file by thumbnail image from a list, the selected thumbnail image and the location information of the shooting file can be matched. According to this embodiment, even if the selected shooting file is, for example, an image taken while the vehicle is traveling, the display on the map and the destination setting can be set to the intended location.
[0074] In this embodiment, when setting a destination or a stopover point by selecting a captured file from a list of thumbnail images, a location close to an object or the like displayed as a thumbnail image can be set as the destination or stopover point.
[0075] [Second embodiment] The video recording device 10A according to the present embodiment will be described with reference to FIG. 7 and FIG. 8. FIG. 7 is a block diagram showing an example of the configuration of the video recording device 10A having the control device 100A according to the second embodiment. FIG. 8 is a flow chart showing an example of the process flow of setting a destination from a thumbnail image in the control device 100A according to the second embodiment. The basic configuration of the video recording device 10A is the same as that of the video recording device 10 of the first embodiment. In the following description, the same or corresponding reference symbols are used for the same components as those of the video recording device 10, and detailed description thereof will be omitted. The video recording device 10A sets an image in which highlights are extracted from images constituting a shooting file as a thumbnail image. The video recording device 10A records position information at the time when the thumbnail image was shot as position information to be associated with the thumbnail image. In this embodiment, the difference from the first embodiment is that the highlight extraction unit 124A is provided and the processing in the thumbnail image generation unit 120A and the recording control unit 122A is different.
[0076] The highlight extraction unit 124A extracts highlights from the photographed data. The highlight extraction unit 124A performs image processing on the image of the constantly recorded data to detect objects that may become highlights in the photographed data, such as prominent buildings and natural objects (hereinafter referred to as "highlight extraction objects"). The highlight extraction unit 124A may refer to map information via a map information reference unit (not shown) and extract the photographed object as a highlight based on a POI (Point of Interest) in the map information, for example, if the photographed object is a tourist attraction or a famous building or natural object.
[0077] The thumbnail image generating unit 120A generates a thumbnail image from an image of highlights extracted by the highlight extracting unit 124A from an image constituting a shooting file (hereinafter referred to as a "highlight extracted image"). More specifically, the thumbnail image generating unit 120A assigns an image of a frame from which the highlight extracting unit 124A has extracted a highlight from an image of a frame constituting a shooting file as a thumbnail image of the shooting file.
[0078] The recording control unit 122A records the location information acquired when the shooting file is selected as the location information at the time when the highlight extraction image was shot. More specifically, the recording control unit 122A records the location information acquired when the shooting file is selected as the location information at the time when the thumbnail image generated from the highlight extraction image extracted by the highlight extraction unit 124A in the shooting file was shot.
[0079] Next, the flow of processing in the control device 100A will be described with reference to Fig. 8. The processing in step S131, and steps S135 to S138 shown in Fig. 8 is similar to the processing in step S101, and steps S102 to S105 in the flowchart shown in Fig. 4.
[0080] The control device 100A determines whether or not a highlight has been extracted (step S132). More specifically, the control device 100A performs image processing on the image of the continuous recording data by the highlight extraction unit 124A, and determines whether or not an object that becomes a highlight, such as a conspicuous building or natural object, has been detected. If the control device 100A determines that a highlight has been extracted (Yes in step S132), the control device 100A proceeds to step S133. If the control device 100A does not determine that a highlight has been extracted (No in step S132), the control device 100A proceeds to step S135.
[0081] When it is determined that a highlight has been extracted (Yes in step S132), the control device 100A assigns the highlight extraction image as a thumbnail image (step S133). More specifically, the control device 100A assigns the highlight extraction image of the captured file as a thumbnail image by the thumbnail image generating unit 120A. The control device 100A proceeds to step S134.
[0082] The control device 100A assigns the location information at the time of shooting of the highlight extraction image as the location information of the shooting file (step S134). More specifically, the control device 100A assigns the location information at the time of shooting of the highlight extraction image of the shooting file by the thumbnail image generating unit 120A in association with the thumbnail image in the shooting file as the location information corresponding to the thumbnail image in the shooting file. The control device 100A proceeds to step S137.
[0083] To explain the second embodiment using the example shown in FIG. 2 and FIG. 3, the highlight extraction unit 124A extracts a structure Ob1 as a highlight from a shooting file F. In the shooting file F, the frame image from which the structure Ob1 is extracted is shot at point B. In other words, the structure Ob1 is extracted as a highlight from the frame image shot at point B. For this reason, the thumbnail image generation unit 120A generates a thumbnail image of the shooting file F based on the image Im12 from which the highlight is shot. In this case, the location information associated with the shooting file F is the location information of point B, which is the location information at the time of shooting the image Im12 from which the structure Ob1 is extracted.
[0084] In this embodiment, when setting a destination or a stopover point by selecting a shooting file from a list of thumbnail images, a location close to an object or the like extracted as a highlight displayed in the thumbnail image can be set as the destination or stopover point.
[0085] <Effects> As described above, in this embodiment, a thumbnail image is generated from a highlight image extracted from a shooting file. In this embodiment, the location information acquired when a shooting file is selected is recorded as location information at the time when the thumbnail image, which is a highlight extraction image, was shot. According to this embodiment, when a user selects a shooting file from a list with a thumbnail image, which is a highlight extraction image, it is possible to match the location information of the selected thumbnail image with that of the shooting file.
[0086] [Third embodiment] With reference to FIG. 9 and FIG. 10, the video recording device 10B according to this embodiment will be described. FIG. 9 is a block diagram showing an example of the configuration of a video recording device having a control device according to a third embodiment. FIG. 10 is a flowchart showing an example of the process flow of setting a destination from a thumbnail image in the control device 100B according to the third embodiment. The basic configuration of the video recording device 10B is the same as that of the video recording device 10A of the second embodiment. The video recording device 10B records the position information corresponding to the extracted highlight as the position information to be associated with the thumbnail image. This embodiment is different from the second embodiment in that it includes a map information storage unit 217B and a map information reference unit 125B, and in the process in the recording control unit 122B. In this embodiment, the GNSS receiving unit 215 and the position information acquisition unit 118 are not essential components.
[0087] The map information storage unit 217B stores map information including information on roads such as intersections. More specifically, the map information storage unit 217B stores map information including location information corresponding to highlights. The map information storage unit 217B may be a storage device such as an external server that acquires map information via a communication function.
[0088] The map information reference unit 125B acquires, from the map information storage unit 217B, location information corresponding to the highlight from which the thumbnail image has been generated, by referring to the map information.
[0089] The recording control unit 122B records the captured file and the thumbnail image in association with each other, and records the location information acquired when the captured file is selected based on the thumbnail image as location information corresponding to the highlight in the captured file.
[0090] Next, the flow of processing in the control device 100B will be described with reference to Fig. 10. The processing in steps S141 to S143 and steps S145 to S148 shown in Fig. 10 is similar to the processing in steps S131 to S133 and steps S135 to S138 in the flowchart shown in Fig. 8.
[0091] The control device 100B assigns the position information of the highlight extraction object as the position information of the shooting file (step S144). More specifically, the control device 100B assigns the position information of the highlight extracted from the shooting file by the thumbnail image generating unit 120B in association with the position information corresponding to the thumbnail image in the shooting file. The control device 100B proceeds to step S147.
[0092] To explain the third embodiment using the example shown in Fig. 2 and Fig. 3, the highlight extraction unit 124B extracts a structure Ob1 as a highlight from a shooting file F. In the shooting file F, the frame image from which the structure Ob1 is extracted is shot at point B. Therefore, the thumbnail image generation unit 120B generates a thumbnail image of the shooting file F based on the image Im12 in which the highlight is shot. In this case, the location information associated with the shooting file F is the location information of the structure Ob1 referenced by the map information reference unit 125B.
[0093] The highlight extraction subject is an object extracted by the highlight extraction unit 124B that can become a highlight in the shooting data, such as a conspicuous building or natural object.
[0094] <Effects> As described above, in this embodiment, a shooting file and a thumbnail image are recorded in association with each other, and location information acquired when a shooting file is selected based on a thumbnail image is recorded as location information corresponding to a highlight in the shooting file. According to this embodiment, when a user selects a shooting file from a list with a thumbnail image that is a highlight extraction image, the location information of the selected thumbnail image and the shooting file can be matched.
[0095] In this embodiment, when setting a destination or a stopover point by selecting a shooting file from a list of thumbnail images, the position of an object or the like extracted as a highlight displayed as a thumbnail image can be set as the destination or stopover point.
[0096] [Fourth embodiment] The location information acquisition device 30 according to this embodiment will be described with reference to Figs. 11 and 12. Fig. 11 is a block diagram showing an example of the configuration of the location information acquisition device 30 having a location information acquisition control device (hereinafter referred to as a "control device") 400 according to the fourth embodiment. Fig. 12 is a flowchart showing an example of a process flow for setting a destination from a thumbnail image in the control device 400 according to the fourth embodiment. The location information acquisition device 30 acquires location information from a thumbnail image associated with a shooting file taken in an external system. In this embodiment, the location information acquisition device 30 acquires location information from a thumbnail image associated with a shooting file taken by, for example, a so-called drive recorder. The location information acquisition device 30 may be implemented as a part of the functions of a navigation system.
[0097] In this embodiment, the shooting file acquired from the external system is associated with location information as well as a thumbnail image. In this embodiment, the shooting file is, for example, one recorded by the video recording device of the first to third embodiments.
[0098] The location information acquisition device 30 may be a device installed in a vehicle, or may be a portable device that can be used in a vehicle. The location information acquisition device 30 may be realized by including the functions or configurations of a device pre-installed in a vehicle or a navigation system. The location information acquisition device 30 has an interface unit (hereinafter referred to as "I / F") 311, an operation unit 312, a display unit 313, and a control device 400.
[0099] The I / F 311 is an interface for acquiring the shooting file and the vehicle position information associated with the shooting file from an external system. In this embodiment, the I / F 311 is an interface for acquiring the shooting file and the vehicle position information associated with the shooting file from a so-called drive recorder. The I / F 311 is, for example, a CAN (Controller Area Network) or the like.
[0100] The operation unit 312 can accept various operations on the position information acquisition device 30. The operation unit 312 is, for example, a touch panel provided on the display unit 313. The operation unit 312 can accept an operation to select a captured file by, for example, touching a list of event record data or the like displayed on the display unit 313. The operation unit 312 can accept an operation to select an image of any frame of a captured file displayed on the display unit 313 as a thumbnail image of the captured file by, for example, touching the image of the frame of the captured file. The operation unit 312 outputs operation information to an operation control unit 413 of the control device 400.
[0101] In this embodiment, the operation unit 312 can accept an operation to set a thumbnail image of a shooting file as a destination or a stopover point for route guidance in cooperation with a navigation system. More specifically, the operation unit 312 can accept an operation to set location information associated with a thumbnail image as a destination, for example. The operation unit 312 can accept an operation to further set a shooting file as a destination or a stopover point, for example, when the shooting file is selected.
[0102] The display unit 313 is, for example, a display device specific to the position information acquisition device 30, or a display device shared with other systems including a navigation system. The display unit 313 is, for example, a display including a liquid crystal display or an organic EL display. The display unit 313 displays an image based on a video signal output from the display control unit 412 of the control device 400. The display unit 313 displays an image captured by a camera or an image recorded in the recording unit 212.
[0103] <Location information acquisition and control device> The control device 400 is, for example, an arithmetic processing device (control device) configured with a CPU and the like. The control device 400 loads a stored program into a memory and executes instructions included in the program. The control device 400 includes an internal memory (not shown) that is used for temporary storage of data in the control device 400. The control device 400 includes a captured file acquisition unit 411, a display control unit 412, an operation control unit 413, and a position information acquisition unit 414.
[0104] The image file acquisition unit 411 acquires an image file based on image data captured by a camera (not shown) provided in the vehicle and vehicle position information associated with the image file. In this embodiment, the image file acquisition unit 411 acquires an image file based on image data captured by a camera of a so-called drive recorder and vehicle position information associated with the image file.
[0105] The display control unit 412 controls the display of the captured files on the display unit 313. The display control unit 412 outputs a video signal that displays a list of captured files such as continuous recording data or event recording data as thumbnail images.
[0106] The operation control unit 413 acquires operation information of the operation accepted by the operation unit 312. The operation control unit 413 selects the captured file acquired by the captured file acquisition unit 411 based on the thumbnail image associated with the captured file. For example, the operation control unit 413 acquires operation information indicating an operation of selecting a captured file from a list, and outputs a control signal.
[0107] In this embodiment, the operation control unit 413 may work in conjunction with a navigation system to obtain operation information indicating an operation of setting a thumbnail image of a shooting file as a destination or a stopover point for route guidance, and output a control signal. More specifically, the operation control unit 413 may obtain operation information indicating an operation of setting location information associated with a thumbnail image as a destination, for example, and output a control signal. For example, the operation control unit 413 may obtain operation information indicating an operation of further setting a shooting file as a destination or a stopover point in a state where the shooting file is selected, and output a control signal.
[0108] The location information acquisition unit 414 acquires location information corresponding to the captured file. More specifically, the location information acquisition unit 414 acquires location information corresponding to the selected captured file as location information corresponding to the thumbnail image.
[0109] In this embodiment, when a thumbnail image is generated based on the image of the first frame of a video constituting a shooting file, the location information acquisition unit 414 acquires location information corresponding to the shooting file as the location information at the time when the first frame of the shooting file was shot.
[0110] In this embodiment, when a thumbnail image is generated based on an image other than the image of the first frame in the video constituting the shooting file, the location information acquisition unit 414 acquires location information corresponding to the shooting file as location information at the time when the thumbnail image was shot, not the time when the first frame of the shooting file was shot.
[0111] <Information processing in a location information acquisition control device> Next, the flow of processing in the control device 400 will be described with reference to Fig. 12. In the following description, as an example, a case where a destination or a waypoint is set from a list of continuous recording data will be described. The same processing is also performed when a destination or a waypoint is set from a list of event recording data.
[0112] The control device 400 acquires a shooting file, which is constantly recorded data (step S201). More specifically, the control device 400 acquires, by the shooting file acquisition unit 411, a shooting file based on shooting data captured by a camera (not shown) provided in the vehicle and vehicle position information associated with the shooting file. The control device 400 proceeds to step S202.
[0113] The control device 400 displays a list of the captured files, which are the constantly recorded data (step S202). More specifically, the control device 400 displays a list of the captured files, which are the constantly recorded data, on the display unit 313 by the display control unit 412. The control device 400 proceeds to step S203.
[0114] The control device 400 determines whether or not a thumbnail image has been selected (step S203). More specifically, the control device 400 determines whether or not an operation to select a thumbnail image from the list, in other words, an operation to select a captured file, has been accepted by the operation control unit 413. The control device 400 determines whether or not an operation to set a captured file as a destination or a stopover has been accepted by the operation control unit 413 after the captured file has been selected. If the control device 400 determines that a thumbnail image has been selected (Yes in step S203), it proceeds to step S204. If the control device 400 does not determine that a thumbnail image has been selected (No in step S203), it ends this process.
[0115] When it is determined that a thumbnail image has been selected (Yes in step S203), the control device 400 acquires the location information at the time when the thumbnail image was captured as the location information of the captured file (step S204). More specifically, the control device 400 acquires the location information corresponding to the selected captured file as the location information corresponding to the thumbnail image by the location information acquisition unit 414. The control device 400 proceeds to step S205.
[0116] The control device 400 sets the location information of the selected shooting file as a destination or a waypoint (step S205). More specifically, the control device 400 transmits a control signal to the navigation system to set the location information of the selected shooting file as a destination or a waypoint.
[0117] Through such processing, for example, a captured file is selected from thumbnail images associated with the captured file captured in an external system. Then, the location information of the selected captured file is set as a destination or a stopover point for route guidance.
[0118] <Effects> As described above, in this embodiment, a shooting file acquired from an external system is selected based on a thumbnail image associated with the shooting file. In this embodiment, location information corresponding to the selected shooting file is acquired as location information corresponding to the thumbnail image. In this manner, according to this embodiment, the location information of the shooting file displayed by the thumbnail image can be appropriately associated. In this embodiment, the location information of the shooting file displayed by the thumbnail image can be appropriately acquired.
[0119] In this embodiment, when a thumbnail is generated based on an image other than the first frame image constituting the shooting file, the location information corresponding to the shooting file is acquired as the location information at the time when the thumbnail image was shot. According to this embodiment, when a user selects a shooting file by a thumbnail image from a list, the location information of the selected thumbnail image and the shooting file can be acquired in a consistent manner. According to this embodiment, even if the selected shooting file is, for example, an image taken while the vehicle is traveling, the display on the map and the destination setting can be set to the intended location.
[0120] In this embodiment, when setting a destination or a stopover point by selecting a captured file from a list of thumbnail images, a location close to an object or the like displayed as a thumbnail image can be set as the destination or stopover point.
[0121] [Fifth embodiment] The position information acquisition device 30A according to this embodiment will be described with reference to FIG. 13 and FIG. 14. FIG. 13 is a block diagram showing an example of the configuration of a position information acquisition device having a control device according to the fifth embodiment. FIG. 14 is a flowchart showing an example of the process flow of setting a destination from a thumbnail image in the control device 400A according to the fifth embodiment. The basic configuration of the position information acquisition device 30A is similar to that of the position information acquisition device 30 of the fourth embodiment. The position information acquisition device 30A records vehicle position information that is close to the position in the map information of an object recognized from a thumbnail image as position information to be associated with the thumbnail image. This embodiment is different from the fourth embodiment in that it includes a map information storage unit 314A, a recognition processing unit 415A, and a map information reference unit 416A, and in the process in the position information acquisition unit 414A.
[0122] The map information storage unit 314A stores map information. The map information storage unit 314A stores map information including, for example, road information such as intersections. More specifically, the map information storage unit 314A stores map information including, for example, position information corresponding to objects such as prominent buildings and natural objects. The map information storage unit 314A may be a storage device such as an external server that acquires map information via a communication function.
[0123] The recognition processing unit 415A recognizes objects captured in the thumbnail images. More specifically, the recognition processing unit 415A performs image processing on the thumbnail images to detect objects such as prominent buildings and natural objects.
[0124] The map information reference unit 416A refers to the map information stored in the map information storage unit 314A. More specifically, the map information reference unit 416A refers to the map information stored in the map information storage unit 314A for the object recognized from the thumbnail image by the recognition processing unit 415A.
[0125] The location information acquisition unit 414A acquires location information corresponding to the selected shooting file as vehicle location information that is close to the location of the object recognized from the thumbnail image in the map information. Close to the location of the object in the map information means, for example, that the difference in location is no more than several meters to several tens of meters. For example, it means the difference between the location of a building and a point on the road in front of the building.
[0126] Next, the flow of processing in the control device 400A will be described with reference to Fig. 14. Processing in steps S211 to S213 and step S218 shown in Fig. 14 is similar to processing in steps S201 to S203 and step S205 in the flowchart shown in Fig. 12.
[0127] The control device 400A determines whether or not an object has been detected (step S214). More specifically, the control device 400A recognizes the object captured in the thumbnail image by the recognition processing unit 415. If the control device 400A determines that an object has been detected (Yes in step S214), the control device 400A proceeds to step S215. If the control device 400A does not determine that an object has been detected (No in step S214), the control device 400A proceeds to step S217.
[0128] When it is determined that an object has been detected (Yes in step S214), the control device 400A acquires position information of the detected object (step S215). More specifically, the control device 400A acquires map information of the object recognized from the thumbnail image by the position information acquisition unit 414A. The control device 400 proceeds to step S216.
[0129] The control device 400A acquires the vehicle position information close to the position information of the detected object as the position information of the shooting file (step S216). More specifically, the control device 400A acquires the position information corresponding to the selected shooting file as the vehicle position information close to the position of the object recognized from the thumbnail image in the map information by the position information acquisition unit 414A. The control device 400A proceeds to step S218.
[0130] When it is not determined that an object has been detected (No in step S214), the control device 400A acquires the position information associated with the shooting file (step S217). The control device 400A proceeds to step S218.
[0131] <Effects> As described above, in this embodiment, the location information corresponding to the selected shooting file is acquired as vehicle location information that is close to the location in the map information of the object recognized from the thumbnail image. According to this embodiment, the location information of the shooting file displayed in the thumbnail image can be appropriately associated. This embodiment can appropriately acquire the location information of the shooting file displayed in the thumbnail image.
[0132] In this embodiment, when setting a destination or a stopover point by selecting a captured file from a list of thumbnail images, a location close to an object or the like detected from the thumbnail image can be set as the destination or stopover point.
[0133] [Sixth embodiment] With reference to FIG. 15, the location information acquisition device 30A according to this embodiment will be described. FIG. 15 is a flowchart showing an example of a process flow for setting a destination from a thumbnail image in a control device 400A according to a sixth embodiment. The location information acquisition device 30A has a basic configuration similar to that of the location information acquisition device 30A of the fifth embodiment. The location information acquisition device 30A records location information of an object recognized from a thumbnail image as location information to be associated with the thumbnail image. In this embodiment, the processes in the shooting file acquisition unit 411A, the operation control unit 413A, the location information acquisition unit 414A, the recognition processing unit 415A, and the map information reference unit are different from those in the first embodiment.
[0134] The captured image file acquisition unit 411A acquires a captured image file based on captured image data captured by a camera provided in a vehicle.
[0135] The operation control unit 413A selects the captured file acquired by the captured file acquisition unit based on the thumbnail image associated with the captured file.
[0136] The recognition processing unit 415A recognizes the object photographed in the thumbnail image.
[0137] The location information acquisition section 414A acquires location information corresponding to the selected captured file as location information in the map information of the object recognized from the thumbnail image.
[0138] Next, the flow of processing in the control device 400A will be described with reference to Fig. 15. The processing in steps S221 to S225 and steps S227 to S228 shown in Fig. 15 is similar to the processing in steps S211 to S215 and steps S217 to S218 in the flowchart shown in Fig. 14.
[0139] The control device 400A acquires the position information of the detected object as the position information of the shooting file (step S226). More specifically, the control device 400A acquires the position information corresponding to the selected shooting file as the position information of the object recognized from the thumbnail image in the map information by the position information acquisition unit 414A. The control device 400A proceeds to step S228.
[0140] <Effects> As described above, in this embodiment, the location information corresponding to the selected shooting file is acquired as the location information in the map information of the object recognized from the thumbnail image. According to this embodiment, the location information of the shooting file displayed in the thumbnail image can be appropriately associated. In this embodiment, the location information of the shooting file displayed in the thumbnail image can be appropriately acquired.
[0141] In this embodiment, when a captured file is selected from a list of thumbnail images and set as a destination or a stopover, the position of an object or the like detected from the thumbnail image can be set as the destination or stopover.
[0142] The video recording device and the position information acquisition device according to the present disclosure may be embodied in various different forms other than the above-described embodiment.
[0143] Each component of the illustrated video recording device and location information acquisition device is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.
[0144] The configuration of the video recording device and the location information acquisition device is realized, for example, as software, by a program loaded into a memory. In the above embodiment, these have been described as functional blocks realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms by hardware alone, software alone, or a combination of both.
[0145] The above-mentioned components include those that a person skilled in the art can easily imagine and those that are substantially the same. Furthermore, the above-mentioned configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the scope of the present invention. [Explanation of symbols]
[0146] 10 Video recording device 100 Control device (video recording control device) 111 Shooting data acquisition section 112 Buffer Memory 113 Shooting data processing section 116 Operation control section 117 Event detection unit 118 Location information acquisition unit 119 Display control section 121 Playback control section 122 Recording control section 120 Thumbnail image generator 211 Camera 212 Recording Department 213 Operation section 214 Acceleration Sensor 215 GNSS receiver 216 Display section 30 Location information acquisition device 311 Interface Section 312 Operation section 313 Display section 400 Control device (location information acquisition control device) 411 Shooting File Acquisition Department 412 Display control unit 413 Operation control section 414 Location Information Acquisition Department
Claims
1. an image data acquisition unit that acquires image data captured by a camera provided on the moving object; a location information acquisition unit that acquires location information indicating the location of the moving object; an imaging data processing unit that generates imaging files for each predetermined time from the imaging data; a thumbnail image generating unit that generates thumbnail images from the images that make up the captured file; a recording control unit that records the captured file and the thumbnail image in association with each other, and that records location information acquired when the captured file is selected based on the thumbnail image in association with the thumbnail image as location information in the captured file corresponding to the thumbnail image; A video recording control device comprising:
2. When the thumbnail image generating unit generates the thumbnail image based on an image other than the first frame image constituting the shooting file, the recording control unit records the location information acquired when the shooting file is selected as the location information at the time when the thumbnail image was captured, rather than the location information at the time when the first frame of the shooting file was captured. The video recording control device according to claim 1 .
3. further comprising a highlight extraction unit that extracts highlights from the photographic data, the thumbnail image generating unit generates a thumbnail image from a highlight image extracted by the highlight extracting unit from the image constituting the captured file; the recording control unit records the location information acquired when the captured file is selected as location information at the time when the thumbnail image generated from the highlight image extracted by the highlight extraction unit in the captured file was captured. The video recording control device according to claim 1 .
4. an image data acquisition unit that acquires image data captured by a camera provided on the moving object; an imaging data processing unit that generates imaging files for each predetermined time from the imaging data; a highlight extraction unit that extracts highlights from the photographic data; a thumbnail image generating unit that generates a thumbnail image from the highlight image extracted by the highlight extracting unit from the image that constitutes the captured file; a map information reference unit that references map information to acquire location information corresponding to the highlight from which the thumbnail image is generated; a recording control unit that records the captured file and the thumbnail image in association with each other, and records location information acquired when the captured file is selected based on the thumbnail image as location information corresponding to the highlight in the captured file; A video recording control device comprising:
5. A photographing file acquisition unit that acquires a photographing file based on photographing data taken by a camera provided on a moving body and location information of the moving body associated with the photographing file; an operation control unit that selects the captured file acquired by the captured file acquisition unit based on a thumbnail image associated with the captured file; a location information acquisition unit that acquires location information corresponding to the selected photographed file as location information corresponding to the thumbnail image; A location information acquisition control device comprising:
6. When the thumbnail image is generated based on an image other than the first frame image in the video constituting the shooting file, the location information acquisition unit acquires the location information as the time when the thumbnail image was captured, rather than the time when the first frame of the shooting file was captured. The position information acquisition control device according to claim 5 .
7. A recognition processing unit that recognizes an object photographed in the thumbnail image; a map information reference unit that references map information, the location information acquisition unit acquires location information corresponding to the selected photographed file as location information of the moving body that approximates a position in the map information of the object recognized from the thumbnail image; The position information acquisition control device according to claim 5 .
8. A photographed file acquisition unit that acquires a photographed file based on photographed data taken by a camera provided on a moving object; an operation control unit that selects the captured file acquired by the captured file acquisition unit based on a thumbnail image associated with the captured file; a recognition processing unit that recognizes an object captured in the thumbnail image; a map information reference unit that references map information; a location information acquiring unit that acquires location information corresponding to the selected photograph file as location information in the map information of an object recognized from the thumbnail image; A location information acquisition control device comprising: