Travel moving image combination device

Abstract

To provide a travel moving image combination device capable of displaying, as one moving image, travel moving images of a plurality of vehicles which separately travels in the same section, so as to allow comparison among the travel moving images.SOLUTION: A travel moving image combination device comprises: a start position adjustment unit for aligning reference start positions in a section regarding a plurality of travel moving images imaged with a plurality of vehicles traveling in the same section; a travel speed adjustment unit for aligning travel speeds of the plurality of vehicles by adjusting feeding speed regarding the plurality of travel moving images; and a moving image combination unit for combining the plurality of travel moving images of which the start positions and the travel speeds are aligned.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to a driving video composition device. [Background technology]

[0002] Patent Document 1 discloses a technique for displaying a plurality of images superimposed on each other so that the images move according to a motion vector of the original image data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2002-150483 A Summary of the Invention [Problem to be solved by the invention]

[0004] The technology disclosed in Patent Document 1 simply displays multiple images by superimposing them on one another, making it difficult to display, for example, videos of multiple vehicles traveling separately along the same section as a single video for comparison.

[0005] The present disclosure has been made in consideration of the above, and aims to provide a driving video synthesis device that can display and compare driving videos of multiple vehicles that have traveled separately over the same section as a single video. [Means for solving the problem]

[0006] The driving video synthesis device of the present disclosure includes a start position adjustment unit that aligns a reference start position in a section for multiple driving videos each captured of multiple vehicles driving along the same section, a driving speed adjustment unit that aligns the driving speeds of the multiple vehicles by adjusting the feed speed for the multiple driving videos, and a video synthesis unit that synthesizes the multiple driving videos with the aligned start positions and driving speeds. Effect of the Invention

[0007] According to the present disclosure, driving videos of multiple vehicles that have traveled the same section separately can be displayed as a single video for comparison. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing a schematic configuration of a running video synthesis device according to an embodiment. [Diagram 2] FIG. 2 is a diagram for explaining the adjustment process of the start position of the driving video performed by the start position adjustment unit of the driving video composition device according to the embodiment. [Diagram 3] FIG. 3 is a diagram for explaining the adjustment process of the feed speed of the running video performed by the start position adjustment unit of the running video composition device according to the embodiment. [Figure 4] FIG. 4 is a diagram for explaining a color correction process of the running video performed by the video composition unit of the running video composition device according to the embodiment. [Diagram 5] FIG. 5 is a diagram for explaining the blurring process of the driving video performed by the video composition unit of the driving video composition device according to the embodiment. [Figure 6] FIG. 6 is a flowchart showing the flow of the running video composition method executed by the running video composition device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] A driving video synthesizing device according to an embodiment of the present disclosure will be described with reference to the drawings. Note that the components in the following embodiments include those that are easily replaceable by a person skilled in the art, or those that are substantially the same.

[0010] (Driving video synthesizer) A configuration of a driving video composition device according to an embodiment will be described with reference to Fig. 1 to Fig. 5. The driving video composition device according to an embodiment is for composing a plurality of videos (hereinafter referred to as "driving videos") taken of a vehicle while it is moving into one.

[0011] In the driving video synthesis device according to the embodiment, in order to compare the course taken by multiple vehicles that have traveled the same section separately (at different times), for example, the driving videos showing each vehicle are synthesized to create one driving video showing multiple vehicles. Note that, although the present embodiment describes a case in which there are two vehicles (two driving videos before synthesis), synthesis is possible in a similar manner even if there are three or more vehicles.

[0012] The running video synthesizer according to the embodiment is realized by a general-purpose computer such as a workstation or a personal computer. As shown in FIG. 1, the running video synthesizer 1 includes at least a calculation unit 11 and a storage unit 12.

[0013] Specifically, the calculation unit 11 includes a processor such as a CPU (Central Processing Unit), a DSP (Digital Signal Processor), an FPGA (Field-Programmable Gate Array), a GPU (Graphics Processing Unit), etc., and a memory (main storage unit) such as a RAM (Random Access Memory), a ROM (Read Only Memory), etc.

[0014] The calculation unit 11 realizes a function that meets a predetermined purpose by, for example, loading a program stored in the storage unit 12 into a working area of ​​the main storage unit and executing the program, and controlling each component part through the execution of the program. The calculation unit 11 functions as a start position adjustment unit 111, a running speed adjustment unit 112, and a video synthesis unit 113 through the execution of the program stored in the storage unit 12, for example.

[0015] The start position adjustment unit 111 aligns the reference start positions (start positions) in a section for a plurality of driving videos each obtained by capturing a plurality of vehicles driving in the same section.

[0016] The start position adjustment unit 111 acquires a plurality of driving videos that have been shot in advance, for example, from the storage unit 12. These driving videos are images of two different vehicles that are driving the same section of a predetermined course. In addition, in these driving videos, for example, the sections in which each vehicle is captured are trimmed (cut out) in advance. The trimming of the sections in which each vehicle is captured may be performed in advance by another image processing device or the like, or the trimming process may be performed when the start position adjustment unit 111 adjusts the start position.

[0017] Here, for example, when two driving videos are displayed side by side (superimposed) as shown in Fig. 2, the initial positions of the two vehicles (the positions of the vehicles at the start of the driving videos) may be different. This is because the start timings of the driving videos of the two vehicles are different.

[0018] Therefore, the start position adjustment unit 111 sets one of the two vehicles as a reference vehicle (hereinafter referred to as the "reference vehicle").Then, the start position adjustment unit 111 sets the position of the other vehicle (hereinafter referred to as the "other vehicle") that is closest to the initial position of the reference vehicle (closest approaching position) as the start position of the other vehicle.

[0019] In Fig. 2, the initial position of the other vehicle is behind (rearward in the direction of travel) the initial position of the reference vehicle. Therefore, the start position adjustment unit 111 aligns the start positions of the reference vehicle and the other vehicle by cutting (deleting) a portion of the traveling video in which the other vehicle appears that corresponds to the initial position of the other vehicle. By performing such processing, when the two traveling videos are superimposed by the video synthesis unit 113 described below, the reference vehicle and the other vehicle can start from a state where they are superimposed at the start position.

[0020] The traveling speed adjustment unit 112 adjusts (slows down or speeds up) the feed speed (playback speed) of the multiple traveling videos to make the traveling speeds of the multiple vehicles uniform.

[0021] Here, for example, as shown in Fig. 3, the travel speeds of the reference vehicle and the other vehicle may differ between the two travel videos. For example, Fig. 3(b) shows a case where the travel speed of the reference vehicle is faster than the travel speed of the other vehicle. Therefore, the travel speed adjustment unit 112 makes the travel speeds of the reference vehicle and the other vehicle the same by slowing down the feed speed of the travel video of the reference vehicle or speeding up the feed speed of the travel video of the other vehicle.

[0022] That is, the start position adjustment unit 111 adjusts the speed of the running video of the reference vehicle or the other vehicle according to the difference in the slope of the graph (graph showing the relationship between time and position) shown in (b) of the same figure. By performing such processing, when the two running videos are superimposed by the video synthesis unit 113 described later, the reference vehicle and the other vehicle will run at the same speed, making it possible to compare the course taken by both vehicles, for example.

[0023] The video composition unit 113 composes a plurality of running videos with the same start position and running speed as described above. That is, the video composition unit 113 superimposes images of other vehicles at each position on the running video of the reference vehicle, thereby combining the plurality of running videos into one.

[0024] Here, for example, as shown in FIG. 4(a), the body colors of the reference vehicle and the other vehicles may be similar. In this case, the video composition unit 113 performs color correction on the body color of the reference vehicle or the other vehicles as shown in FIG. 4(b), and then composes the multiple running videos. FIG. 4 shows a case where the body color of the other vehicle is changed to a different color. By performing such processing, when the two running videos are superimposed by the video composition unit 113 described below, it becomes easier to distinguish between the reference vehicle and the other vehicle, making it easier to compare the two.

[0025] Furthermore, when synthesizing a plurality of driving videos, the video synthesis unit 113 cuts out rectangular areas of other vehicles as time passes, for example, as shown in (a) of Fig. 5. Then, as shown in (b) of the same figure, the video synthesis unit 113 blurs the boundaries of the cut-out rectangular areas of other vehicles and overlays them on the driving video of the reference vehicle. This makes it possible to synthesize driving videos in a shorter calculation time than, for example, when pixel areas of each vehicle are extracted and synthesized (when semantic segmentation is performed).

[0026] The storage unit 12 stores, for example, a driving video processed by the calculation unit 11, various processing results by the calculation unit 11, and the like, as necessary.

[0027] (Driving video synthesis method) The flow of the driving video composition method executed by the driving video composition device according to the embodiment will be described with reference to Fig. 6. Note that it is preferable that the processes of steps S1 and S2 in the figure are performed in advance at a timing separate from the subsequent processes of steps S3 to S7.

[0028] First, a plurality of vehicles traveling along a predetermined course are photographed by a general photographing device (camera) or the like, and the photographs are stored in the storage unit 12 or the like (step S1). Next, a general image processing device or the like is used to trim the sections in which each vehicle (reference vehicle and other vehicles) is captured in the two traveling videos (step S2).

[0029] Next, the start position adjustment unit 111 aligns the start positions of the reference vehicle and the other vehicles in the two driving videos (step S3). Next, the driving speed adjustment unit 112 aligns the driving speeds of the reference vehicle and the other vehicles in the two driving videos (step S4).

[0030] Next, the video composition unit 113 determines whether the colors of the reference vehicle and the other vehicle are similar in the two driving videos (step S5). If it is determined in step S5 that the colors of the reference vehicle and the other vehicle are similar (Yes in step S5), the video composition unit 113 performs color correction of the body color of the reference vehicle or the other vehicle (step S6).

[0031] Next, the video composition unit 113 cuts out rectangular areas of the other vehicles at each time point, blurs the boundaries, and overlays them on the running video of the reference vehicle (step S7), completing this process. Note that, if it is determined in step S5 that the colors of the reference vehicle and the other vehicles are not similar (No in step S5), the video composition unit 113 skips step S6 and proceeds to step S7.

[0032] According to the driving video composition device according to the embodiment described above, driving videos of a plurality of vehicles separately traveling the same section can be displayed as a single video for comparison.

[0033] Further advantages and modifications may readily occur to those skilled in the art. Thus, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and equivalents thereof. [Explanation of symbols]

[0034] 1. Driving video synthesizer 11 Arithmetic section 111 Start position adjustment section 112 Travel speed adjustment unit 113 Video composition section 12 Storage section

Claims

[Claim 1] a start position adjustment unit that aligns a reference start position in a section for a plurality of running videos each obtained by capturing a plurality of vehicles running in the same section; a travel speed adjustment unit that adjusts a feed speed of the plurality of travel videos to make the travel speeds of the plurality of vehicles uniform; a moving image synthesizing unit that synthesizes the plurality of running moving images having the same start position and the same running speed; A driving video synthesis device comprising:

Images