Moving image generation system

Abstract

To facilitate creation of a road trip movie.SOLUTION: A moving image generation server 20 acquires imaging data during a road trip by a drive recorder 11 mounted in a vehicle 10 and analyzes the video and sound of the imaging data. Then the moving image generation server 20 sets a segmentation range based on an analytic result of the video and sound and automatically generates a moving image obtained by segmenting an image of the segmentation range from the imaging data, as a road trip movie.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a video generation system. [Background technology]

[0002] Patent Document 1 describes a technology that automatically generates a road trip album by automatically recording video and audio inside and outside the vehicle based on the analysis results of the facial expressions and speech of the occupants. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-194950 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional technology, it is necessary to analyze the facial expressions and speech of the occupants in a moving vehicle in real time, which requires the vehicle to be equipped with an analysis system with high processing power. [Means for solving the problem]

[0005] The video creation system that solves the above problem is configured to set a cut-out range based on the analysis results of the shooting data from a drive recorder, and to automatically create a video by cutting out the image of the cut-out range from the shooting data. Effect of the Invention

[0006] The above-described video production system has the effect of facilitating the creation of road trip movies. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a moving image generation system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a sequence diagram showing a procedure for generating moving images in the moving image generation system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of a video generation system will be described in detail with reference to FIGS. <About the configuration of the video generation system> First, the configuration of the moving image production system of this embodiment will be described with reference to Fig. 1. The moving image production system of this embodiment automatically edits moving images captured during a road trip by a drive recorder 11 and provides the edited moving images to a user of a vehicle 10.

[0009] As shown in Fig. 1, a drive recorder 11 is installed in a vehicle 10. The drive recorder 11 includes an in-vehicle camera 12 that captures images inside the vehicle, an exterior camera 13 that captures images outside the vehicle, and a microphone 14 that records sounds inside the vehicle. The vehicle 10 is also installed with a data storage 15 that records images captured by the in-vehicle camera 12 and the exterior camera 13 of the drive recorder 11, and sound data captured by the microphone 14. The data storage 15 may be built into the drive recorder 11, or may be installed outside the drive recorder 11.

[0010] Furthermore, the vehicle 10 is equipped with a human-machine interface (HMI) 16 and a communication module 17. The HMI 16 is an interface that connects the system of the vehicle 10 with the occupants. An example of the HMI 16 is a touch panel display. The communication module 17 is an electronic component for wireless communication with the outside of the vehicle. The drive recorder 11, the data storage 15, the HMI 16, and the communication module 17 are connected to each other via an in-vehicle network 18 so as to be able to communicate with each other.

[0011] The video generation system of this embodiment is configured as a system that automatically generates a road trip movie as a video based on the video captured by the drive recorder 11 of the vehicle 10. The video generation system includes a video generation server 20 that is a server device for video generation. The video generation server 20 includes a processor 21 that performs various processes for video generation, and a storage 22 that stores a program for video generation and various data used for video generation. The video generation server 20 also includes a communication module 23 for performing data communication with the vehicle 10.

[0012] <About generating road trip movies> Next, automatic generation of a road trip movie in this embodiment will be described with reference to Fig. 2. The video generation system of this embodiment creates a road trip movie based on shooting data of a drive recorder 11 during a road trip. The shooting data of the drive recorder 11 includes images shot by an in-vehicle camera 12 and an outside-vehicle camera 13, and sounds collected by a microphone 14. The shooting data also includes information on the shooting position and time of the video obtained from an in-vehicle GPS device.

[0013] When creating a road trip movie, the user of the vehicle 10 inputs video settings on the HMI 16 (S1). The video settings are the specifications of the video to be generated. Items in the video settings include the duration of the video, the name of the song to be used as background music for the video, the title of the video, etc. In addition, the video settings specify the people, time, and locations to be included in the video to be generated. Furthermore, the user inputs the date and time of the road trip in the video settings. Thereafter, when the user of the vehicle 10 performs a transmission instruction operation on the HMI 16 (S2), the information on the video settings input by the user in S1 is transmitted to the video generation server 20 together with the data captured during the road trip stored in the data storage 15 (S3).

[0014] The video generation server 20 performs video analysis and audio analysis of the received shooting data (S4), and sets the video cut-out range based on the analysis results (S5). Next, the video generation server 20 cuts out the video of the cut-out range from the shooting data during the road trip and edits it by connecting it together to generate video data for a road trip movie (S6). After that, the video generation server 20 transmits the generated video data to the vehicle 10 (S7). The vehicle 10 stores the received video data in the data storage 15 (S8).

[0015] <About setting the cutout range> The setting of the cut-out range performed by the video generation server 20 in S5 of FIG. 2 will be described. The video generation server 20 extracts a period during which the occupant of the vehicle 10 is in an elated mood based on the results of the video and audio analysis, and sets the period as the cut-out range. Whether the occupant is in an elated mood is determined by analyzing the facial expression and voice of the occupant. The music being played in the vehicle may be used as a criterion for determining whether the occupant is in an elated mood. Specifically, the video generation server 20 analyzes the volume, tune, or name of the music being played in the vehicle, and uses the analysis results to determine whether the occupant is in an elated mood.

[0016] In addition to the above, the moving image generating server 20 sets the following moving image periods as the cutout range. When the video generation server 20 determines from the video analysis results that the occupant is making a predetermined gesture, it sets the period starting from when the gesture was made as the cut-out range.

[0017] The video generation server 20 sets the time and location specified by the user in the video settings as the video cutout range. Examples of the time include the departure time of a road trip and the arrival time at the destination. The video generation server 20 sets the cutout range based on the shooting location and shooting time information included in the video data.

[0018] The video generation server 20 sets the range in which the person specified in the video setting is included in the video as the cutout range. The video generation server 20 identifies the person in the video by face recognition. The video creation server 20 sets the cutout range so that the duration of the video to be created is the duration set in the video settings. Furthermore, when creating a video, the video creation server 20 inserts a piece of music designated by the user in the video settings as background music.

[0019] <Effects of the embodiment> The operation of the video generation system of this embodiment will be described. In this embodiment, the shooting data of the drive recorder 11 during the road trip is transmitted to the video generating server 20 outside the vehicle. The video generating server 20 sets a cutout range based on the analysis results of the video and audio of the shooting data, and generates a video by cutting out the video of the cutout range from the shooting data as a road trip movie.

[0020] When performing such video and audio analysis for generating a video in real time while the drive recorder 11 is shooting, it is necessary to install an analysis device with high processing power in the vehicle 10. In the case of this embodiment, the video and audio analysis for generating a video is performed by a video generation server 20 outside the vehicle after shooting. Even if the vehicle 10 does not have an analysis device with high processing power, it is possible to automatically generate a road trip movie.

[0021] As described above, in this embodiment, it is possible to automatically generate a road trip movie using the shooting data of the drive recorder 11, even if a high-performance analysis device is not installed in the vehicle 10. Therefore, the video generation system of this embodiment has an effect of facilitating the creation of a road trip movie.

[0022] <Other embodiments> This embodiment can be modified as follows: This embodiment and the following modifications can be combined with each other to the extent that there is no technical contradiction.

[0023] The music being played in the car while the image data was being captured may be used as background music for the video to be generated. In this case, the video generation server 20 identifies the music being played in the car by acoustic analysis of the image data. The video generation server 20 then inserts the identified music as background music into the video to be generated. At this time, the climax of the image may be synchronized with the quiet part of the music.

[0024] 2 may be performed by a user terminal (such as a PC) outside the vehicle. In this case, the captured data of the drive recorder 11 is moved or copied to the user terminal using a memory card or the like, and then transmitted from the user terminal to the video production server 20. Furthermore, the processing performed by the video production server 20 may be performed by the user terminal. In this case, the user terminal constitutes a video production system.

[0025] The process related to video generation, which was performed by the video generation server 20 in the above embodiment, may be performed in the vehicle 10. In this case, it is not necessary to perform real-time analysis of the video and audio for video generation. Therefore, the processing power required for the processing device mounted on the vehicle 10 for video generation can be kept low. [Explanation of symbols]

[0026] 10 Vehicles 11 Drive recorder 12 In-car camera 13. Exterior camera 14 Microphones 15 Data Storage 16 Human Machine Interface (HMI) 17 Communication Module 18 In-vehicle network 20 Video Generation Server 21 Processors 22 Data Storage 23 Communication Module

Claims

1. A video generation system that sets a cut-out range based on the analysis results of data captured by a drive recorder, and automatically generates a video by cutting out footage of the cut-out range from the captured data.

2. The video production system according to claim 1 , wherein the cut-out range is set based on sounds inside the vehicle recorded in the shooting data.

3. The video generation system according to claim 1 , wherein the cut-out range is set based on music that is being played in the vehicle while the photographed data is being photographed.

4. The video generating system according to claim 1 , wherein music played in a car while the photographic data was being taken is used as background music for the video.

5. The video generation system according to claim 1 , wherein a range in which a designated person is included in the video, or a range starting at a time when a person in the video makes a specific gesture, is set as the cut-out range.

Images