Moving picture creating method

Abstract

To provide a moving image creation method for creating a performance moving image which a player wants to contribute easily.SOLUTION: The video creation method is realized by a computer, and includes receiving an operation of selecting a character to be used, superimposing and arranging the selected character on a captured video that is a video to be captured, recording the captured video including a performer, analyzing a song performed in the recorded captured video, and creating a video for posting in which an action of the character is synchronized with the performance based on a result of the analysis.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a video creation method. [Background technology]

[0002] Techniques for creating videos of musical instrument performances have been known for some time. For example, Patent Document 1 discloses a technique for creating a musical performance video that combines information such as the title of the song being performed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-054686 Summary of the Invention [Problem to be solved by the invention]

[0004] Among musicians who regularly use social media, there are some who would like to post videos of their performances on social media. However, because social media often provides opportunities to see videos of skilled performers, it has traditionally been difficult for beginners or those who lack confidence in their playing to easily post videos of their performances.

[0005] In view of the above circumstances, the present invention provides a video creation method for creating performance videos that performers will want to post casually. [Means for solving the problem]

[0006] A video creation method according to one aspect of the present invention is implemented by a computer, accepts an operation to select a character to be used, overlays the selected character on a filmed video, which is a video to be shot, records the filmed video including the performer, analyzes the song played in the recorded filmed video, and creates a video to be posted in which the character's movements are synchronized with the performance based on the results of the analysis. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an information processing system. [Figure 2] 10 is a flowchart illustrating an example of processing by a user terminal. [Figure 3] FIG. 10 is a diagram showing an example of a captured video in which a character is placed. [Figure 4] FIG. 10 is a diagram showing an example of a video to be posted. DETAILED DESCRIPTION OF THE INVENTION

[0008] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will now be described with reference to the accompanying drawings.

[0009] The information processing system 1 includes a user terminal 10 and a server 20. The components included in the information processing system 1 are connected to each other so that they can communicate with each other via a network 30. The user terminal 10 is a computer such as a smartphone, tablet, or PC used by a user. The server 20 provides predetermined services, apps, etc. to the user terminal 10.

[0010] The user terminal 10 includes a control unit 11, a memory unit 12, a communication unit 13, a display unit 14, an operation unit 15, and a photographing unit 16. The control unit 11 includes, for example, a CPU, and executes various processes and controls according to a program. The memory unit 12 includes, for example, a storage device, a ROM, a RAM, etc., and stores various programs and data. The communication unit 13 includes a communication interface, and communicates with other devices such as a server 20 via a network 30. The display unit 14 includes, for example, an LCD display or an organic EL display, and displays a screen containing various information, images, etc. The operation unit 15 includes, for example, physical keys, a touch panel integrated with the display unit 14, etc., and is operated by the user. The photographing unit 16 includes a camera, and captures images including videos.

[0011] The server 20 includes a control unit 21, a storage unit 22, and a communication unit 23. The components of the server 20 are the same as those of the user terminal 10, and therefore a description thereof will be omitted.

[0012] In this embodiment, a video to be posted is created by filming a performer playing an instrument and superimposing a character dancing along with the performance on top of the video. Note that the performer and the user using the user terminal 10 (i.e., the person filming) may be the same person or different people. The processing of the user terminal 10 will be described below.

[0013] Fig. 2 is a flowchart showing an example of processing of the user terminal 10. Fig. 3 is a diagram showing an example of a captured video in which a character is placed. Fig. 4 is a diagram showing an example of a video to be posted.

[0014] It is assumed that a performance video creation application (hereinafter referred to as "app") is pre-installed on the user terminal 10. The performance video creation app may be downloaded and installed on the user terminal 10 from a server 20 that manages an app store via a network 30, for example. The control unit 11 of the user terminal 10 executes the process shown in FIG. 2 in accordance with a program included in the performance video creation app stored in the storage unit 12.

[0015] First, the control unit 11 acquires a list of available characters (step S1). The information on the available characters may be downloaded from the server 20 to the user terminal 10, or may be included in the data of the performance video creation application. Furthermore, the characters may be either paid or free, and paid characters may be available for purchase via the server 20.

[0016] Control unit 11 causes display unit 14 to display the list of characters acquired in step S1 (step S2). Then, control unit 11 accepts a user operation via operation unit 15 to select a character to use from the characters displayed in step S2 (step S3).

[0017] Control unit 11 acquires video captured by imaging unit 16 (hereinafter referred to as "captured video") and displays it on display unit 14 (step S4). At step S4, control unit 11 does not start the recording process of the captured video (i.e., the process of storing the captured video in memory unit 12), but starts the display process of the captured video to allow the user to prepare for recording (for example, adjust the camera orientation, etc.). If the performer and the user (camera operator) are the same person, the in-camera of user terminal 10 may be used as imaging unit 16 so that the performer can play while checking display unit 14.

[0018] The control unit 11 starts the movement of the character selected in step S3, and displays the moving character on the display unit 14, superimposed on the captured video displayed in step S4 (step S5). At the time of step S5, the character moves at an arbitrary movement speed and movement pattern, and is placed at an arbitrary position on the captured video. The control unit 11 then accepts a user operation to adjust the position of the character placed on the captured video via the operation unit 15 (step S6). The character may be placed in a conspicuous position, for example, on the shoulder or lap of a musician included in the captured video, or on top of an instrument. In the example shown in FIG. 3, the character is placed as if sitting on the lap of a musician sitting with a guitar.

[0019] When control unit 11 receives a user operation via operation unit 15 to start recording of a captured video including a performer as the performance of a musical instrument begins, control unit 11 starts the recording process (step S7). Control unit 11 starts recording of the captured video itself, which does not include characters. Then, when control unit 11 receives a user operation via operation unit 15 to end recording of the captured video as the performance ends, control unit 11 ends the recording process started in step S7 (step S8).

[0020] The control unit 11 analyzes the song played in the recorded video (step S9). Any known analysis method may be used to analyze the song. As a result of the analysis, the control unit 11 may obtain one or more pieces of information indicating the characteristics of the song, such as the rhythm, tempo, chords, key, or structure of the song. Analysis of the song's tempo may include analysis of not only fixed tempo but also variable tempo, and analysis of the song's structure may include analysis of sections including an A-melody, a B-melody, or a chorus, climaxes, highlights and breaks, or musical jumps. Note that the song analysis may be performed on the server 20 side, or the control unit 11 may transmit the video to the server 20 via the communication unit 13, and the control unit 21 of the server 20 may receive the video via the communication unit 23 and analyze the song.

[0021] Based on the analysis results in step S9, control unit 11 creates a video for posting on SNS (hereinafter referred to as "video for posting") in which the character's movements are synchronized with the music performance, and stores the video in storage unit 12 (step S10). Control unit 11 may control the character's movement speed in synchronization with the rhythm or tempo of the song acquired in step S9, for example, or may control the character's movement pattern according to the chords, key, or structure of the song. Paid characters may have more movement patterns than free characters, and may be changed more finely than free characters according to the chords, key, or structure of the song.

[0022] When the control unit 11 receives a user's operation to play the video to be posted via the operation unit 15, the control unit 11 plays the video to be posted created in step S10 and displays it on the display unit 14 (step S11). The control unit 11 executes a playback process for the video to be posted to allow the user to check the quality of the video to be posted. In the example of the video to be posted shown in FIG. 4, a character is displayed as if dancing to the music while sitting on the lap of a musician who is sitting with a guitar. Note that the control unit 11 may automatically play the video to be posted as soon as the video to be posted is created in step S10, without waiting for a user operation. The control unit 11 may also receive a user's operation to change the position of the character placed on the video to be posted, and may recreate the video to be posted if the position of the character is changed.

[0023] The control unit 11 determines whether an operation to save or delete the video to be posted has been received via the operation unit 15 from the user who confirmed the video to be posted played in step S11 (step S12). If the control unit 11 receives a save operation, it causes the storage unit 12 to maintain the storage of the video to be posted that was stored (saved) in step S10 (step S13). The user can post the saved video to be posted to an SNS. On the other hand, if the control unit 11 receives a delete operation, it controls the storage unit 12 to delete the storage of the video to be posted (step S14). Thereafter, the control unit 11 ends the process.

[0024] As described above, in this embodiment, a video to be posted is created by superimposing a character dancing along with the musical instrument performance on a filmed video that includes a performer playing the instrument. The visually lively character dancing along with the musical performance attracts attention to the video, thereby reducing attention to the performer's performance alone. This allows even beginners to musical instruments or performers who are not confident in their performance to create videos to be posted (performance videos) that they will want to post with ease. Furthermore, because the process from recording to editing the video can be completed within a single app, even users who are not good at editing videos can easily create attractive videos to be posted.

[0025] Furthermore, the character's movements are not synchronized with the performance during recording, but are synchronized after analysis is performed after recording. By not performing analysis during recording, the processing load on the user terminal 10 can be reduced. Meanwhile, during recording, characters that move out of synchronization with the performance are displayed in combination with the captured video, allowing the user to easily grasp the image of the video to be posted. Furthermore, after the performance ends after recording, the entire song that was performed is analyzed, so the structure of the entire song is accurately analyzed, and the degree of synchronization of the character's movements with the performance can be improved. Note that some simple analysis processing (for example, analysis processing of only the rhythm and tempo of the song) may be performed during recording. In this case, the processing load on the user terminal 10 can be reduced while the character's movements can be synchronized to a certain extent with the performance during recording. [Explanation of symbols]

[0026] 1: Information processing system 10: User terminal 11, 21: Control unit 12, 22: Storage section 13, 23: Communications Department 14: Display section 15:Operation section 16: Photography Department 20: Server 30: Network

Claims

[Claim 1] 1. A computer-implemented video creation method, comprising: Accept the operation to select the character to use, placing the selected character on a captured video that is a video to be shot; Record the video including the performer; Analyzing the music played in the recorded video; creating a video to be posted in which the character's movements are synchronized with the musical performance based on the results of the analysis; How to create a video.

Images