Unlock instant, AI-driven research and patent intelligence for your innovation.

Video generation method and device, equipment and storage medium

A video and target video technology, applied in the computer field, can solve the problems of high cost and low video production efficiency, and achieve the effect of low cost, high video production efficiency and high matching degree.

Active Publication Date: 2022-03-25
ALIBABA (CHINA) CO LTD
View PDF19 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The production cycle usually takes a week or even longer, so the video production efficiency is low and the cost is high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video generation method and device, equipment and storage medium
  • Video generation method and device, equipment and storage medium
  • Video generation method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] refer to figure 1 , figure 1 It is a flowchart of steps of a video generation method according to Embodiment 1 of the present application. Specifically, the video generation method provided in this embodiment includes the following steps:

[0028] Step 102, acquiring lyrics text data and audio data corresponding to the target song segment.

[0029] The target song segment in the embodiment of the present application can be any song segment to be generated with a corresponding video, and the song segment can be a complete song, or a part of a complete song, such as: according to the completeness of the lyrics Split the song to obtain multiple song fragments, and each song fragment corresponds to a complete sentence of lyrics, and so on. In the embodiment of the present application, the specific content of the target song segment is not limited, and can be selected according to actual needs.

[0030] Step 104, perform semantic analysis on the lyrics text data to obtai...

Embodiment 2

[0044] refer to image 3 , image 3 It is a flowchart of steps of a frequency generation method according to Embodiment 2 of the present application. Specifically, the frequency generation method provided in this embodiment includes the following steps:

[0045] In step 302, the target song is obtained, and the target song is segmented to obtain a plurality of target song segments.

[0046] Wherein, each target song segment corresponds to a sentence of lyrics.

[0047] Specifically, the target song in this embodiment of the present application may be a complete song. Since there may be certain differences and spans between the semantic attribute information of each sentence lyrics, and there may also be differences and spans between the music emotion information of each sentence lyrics, in order to make the final generated video better match the target song , therefore, the complete target song can be first divided into multiple target song segments, and then the correspon...

Embodiment 3

[0096] see Figure 4 , Figure 4 It is a structural block diagram of a video generation device according to Embodiment 3 of the present application. The video generation device provided in the embodiment of the present application includes:

[0097] Data obtaining module 402, for obtaining the lyric text data and the audio data corresponding to the target song segment;

[0098] The information obtaining module 404 is used to carry out semantic analysis to the lyrics text data to obtain the semantic attribute information of the target song segment; and based on the audio data, obtain the corresponding music emotion information of the target song segment;

[0099] The matching module 406 is used to determine the target video material matched with the target song segment from the preset video material library based on the semantic attribute information and the music mood information;

[0100] A target video generation module 408, configured to generate a target video correspon...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a video generation method and device, equipment and a storage medium. The video generation method comprises the following steps: acquiring lyric text data and audio data corresponding to a target song fragment; performing semantic analysis on the lyric text data to obtain semantic attribute information of the target song fragment; obtaining music emotion information corresponding to the target song fragment based on the audio data; based on the semantic attribute information and the music emotion information, determining a target video material matched with the target song fragment from a preset video material library; and generating a target video corresponding to the target song clip based on the target video material. According to the embodiment of the invention, the video production efficiency is relatively high, and the cost is relatively low. Besides, when the target video material is determined, the semantics and the music emotion of the song fragment are considered at the same time, so that the matching degree of the determined target video material and the target song fragment is higher, and the target video generated based on the target video material is higher in quality.

Description

technical field [0001] The embodiments of the present application relate to the field of computer technology, and in particular, to a video generation method, device, device, and storage medium. Background technique [0002] With the continuous development of multimedia technology, the consumer demand for short videos is also growing. Among the many types of multi-videos, short music videos that display associated video content around target music songs are widely loved by consumers. [0003] For traditional music short videos, the editing and creation process is completely dependent on manual work. Specifically, it mainly relies on manual search for related video materials, and subsequent post-processing operations such as editing and synthesis. The production cycle usually takes a week or even longer, so the video production efficiency is low and the cost is high. Contents of the invention [0004] In view of this, embodiments of the present application provide a video...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G10L15/26G10L15/18G10L25/60G10L25/57H04N21/234H04N21/44H04N21/439H04N21/233
CPCG10L15/26G10L15/1822G10L25/60G10L25/57H04N21/234H04N21/44H04N21/439H04N21/233
Inventor 丁飞梁军王崇晓
Owner ALIBABA (CHINA) CO LTD