Motion-driven intelligent music generation method and system

Abstract

The invention discloses a motion-driven intelligent music generation method and system. The method comprises the steps of data set construction, video frame image initial feature extraction, video frame feature time sequence association, audio original data generation and network training and testing. According to the method, a deep neural network structure is designed and trained by utilizing the convenience and economy of a computer, intelligent processing of a sports video is realized, original audio data is generated, and then the incidental music is synthesized, so that the problems of high difficulty in making the incidental music and high time and economic cost in the prior art are solved; further, a motion-driven intelligent music generation function system is established, feature extraction can be accurately carried out on input video data, high-quality music is generated, matching of the music and a motion scene is achieved, the subjective score MOS of the generated music is larger than 3.5, rapid and batched generation of incidental music is carried out on videos of themes such as sports and the like, and the time cost and the economic cost of music production are reduced by more than one time.

Description

technical field [0001] The invention relates to the technical fields of computer vision and intelligent soundtracking, in particular to a motion-driven intelligent music generation method and system. Background technique [0002] Exercise is a variety of activities that human beings cultivate their physical fitness in the process of development. Since the beginning of the 21st century, with the continuous advancement of science and technology, people have begun to seek to integrate various elements into sports, such as: adding music to sports videos to give the audience a stronger audio-visual experience. Music is an important form of expression in the field of art, which embodies the human thinking mode and is a unified combination of regularity and creativity. On the one hand, the production of music is based on certain knowledge of music theory; on the other hand, music itself carries certain human emotions. [0003] The technology of using deep learning technology to a...

AI Technical Summary

Problems solved by technology

[0007] In order to solve the problems existing in the prior art, the present invention provides a motion-driven intelligent music generation method and system, utilizes the characteristics of computer quickness and economy, designs a deep neural network structure and trains it, Constructed a motion-driven intelligent music generation system, realized the intelligent processing of motion video and generated original audio data, and then synthesized the function of soundtrack, which solved the difficulty, time and economic cost of soundtrack production mentioned in the above-mentioned background technology high problem

Images