Video music matching method and device, electronic equipment and storage medium

A technology in video and video, applied in the field of video processing, can solve the problems of poor user viewing experience, unable to reflect the real content of the video, affecting the emotional expression of the video, etc., to achieve the effect of improving the viewing experience

Active Publication Date: 2020-12-29
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004]However, such a soundtrack method has large matching errors, and it is often impossible to obtain soundtrack audio that matches the content of the video, which cannot reflect the real content of the video, and may even be counterproductive and affect The emotional expression of the video leads to a poor viewing experience for users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video music matching method and device, electronic equipment and storage medium
  • Video music matching method and device, electronic equipment and storage medium
  • Video music matching method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028]figure 1 It is a flow chart of a method for scoring a video provided by the first embodiment of the present disclosure. This embodiment is applicable to the case of selecting a scoring audio for a video. This method can be executed by the video scoring device in the embodiment of the present disclosure. It can be implemented by software and / or hardware and integrated in an electronic device. The method specifically includes the following steps:

[0029]S110: Obtain image characteristics of each image frame in the video to be dubbed, and determine the image change characteristics of the video to be dubbed according to each of the image characteristics.

[0030]Image features can include color features, texture features, shape features, and / or spatial relationship features; among them, color features describe the surface properties of the scene corresponding to an image or image area and are based on pixel features; texture features describe The surface properties of the scene corresp...

Embodiment 2

[0046]figure 2 It is a structural block diagram of a video music scoring device provided in the second embodiment of the present disclosure, which specifically includes: an image change feature acquisition module 210, a rhythm change feature acquisition module 220, and a soundtrack audio acquisition module 230.

[0047]The image change feature acquiring module 210 is configured to acquire the image features of each image frame in the video to be dubbed, and determine the image change feature of the video to be dubbed according to each of the image features;

[0048]The rhythm change feature acquiring module 220 is configured to acquire the audio feature of each candidate audio, and determine the rhythm change feature of each candidate audio according to each of the audio features;

[0049]The soundtrack audio acquisition module 230 is configured to select the soundtrack of the video to be scored from among the candidate audios according to the similarity between the rhythm change feature of ...

Embodiment 3

[0061]image 3A schematic structural diagram of an electronic device 300 suitable for implementing the embodiments of the present disclosure is shown. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (e.g. Car navigation terminals) and other mobile terminals and fixed terminals such as digital TVs, desktop computers, etc.image 3The illustrated electronic device is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.

[0062]Such asimage 3As shown, the electronic device 300 may include a processing device (such as a central processing unit, a graphics processor, etc.) 301, which may be loaded into a random access memory (RAM) according to a program stored in a read-only memory (RO...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a video music matching method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining the image features of all image frames in a to-be-matched video, and determining the image change features of the to-be-matched video according to all image features; acquiring audio features of each alternative audio, and determining rhythm change features of each alternative audio according to each audio feature; and according to the similarity between the rhythm change characteristics of the alternative audios and the image change characteristics of the to-be-matched video, selecting the matched audio of the to-be-matched video from the alternative audios. According to the technical scheme provided by the embodimentof the invention, the change of the video content is matched with the change of the music rhythm, and the content expression of the video is accurately highlighted, so that when a user watches the video, the resonance of the user is more easily caused, and the watching experience of the user is improved.

Description

Technical field[0001]The embodiments of the present disclosure relate to video processing technology, and in particular, to a method, device, electronic device, and storage medium for scoring a video.Background technique[0002]With the continuous development of Internet technology, a variety of video software appears on terminal equipment, which brings a large amount of video data, and video soundtrack technology, as a common video data processing method, has become a video processing technology Important branch.[0003]Adding matching audio to the video can not only increase the richness of the video content, but also better express the emotional expression of the video; usually, through machine learning, emotional prediction is performed for the video and each candidate audio separately to obtain According to the corresponding classification label, the corresponding soundtrack audio is selected for the video according to the label.[0004]However, such a soundtrack method has large mat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/439H04N21/44H04N5/262G10L25/63
CPCH04N21/44008H04N21/4394H04N5/262G10L25/63
Inventor 高永强何婉婷
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap