Video music matching method, device, storage medium and program product

Abstract

[0009] The embodiments of the present disclosure provide a video-music matching method, device, storage medium, and program product, which obtain target attribute information of a video material to be matched with music in a video track of a video editing tool, perform image recognition on the video material to determine image content characteristics of the video material, obtain music matching options from a music library based on the target attribute information and the image content characteristics, and synthesize the user-selected target music matching option into the video material in response to a user's selection instruction for the music matching option. The embodiments of the present disclosure perform music matching recommendation based on the target attribute information and image content characteristics of the video material, thereby improving the accuracy of the music matching recommendation and reducing the cost of user music selection, thereby reducing the complexity of user music selection and video editing operations, and contributing to faster and better production of high-quality videos.

Description

[Technical Field]

[0001] This application claims priority to a Chinese patent application filed on December 19, 2022, entitled "Video Music Matching Method, Device, Storage Medium and Program Product," and bearing application number 202211635265.X, the entire contents of which are incorporated herein by reference.

[0002] TECHNICAL FIELD Embodiments of the present disclosure relate to the field of computer and network communication technologies, and in particular to a video music matching method, device, storage medium and program product. [Background technology]

[0003] In video editing, music (BGM, background music) is usually added to a video to achieve the purpose of enhancing the atmosphere, enhancing the mood of the video, stimulating the viewer's interest, and eliciting the viewer's enthusiasm to participate in the plot.

[0004] Existing video editing solutions typically provide users with a music matching editing function and offer several music matching content for users to choose from. Existing music matching content provision solutions typically recommend currently popular songs, that is, songs that are currently being used, have a high search volume, or have a high growth rate, to users preferentially, or recommend songs by genre, categorizing songs into commonly used genres such as "pop," "rhythm," "fresh," "travel," etc., and users can enter subpages to select songs according to the theme they have created.

[0005] Current popular song recommendation solutions have poor recommendation accuracy and high costs for users to find songs they like. However, the granularity of recommendation classification by genre is coarse and the genre is not flexible enough, so the cost of users selecting songs is not significantly reduced. Summary of the Invention [Means for solving the problem]

[0006] Embodiments of the present disclosure provide a video music matching method, device, storage medium, and program product for improving the accuracy of music matching recommendations and reducing the cost of music selection for users.

[0007] In a first aspect, an embodiment of the present disclosure provides a video music matching method, the method comprising: Obtaining target attribute information of a video material to be matched with a music piece in a video track of a video editing tool; performing image recognition on the video footage to determine image content characteristics of the video footage; obtaining music matching options from a music library based on the target attribute information and the image content features; and compositing a user-selected target music matching option into the video material in response to a user indication of a selection of the music matching option.

[0008] In a second aspect, an embodiment of the present disclosure provides a video music matching device, the device comprising: an information extraction unit for obtaining target attribute information of a video material to be matched with a song in a video track of a video editing tool; a feature extraction unit for performing image recognition on said video material to determine image content features of the video material; a music matching recommendation unit for obtaining music matching options from a music library based on the target attribute information and the image content features; and an editing unit for compositing a user-selected target music matching option into the video material in response to a user's selection of the music matching option.

[0009] In a third aspect, an embodiment of the present disclosure provides an electronic device, the device comprising at least one processor and a memory; the memory stores computer-executable instructions; The at least one processor executes computer-executable instructions stored in the memory to cause the at least one processor to perform the video music matching method described in the first aspect and various possible designs of the first aspect above.

[0010] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having computer-executable instructions stored thereon, the computer-readable storage medium performing, when executed by a processor, the video music matching method as set forth in the first aspect above and various possible designs of the first aspect.

[0011] In a fifth aspect, an embodiment of the present disclosure provides a computer program product comprising computer executable instructions that, when executed by a processor, performs the video music matching method as set forth in the first aspect above and various possible designs of the first aspect.

[0012] The video / music matching method, device, storage medium, and program product provided by the present disclosure include: obtaining target attribute information of a video material to be matched with music in a video track of a video editing tool; performing image recognition on the video material to determine image content characteristics of the video material; obtaining music matching options from a music library based on the target attribute information and the image content characteristics; and synthesizing the user-selected target music matching option into the video material in response to a user's selection instruction for the music matching option. The present disclosure performs music matching recommendation based on the target attribute information and image content characteristics of the video material, thereby improving the accuracy of the music matching recommendation and reducing the cost of user music selection, thereby reducing the complexity of user music selection and video editing operations and contributing to faster and better production of high-quality videos. [Brief explanation of the drawings]

[0013] In order to more clearly explain the technical solutions in the embodiments of the present disclosure or the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. The accompanying drawings in the following description are some embodiments of the present disclosure, and it is obvious to those skilled in the art that they can obtain other drawings according to these accompanying drawings without paying creative efforts.

[0014] [Figure 1] FIG. 1 is an exemplary diagram of an application scenario of the video music matching method provided by an embodiment of the present disclosure. [Figure 2] 1 is a schematic flowchart of a video music matching method provided by an embodiment of the present disclosure; [Figure 3] 4 is a schematic flowchart of a video music matching method provided by another embodiment of the present disclosure; [Figure 4] FIG. 1 is a block diagram of a video music matching device provided by an embodiment of the present disclosure. [Figure 5] FIG. 1 is a schematic diagram of a hardware configuration of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0015] In order to clarify the objectives, technical solutions and advantages of the embodiments of the present disclosure, the following will clearly and completely describe the technical solutions in the embodiments of the present disclosure in conjunction with the accompanying drawings in the embodiments of the present disclosure, but it is clear that the described embodiments are only a part of the embodiments of the present disclosure and do not represent all of the embodiments. All other embodiments that can be obtained by a person skilled in the art based on the embodiments of the present disclosure without paying creative effort are within the scope of protection of the present disclosure.

[0016] Existing video editing solutions typically provide users with a music matching editing function and offer several music matching content for users to choose from. Existing music matching content provision solutions typically recommend currently popular songs, that is, songs that are currently being used, have a high search volume, or have a high growth rate, to users preferentially, or recommend songs by genre, categorizing songs into commonly used genres such as "pop," "rhythm," "fresh," "travel," etc., and users can enter subpages to select songs according to the theme they have created.

[0017] Current popular song recommendation solutions have poor recommendation accuracy, and the cost for users to find their favorite songs is high, requiring them to constantly click, load, and listen to songs until they find one they like. Meanwhile, the granularity of recommendation classification by genre is coarse, and the genres are not flexible enough. Similarly, users must enter the subpage of the song genre and constantly click, load, and listen to songs, which does not significantly reduce the cost of selecting songs.

[0018] To solve the above technical problems, the present disclosure provides a video music matching method, which includes: obtaining target attribute information of a video material to be matched with music in a video track of a video editing tool; performing image recognition on the video material to extract image content features; obtaining music matching options from a music library based on the target attribute information and the image content features; and synthesizing the user-selected target music matching options into the video material in response to a user's selection instruction for the music matching options. The embodiment of the present disclosure performs music matching recommendation based on the target attribute information of the video material and the image content features of the video frame images, thereby improving the accuracy of the music matching recommendation and reducing the cost of user music selection, thereby reducing the complexity of user music selection and video editing operations and contributing to faster and better production of high-quality videos.

[0019] The video and music matching method provided by the present disclosure is applicable to the application scenario shown in FIG. 1 and may include a terminal device 101 and a server 102. A user may upload video material to be matched with music to a video track of a video editing tool of the terminal device 101, or select video material to be matched with music from video material pre-stored in the terminal device 101 and add it to the video track of the video editing tool, or directly call the camera of the terminal device 101 in the video editing tool of the terminal device 101 to record video material. The terminal device 101 may obtain target attribute information of the video material to be matched with music in the video track of the video editing tool, extract video frame images from the video material, perform image recognition to extract image content features, and send the target attribute information and image content features to the server 102. The server 102 may obtain music matching options from a music library based on the target attribute information and image content features, and return the music matching options to the terminal device 101. The user may preview and select a music matching option on the terminal device 101, and in response to the user's selection instruction for the music matching option, the terminal device 101 may add the target music matching option selected by the user to an audio track corresponding to the video material, such as compositing the audio track with the video track.

[0020] In another application scenario, the terminal device may directly upload the video material to be music-matched in the video track of the video editing tool to the server, the server may obtain target attribute information of the video material to be music-matched, extract image content features from the video material, obtain music matching options from a music library according to the target attribute information and the image content features, and return the music matching options to the terminal device, the user may listen to and select the music matching options on the terminal device, and the terminal device may synthesize the target music matching option selected by the user into the video material in response to the user's selection instruction for the music matching option, or the terminal device may send the user's selection instruction for the music matching option to the server, and the server may synthesize the target music matching option selected by the user into the video material.

[0021] The video music matching method of the present disclosure will be described in detail below in conjunction with specific examples.

[0022] Referring to Figure 2, Figure 2 is a schematic flowchart of a video music matching method provided by an embodiment of the present disclosure. The method of this embodiment can be applied to a terminal device or a server, and the video music matching method includes the following steps:

[0023] S201: Obtain target attribute information of a video material to be matched with music in a video track of a video editing tool.

[0024] In this embodiment, in the video editing scenario, target attribute information of the video material to be matched with music in the video track of the video editing tool may be obtained.

[0025] Here, some required target attribute information of the video material, such as recording time, season, weather, recording location, etc., may be obtained, provided that the user has granted the corresponding authorization (e.g., file access authorization, location information authorization, information acquisition authorization, etc.).

[0026] Alternatively, the target attribute information may be extracted from the attribute information of the video material, which may include, but is not limited to, the recording time, the recording location, the video duration, the size of the occupied storage area, etc., and necessary key attribute information may be extracted therefrom, such as key attribute information such as the recording time and the recording location. If the attribute information of the video material does not include target attribute information such as the recording time and the recording location, the current time and the current location may be obtained with the user's permission, or an input interface may be provided for the user to input the recording time and the recording location themselves.

[0027] In addition, derived attribute information may be obtained based on the key attribute information and in accordance with the key attribute information. For example, preliminary processing may be performed on the key attribute information to determine, based on the recording time, the season, holiday, weather information (for example, weather information can be queried from the recording time and recording location), the location area (for example, a scenic spot or a commercial area) when the video material was recorded, etc.

[0028] In this embodiment, as a kind of key information that can reflect the content of the video material, key attribute information and / or derived attribute information may be determined as the target attribute information.

[0029] S202: Perform image recognition on the video material to determine image content characteristics of the video material.

[0030] In this embodiment, in a video editing scenario, one or more video frame images are extracted from the video material to be matched with music in the video track of the video editing tool, and image recognition is performed on the video frame images to extract image content features from the video frame images. For example, the image content features may include main elements such as the sky, the coast, trees, flowers, and buildings from the video frame images. Here, the extraction of the image content features may employ any image recognition algorithm, and is not limited in this specification.

[0031] Furthermore, the video frame images may be key frames in the video material or any frames. Optionally, in order to ensure the number of video frame images and processing efficiency, a predetermined number of video frame images may be extracted from the video material at equal intervals depending on the duration of the video material. For example, if the duration of the video material is less than 30 seconds, two frames may be extracted from the video material at equal intervals; if the duration of the video material is more than 30 seconds but less than one minute, three frames may be extracted from the video material at equal intervals; if the duration of the video material is more than one minute, five frames may be extracted from the video material at equal intervals, and so on.

[0032] In this embodiment, there is no limitation on the order of S201 and S202, and they may be performed sequentially or simultaneously.

[0033] S203: Obtaining music matching options from a music library based on the target attribute information and the image content features.

[0034] In this embodiment, after obtaining the target attribute information and image content features of the video footage, matching may be performed from a music library based on the target attribute information and the image content features, and one or more music matching options may be recommended for selection by the user.

[0035] Furthermore, current popularity information may also be taken into consideration, and corresponding priorities (or weights) may be set for target attribute information, image content features, and current popularity information. Among these, the target attribute information can best reflect the main content of the video material and is the most important for recommending music matching, so the highest priority (or weight) is set for the target attribute information. Furthermore, the image content features are extracted from some video frame images of the video material and are somewhat representative, but may also be relatively one-sided, so a medium priority (or weight) is set for the image content features. On the other hand, the current popularity information generally has little relevance to the video material and is only reference information for recommending music matching, so the lowest priority (or weight) may be set for the current popularity information. Of course, the above-mentioned predetermined priority (or weight) order may be changed according to more realistic situations, or other priority (or weight) orders may be used, and are not limited thereto.

[0036] Furthermore, when obtaining song matching options from the song library, it specifically includes:

[0037] A predetermined number of songs that match the target attribute information, the image content characteristics, and the current popularity information are searched from the music library in a predetermined order of priority, and determined as music matching options.

[0038] In this embodiment, when recommending song matching, a predetermined number of songs are searched and matched from the song library based on the target attribute information, image content features, and current popularity information individually, and these songs may be sorted according to a predetermined priority to determine the song matching options. Optionally, the predetermined number corresponding to information with a higher priority may be larger. For example, since the target attribute information has the highest priority, the predetermined number of songs recommended based on the target attribute information will be the largest.

[0039] Furthermore, the target attribute information, image content features, and current popularity information may be combined with each other to search and match a predetermined number of songs from a music library, for example, searching and matching a predetermined number of songs from a music library based on the target attribute information and image content features, searching and matching a predetermined number of songs from a music library based on the target attribute information and current popularity information, searching and matching a predetermined number of songs from a music library based on the target attribute information, image content features, and current popularity information, etc.

[0040] S204: In response to a user's selection instruction for a music matching option, the target music matching option selected by the user is composited into the video material.

[0041] In this embodiment, after obtaining the song matching options, the options are displayed for the user to listen to. After listening, the user selects one of the song matching options to be used as a song in the video footage. In response to the user's selection instruction for the song matching options, the target song matching option selected by the user is determined from the song matching options. The target song matching option is combined with the video footage as a song in the video footage, thereby automatically adding the target song matching option to the video footage.

[0042] Specifically, the target music matching option selected by the user can be input into the audio track corresponding to the video material, and the audio track and the video track can be combined, where the track timeline interval of the target music matching option in the audio track corresponds to the track timeline interval of the video material to be music matched in the video track, and optionally the track timeline interval of the target music matching option in the audio track can cover the track timeline interval of the video material to be music matched in the video track, allowing the user to continue editing.

[0043] The video / music matching method provided by this embodiment includes: obtaining target attribute information of a video material to be matched with music in a video track of a video editing tool; performing image recognition on the video material to determine image content characteristics of the video material; obtaining music matching options from a music library based on the target attribute information and the image content characteristics; and synthesizing the user-selected target music matching option into the video material in response to a user's selection instruction for the music matching option. This embodiment performs music matching recommendation based on the target attribute information of the video material and the image content characteristics of the video frame images, thereby improving the accuracy of the music matching recommendation and reducing the cost of user music selection, thereby reducing the complexity of user music selection and video editing operations and contributing to faster and better production of high-quality videos.

[0044] In an alternative embodiment, the video material to be matched with music may have multiple sub-video clips. In this case, obtaining music matching options from a music library based on the target attribute information and the image content features described in S203 can be specifically performed as shown in FIG. 3 : S301: Obtaining correlation parameters between adjacent sub-video clips; S302: Obtaining song matching options from a song library based on the correlation parameters and the target attribute information and image content features of each sub-video clip.

[0045] In this embodiment, considering that there may be a certain correlation between multiple sub video clips, adjacent sub video clips with relatively high correlation may be combined to use one song, thereby avoiding the user from selecting one song for each sub video clip. First, obtain the correlation parameters of the adjacent sub video clips, and determine whether the adjacent sub video clips can be combined to use one song based on the correlation parameters. Here, the correlation parameters of the adjacent sub video clips may be determined based on the similarity of the target attribute information and / or image content features of the adjacent sub video clips, or other algorithms that can compare the similarity or correlation of videos may be used, and are not limited in this specification. Furthermore, if the correlation parameter of any adjacent sub video clip is greater than a predetermined threshold, the adjacent sub video clips may be combined and processed as a combination of sub video clips. For example, for sub-video clips A, B, C, D, E, and F, if the correlation parameter between adjacent sub-video clips A and B is greater than a predetermined threshold and the correlation parameter between adjacent sub-video clips B and C is greater than a predetermined threshold, the sub-video clips A, B, and C can share one song as a combination of one sub-video clip; if the correlation parameter between adjacent sub-video clips C and D is not greater than a predetermined threshold and the correlation parameter between adjacent sub-video clips D and E is not greater than a predetermined threshold, the sub-video clip D does not form a combination of the adjacent sub-video clip and the sub-video clip, but uses one song individually; and if the correlation parameter between adjacent sub-video clips E and F is greater than a predetermined threshold, the sub-video clips E and F can share one song as a combination of one sub-video clip.

[0046] After determining the adjacent sub-video clips with the correlation parameter greater than a predetermined threshold as a sub-video clip combination, the target attribute information and image content features of each sub-video clip in the sub-video clip combination may be integrated, and during the integration, one or more operations may be performed based on the target attribute information and image content features of each sub-video clip, including but not limited to generalization, expansion, selection, etc. Furthermore, based on the integrated target attribute information and image content features, song matching options may be obtained from a song library as song matching options shared by each sub-video clip in the sub-video clip combination, where a set(s) of song matching options are obtained for each sub-video clip combination.

[0047] In the integration process, for example, if a user imports three sub-video clips A, B, and C, and the target attribute information and image content features extracted from each are A (10 seconds, April, sunny, a park in Y City, flowers, etc.), B (20 seconds, April, cloudy, a shopping mall in Y City, nothing, etc.), and C (5 seconds, March, cloudy, a residential area in Y City, children, etc.), and a comprehensive assessment shows that there is a high correlation between sub-video clips A, B, and C, the target attribute information and image content features of each sub-video clip are integrated to expand the sub-video clips to spring, sunny to cloudy, Y City, indoors, fashion, trend (obtained from the feature information of Y City and a shopping mall), natural scenery, children, cute, etc. Furthermore, based on the integrated target attribute information and image content features, song matching options common to sub-video clips A, B, and C may be obtained from a song library.

[0048] As another example, if a user captures three sub-video clips A, B, and C, the target attribute information and image content features extracted from each of them are A (10 seconds, April, sunny, a park in Y City, flowers, etc.), B (20 seconds, April, cloudy, a shopping mall in Y City, nothing, etc.), and C (5 seconds, December, cloudy, a scenic spot in Z City, mountain peak, etc.). After comprehensive determination, it is determined that the sub-video clips A and B are highly correlated and the correlation with the sub-video clip C is low. Therefore, the sub-video clips A and B are first merged, and song matching options are obtained from a song library based on the merged target attribute information and image content features to become the song matching options for the combined video material of the video clips A and B. For the video matching content C, the song matching options for the combined video clip of the video clips A and B can be used, or song matching options can be obtained from a song library based on the target attribute information and image content features of the video clip C individually.

[0049] In an alternative embodiment, in the above embodiment, in the process of integrating the target attribute information and the image content features of each sub-video clip in the sub-video clip combination and obtaining music matching options, specifically: determining a weight of each sub video clip in the combination of sub video clips based on predetermined attribute information of the sub video clips; Determining a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature based on a weight of each sub-video clip in the combination of the sub-video clips, where a sub-video clip with a larger weight has a larger weight of the target attribute information and image content feature; Obtaining song matching options from a song library based on the integrated target attribute information and image content features and corresponding weights; It may further include:

[0050] In this embodiment, for any combination of sub-video clips, the weight of each sub-video clip can be determined based on the predetermined attribute information of each sub-video clip in this combination of sub-video clips. For example, the weight can be determined based on the arrangement order of the sub-video clips and / or the duration of the sub-video clips, and the earlier the arrangement order and the longer the duration of the sub-video clip, the heavier the weight will be. Based on the weight information of each sub-video clip, the weight information of each target attribute information and image content feature in the integrated target attribute information and image content feature can be determined, and the sub-video clip with a higher weight will have a higher weight for its target attribute information and image content feature. Furthermore, when performing selection and rejection operations on the target attribute information and image content feature of the sub-video clips, the target attribute information and image content feature with a higher weight will be retained as much as possible.

[0051] Furthermore, when obtaining song matching options from a song library based on the integrated target attribute information and image content features, the song matching options may be obtained from the song library specifically based on the integrated target attribute information and image content features and corresponding weights.

[0052] In this embodiment, when obtaining song matching options from a song library based on the integrated target attribute information and image content features, weights are set for the target attribute information and image content features, so that song matching options can be matched and searched from the song library based on the weights of the target attribute information and image content features, and the obtained song matching options are more likely to match the target attribute information and image content features with high weights, or there are a large number of song matching options that match the target attribute information and image content features with high weights, and they will be ranked high.

[0053] Alternatively, the music matching options corresponding to the combination of sub-video clips may also be applied to independent sub-video clips that do not belong to the combination of sub-video clips, or the independent sub-video clips that do not belong to the combination of sub-video clips may also individually obtain music matching options from the music library based on their target attribute information and image content features.

[0054] In the above embodiment, if there are no adjacent sub-video clips in the video material whose correlation parameter is greater than a predetermined threshold, i.e., if all the sub-video clips are not correlated, then based on the target attribute information and image content features of each sub-video clip, music matching options corresponding to each sub-video clip are respectively obtained from the music library.

[0055] In another alternative embodiment, a single piece of music may be used for multiple sub-video clips included in the video material in the above embodiment. The specific process is as follows: Integrating the target attribute information and the image content features of all sub-video clips; and obtaining song matching options from a song library as song matching options shared by all the sub-video clips based on the integrated target attribute information and image content features.

[0056] In this embodiment, matching songs may be recommended for all sub-video clips as a whole, that is, only one target song matching option is ultimately selected for all sub-video clips, and this is the matching song for all sub-video clips. In this case, the target attribute information and image content features of all sub-video clips may be integrated, and during the integration, one or more operations may be performed, including but not limited to generalization, expansion, selection and rejection.

[0057] Furthermore, a weight of each sub-video clip among all the sub-video clips may be determined based on predetermined attribute information of each sub-video clip, for example, the weight information may be determined based on the arrangement order of the video material of each sub-video clip and / or the duration of the video material of the sub-video clip, and the sub-video clip that is arranged earlier and has a longer duration has a larger weight. Furthermore, a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature is determined based on the weight of each sub-video clip, and a sub-video clip with a larger weight has a larger weight of the target attribute information and image content feature.

[0058] In another possible embodiment, adjacent sub-video clips may be divided into sub-video clip combinations and / or independent sub-video clips depending on whether the correlation parameter is a predetermined threshold. This may include dividing all sub-video clips into multiple video clip combinations, dividing all sub-video clips into video clip combinations and independent sub-video clips, or dividing all sub-video clips into independent sub-video clips. Then, based on the predetermined attribute information of each sub-video clip combination and / or independent sub-video clip, a weight for each sub-video clip combination and each independent sub-video clip is determined. Similarly, regardless of whether the sub-video clip or the independent sub-video clip is an independent sub-video clip, a weight for an earlier sub-video clip in the arrangement order and a longer sub-video clip duration is increased. Furthermore, based on the weight for each sub-video clip combination and each independent sub-video clip, a weight for each target attribute information and image content feature in the integrated target attribute information and image content feature is determined. Here, the weight for the target attribute information and image content feature corresponding to the sub-video clip combination or independent sub-video clip with a higher weight is increased, as in the above embodiment. Further description is omitted in this specification.

[0059] Furthermore, based on the weight of each target attribute information and image content feature in the integrated target attribute information and image content feature, a predetermined number of songs are obtained from the music library and determined as music matching options for all sub-video clips. For example, if the obtained music matching options are highly likely to match the target attribute information and image content features with high weights, or if a large number of music matching options match the target attribute information and image content features with high weights, they will be ranked high.

[0060] In the above embodiment, if a user selects a sub-video clip in a video footage in a video editing tool and then enters the music matching function, the user will obtain music matching options for this sub-video clip alone, and the user may also obtain music matching options for each sub-video clip alone in this manner. If a user directly enters the music matching function, or enters the music matching function after simultaneously selecting multiple sub-video clips in the video footage, the music matching recommendation process for multiple sub-video clips provided in the various possible embodiments described above will be executed.

[0061] In any of the above embodiments, the method further includes setting a fade-in / fade-out transition effect for any one of the target music matching options selected by the user after the target music matching options are composited into the video material.

[0062] In this embodiment, a fade-in / fade-out transition effect may be used for the connection points of multiple target music matching options, i.e., to better realize the transition, the end of the previous target music matching option may be configured to fade out, and the beginning of the next target music matching option may be configured to fade in. Of course, if there is only a single target music matching option, the target music matching option may fade in at the beginning and / or fade out at the end.

[0063] Corresponding to the video music matching method of the above embodiment, Fig. 4 is a block diagram of a video music matching device provided by an embodiment of the present disclosure. For ease of explanation, only parts relevant to the embodiment of the present disclosure are shown. Referring to Fig. 4, the video music matching device 400 includes an information extraction unit 401, a feature extraction unit 402, a music matching recommendation unit 403, and an editing unit 404.

[0064] Here, the information extraction unit 401 is used to obtain target attribute information of the video material to be matched with music in the video track of the video editing tool.

[0065] The feature extraction unit 402 is used to perform image recognition on the video material and determine image content features of the video material.

[0066] The music matching recommendation unit 403 is used to obtain music matching options from a music library based on the target attribute information and the image content features.

[0067] The editing unit 404 is used to composite user-selected target music matching options into the video material in response to a user's selection of the music matching options.

[0068] In one or more embodiments of the present disclosure, the video material includes multiple sub-video clips, and the music matching recommendation unit 403, when obtaining music matching options from a music library based on the target attribute information and the image content features, can: Obtaining correlation parameters between adjacent sub-video clips; and obtaining song matching options from a song library based on the correlation parameters and the target attribute information and image content features of each sub-video clip.

[0069] In one or more embodiments of the present disclosure, the music matching recommendation unit 403, when obtaining music matching options from a music library based on the correlation parameters and the target attribute information and image content features of each sub-video clip, may: determining adjacent sub-video clips whose correlation parameter is greater than a predetermined threshold as a combination of sub-video clips; Integrating the target attribute information and the image content features of each sub-video clip in the combination of sub-video clips; and obtaining, based on the integrated target attribute information and image content features, song matching options from a song library as song matching options shared by each sub-video clip in the combination of sub-video clips.

[0070] In one or more embodiments of the present disclosure, the music matching recommendation unit 403, when obtaining music matching options from a music library based on the integrated target attribute information and image content features, comprises: determining a weight of each sub video clip in the combination of sub video clips based on predetermined attribute information of the sub video clips; Determine a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature according to the weight of each sub-video clip in the combination of the sub-video clips, where a sub-video clip with a large weight has a large weight of the target attribute information and image content feature; and obtaining song matching options from a song library based on the integrated target attribute information and image content features and corresponding weights.

[0071] In one or more embodiments of the present disclosure, the music matching recommendation unit 403, when obtaining music matching options from a music library based on the correlation parameters and the target attribute information and image content features of each sub-video clip, may: If there are no adjacent sub-video clips whose correlation parameters are greater than a predetermined threshold, the target attribute information and image content features of each sub-video clip are used to obtain song matching options corresponding to each sub-video clip from a song library, respectively.

[0072] In one or more embodiments of the present disclosure, the video material includes multiple sub-video clips, and the music matching recommendation unit 403, when obtaining music matching options from a music library based on the target attribute information and the image content features, can: Integrating the target attribute information and the image content features of all sub-video clips; and obtaining song matching options from a song library as song matching options shared by all the sub-video clips based on the integrated target attribute information and image content features.

[0073] In one or more embodiments of the present disclosure, the music matching recommendation unit 403, when obtaining music matching options from a music library based on the integrated target attribute information and image content features, comprises: determining a weight for each sub video clip based on predetermined attribute information of the sub video clip; Determine a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature according to the weight of each sub-video clip, where a sub-video clip with a large weight has a large weight of the target attribute information and image content feature; and obtaining song matching options from a song library based on the integrated target attribute information and image content features and corresponding weights.

[0074] In one or more embodiments of the present disclosure, the information extracting unit 401, when obtaining target attribute information of the video material to be matched with music in the video track of the video editing tool, may include: extracting key attribute information from attribute information of the video material to be matched with the music; and obtaining derived attribute information based on the key attribute information, and determining the key attribute information and / or the derived attribute information as the target attribute information.

[0075] In one or more embodiments of the present disclosure, the music matching recommendation unit 403, when obtaining music matching options from a music library based on the target attribute information and the image content features, comprises: A predetermined number of songs that match the target attribute information, the image content characteristics, and the current popularity information are searched from the music library in a predetermined order of priority and used to determine them as music matching options.

[0076] In one or more embodiments of the present disclosure, the predetermined priorities are, in descending order, target attribute information, image content features, and current popularity information.

[0077] In one or more embodiments of the present disclosure, the editing unit 404 may, when compositing the user-selected target music matching options into the video footage, include: The user's selected target music matching option is used to input the audio track corresponding to the video material and combine the audio track with the video track.

[0078] The device provided by this embodiment can implement the technical solution of the above method-related embodiment, and the implementation principles and technical effects thereof are similar, so the description of this embodiment will not be repeated here.

[0079] Referring to FIG. 5 , a schematic diagram of an electronic device 500 suitable for implementing an embodiment of the present disclosure is shown. The electronic device 500 may be a terminal device or a server. Here, the terminal device may include, but is not limited to, mobile devices such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (abbreviated as PDAs), tablet computers (portable Android devices (abbreviated as PADs), portable media players (abbreviated as PMPs), and in-vehicle devices (e.g., vehicle navigation devices), as well as fixed devices such as digital TVs and desktop computers. The electronic device shown in FIG. 5 is merely an example and does not limit the functionality or scope of use of the embodiment of the present disclosure.

[0080] 5, the electronic device 500 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 501 that can perform various appropriate operations and processes based on a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. The RAM 503 also stores various programs and data necessary for the operation of the electronic device 500. The processing unit 501, the ROM 502, and the RAM 503 are connected to one another via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0081] Typically, the I / O interface 505 may be connected to input devices 506, including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507, including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 508, including, for example, a magnetic tape, hard disk, etc.; and communication devices 509. The communication devices 509 may enable the electronic device 500 to communicate and exchange data with other devices wirelessly or via wires. While FIG. 5 illustrates the electronic device 500 with various devices, it should be understood that it is not necessary for the electronic device 500 to implement or include all of the devices shown. More or fewer devices may alternatively be implemented or included.

[0082] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program stored on a computer-readable medium, the computer program including program code for performing the method illustrated in the flowcharts. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, it performs the functions defined above in the method of the embodiments of the present disclosure.

[0083] In this disclosure, the computer-readable medium may be a computer-readable signal medium, a computer-readable storage medium, or any combination thereof. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media include, but are not limited to, an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a CD-ROM (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device. In addition, in this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier carrying computer-readable program code. Such propagated data signals may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium, other than a computer-readable storage medium, that transmits, propagates, or transmits a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted using any suitable medium, including, but not limited to, wire, fiber optic cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

[0084] The computer-readable medium may be included in the electronic device or may be separate and not assembled to the electronic device.

[0085] The computer-readable medium stores one or more programs that, when executed by the electronic device, cause the electronic device to perform the methods illustrated in the above embodiments.

[0086] Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and the like, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may run entirely on the user computer, partially on the user computer, as a stand-alone software package, partially on the user computer and partially on a remote computer, or entirely on a remote computer or server. In the context of a remote computer, the remote computer may be connected to the user computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet Service Provider).

[0087] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functions, and operations that may be implemented in accordance with systems, methods, and computer program products according to embodiments of the present disclosure. In this regard, each box in a flowchart or block diagram may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing a specified logical function. Note that in some alternative implementations, the functions marked in the boxes may occur in a different order than those marked in the accompanying drawings. For example, two consecutive boxes may actually be executed substantially in parallel, or may be executed in the reverse order depending on the functionality involved. It should also be noted that each box in the block diagrams and / or flowcharts, and combinations of boxes in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system that performs a given function or operation, or in a combination of dedicated hardware and computer instructions.

[0088] The units according to the embodiments of the present disclosure may be implemented by software or hardware, and the name of a unit does not constitute a limitation on the unit itself in a given situation, for example, the first obtaining unit may also be described as "a unit for obtaining at least two Internet Protocol addresses."

[0089] The functionality described herein above may be performed, at least in part, by one or more hardware logic units, such as, but not limited to, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0090] In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium includes, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof. More specific examples of machine-readable storage media include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a CD-ROM (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0091] In a first aspect, according to one or more embodiments of the present disclosure, there is provided a video music matching method, the method comprising: Obtaining target attribute information of a video material to be matched with a music piece in a video track of a video editing tool; performing image recognition on the video footage to determine image content characteristics of the video footage; obtaining music matching options from a music library based on the target attribute information and the image content features; and compositing a user-selected target music matching option into the video material in response to a user indication of a selection of the music matching option.

[0092] According to one or more embodiments of the present disclosure, the video material includes a plurality of sub-video clips, and obtaining music matching options from a music library based on the target attribute information and the image content features includes: Obtaining correlation parameters between adjacent sub-video clips; and obtaining song matching options from a song library based on the correlation parameters and the target attribute information and image content features of each sub-video clip.

[0093] According to one or more embodiments of the present disclosure, obtaining song matching options from a song library based on the correlation parameters and target attribute information and image content features of each sub-video clip includes: determining adjacent sub-video clips whose correlation parameter is greater than a predetermined threshold as a combination of sub-video clips; Integrating the target attribute information and the image content features of each sub-video clip in the combination of sub-video clips; and obtaining, based on the integrated target attribute information and image content features, song matching options from a song library as song matching options shared by each sub-video clip in the combination of sub-video clips.

[0094] According to one or more embodiments of the present disclosure, obtaining music matching options from a music library based on the integrated target attribute information and image content features includes: determining a weight of each sub video clip in the combination of sub video clips based on predetermined attribute information of the sub video clips; Determining a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature based on a weight of each sub-video clip in the combination of the sub-video clips, where a sub-video clip with a larger weight has a larger weight of the target attribute information and image content feature; and obtaining song matching options from a song library based on the integrated target attribute information and image content features and corresponding weights.

[0095] According to one or more embodiments of the present disclosure, obtaining song matching options from a song library based on the correlation parameters and target attribute information and image content features of each sub-video clip includes: If there are no adjacent sub-video clips whose correlation parameter is greater than a predetermined threshold, obtaining music matching options corresponding to each sub-video clip from a music library based on the target attribute information and image content features of each sub-video clip.

[0096] According to one or more embodiments of the present disclosure, the video material includes a plurality of sub-video clips, and obtaining music matching options from a music library based on the target attribute information and the image content features includes: Integrating the target attribute information and the image content features of all sub-video clips; and obtaining, based on the integrated target attribute information and image content features, song matching options from a song library as song matching options shared by all the sub-video clips.

[0097] According to one or more embodiments of the present disclosure, obtaining music matching options from a music library based on the integrated target attribute information and image content features includes: determining a weight for each sub video clip based on predetermined attribute information of the sub video clip; Determine a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature according to the weight of each sub-video clip, where a sub-video clip with a larger weight has a larger weight of the target attribute information and image content feature; and obtaining song matching options from a song library based on the integrated target attribute information and image content features and corresponding weights.

[0098] According to one or more embodiments of the present disclosure, obtaining target attribute information of a video material to be music-matched in a video track of a video editing tool includes: extracting key attribute information from attribute information of the video material to be matched with the music; Obtaining derived attribute information based on the key attribute information, and determining the key attribute information and / or the derived attribute information as the target attribute information.

[0099] According to one or more embodiments of the present disclosure, obtaining music matching options from a music library based on the target attribute information and the image content features includes: The method includes searching the music library for a predetermined number of songs that match the target attribute information, the image content characteristics, and the current popularity information, in a predetermined order of priority, and determining the songs as music matching options.

[0100] According to one or more embodiments of the present disclosure, the predetermined priorities are, in descending order, target attribute information, image content features, and current popularity information.

[0101] According to one or more embodiments of the present disclosure, compositing user-selected target music matching options into the video material includes: and inputting the user-selected target music matching selection into an audio track corresponding to the video material to combine the audio track with the video track.

[0102] In a second aspect, according to one or more embodiments of the present disclosure, there is provided a video song matching device, the device comprising: an information extraction unit for obtaining target attribute information of a video material to be matched with a song in a video track of a video editing tool; a feature extraction unit for performing image recognition on said video material to determine image content features of the video material; a music matching recommendation unit for obtaining music matching options from a music library based on the target attribute information and the image content features; and an editing unit for compositing a user-selected target music matching option into the video material in response to a user's selection of the music matching option.

[0103] According to one or more embodiments of the present disclosure, the video material includes a plurality of sub-video clips, and the music matching recommendation unit, when obtaining music matching options from a music library based on the target attribute information and the image content features, includes: Obtaining correlation parameters between adjacent sub-video clips; and obtaining song matching options from a song library based on the correlation parameters, target attribute information and image content features of each sub-video clip.

[0104] According to one or more embodiments of the present disclosure, when obtaining song matching options from a song library based on the correlation parameters, target attribute information and image content features of each sub-video clip, the song matching recommendation unit: determining adjacent sub-video clips whose correlation parameter is greater than a predetermined threshold as a combination of sub-video clips; Integrating the target attribute information and the image content features of each sub-video clip in the combination of sub-video clips; and obtaining, based on the integrated target attribute information and image content features, song matching options from a song library as song matching options shared by each sub-video clip in the combination of sub-video clips.

[0105] According to one or more embodiments of the present disclosure, the music matching recommendation unit, when obtaining music matching options from a music library based on the integrated target attribute information and the image content features, comprises: determining a weight of each sub video clip in the combination of sub video clips based on predetermined attribute information of the sub video clips; Determining a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature based on a weight of each sub-video clip in the combination of the sub-video clips, where a sub-video clip with a larger weight has a larger weight of the target attribute information and image content feature; and obtaining song matching options from a song library based on the integrated target attribute information and image content features and corresponding weights.

[0106] According to one or more embodiments of the present disclosure, when obtaining song matching options from a song library according to the correlation parameters and the target attribute information and image content features of each sub-video clip, the song matching recommendation unit: If there are no adjacent sub-video clips whose correlation parameter is greater than a predetermined threshold, the target attribute information and image content features of each sub-video clip are used to respectively obtain song matching options corresponding to each sub-video clip from a song library.

[0107] According to one or more embodiments of the present disclosure, the video material includes a plurality of sub-video clips, and the music matching recommendation unit, when obtaining music matching options from a music library based on the target attribute information and the image content features, comprises: Integrating the target attribute information and the image content features of all sub-video clips; and obtaining song matching options from a song library as song matching options shared by all the sub-video clips based on the integrated target attribute information and image content features.

[0108] According to one or more embodiments of the present disclosure, the music matching recommendation unit, when obtaining music matching options from a music library based on the integrated target attribute information and the image content features, comprises: determining a weight for each sub video clip based on predetermined attribute information of the sub video clip; Determine a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature according to the weight of each sub-video clip, where a sub-video clip with a larger weight has a larger weight of the target attribute information and image content feature; and obtaining song matching options from a song library based on the integrated target attribute information and image content features and corresponding weights.

[0109] According to one or more embodiments of the present disclosure, when obtaining target attribute information of a video material to be matched with music in a video track of a video editing tool, the information extracting unit: extracting key attribute information from attribute information of the video material to be matched with the music; and obtaining derived attribute information based on the key attribute information, and determining the key attribute information and / or the derived attribute information as the target attribute information.

[0110] According to one or more embodiments of the present disclosure, when obtaining song matching options from a song library based on the target attribute information and the image content features, the song matching recommendation unit: The music library is used to search for a predetermined number of songs that match the target attribute information, the image content characteristics, and the current popularity information in a predetermined order of priority, and to determine them as music matching options.

[0111] According to one or more embodiments of the present disclosure, the predetermined priorities are, in descending order, target attribute information, image content features, and current popularity information.

[0112] According to one or more embodiments of the present disclosure, the editing unit, when compositing the user-selected target music matching option into the video material, The user's selected target music matching option is used to input the audio track corresponding to the video material and combine the audio track with the video track.

[0113] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, the device comprising: at least one processor; and a memory; the memory stores computer-executable instructions; The at least one processor executes computer-executable instructions stored in the memory, causing the at least one processor to perform the video music matching method described in the first aspect and various possible designs of the first aspect above.

[0114] In a fourth aspect, according to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, perform the video music matching method as set forth in the first aspect above and various possible designs of the first aspect.

[0115] In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided a computer program product comprising computer executable instructions which, when executed by a processor, perform the video music matching method as set forth in the first aspect above and various possible designs of the first aspect.

[0116] The above description merely describes preferred embodiments of the present disclosure and the technical principles employed. It should be understood by those skilled in the art that the scope of the present disclosure is not limited to a technical solution formed by a specific combination of the above technical features, but also covers other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the concept disclosed above. For example, it includes technical solutions formed by replacing the above features with (but not limited to) technical features having similar functions disclosed in the present disclosure.

[0117] Additionally, although operations are depicted using a particular order, this should not be construed as requiring that these operations be performed in the particular order shown, or that they be performed sequentially. Multitasking and parallel processing may be advantageous in certain environments. Similarly, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Some features described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, each feature described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable subcombination.

[0118] Although the present subject matter has been described using language specific to structural features and / or methodological operations, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms of implementing the claims.

Claims

1. Obtaining target attribute information of a video material to be matched with a music piece in a video track of a video editing tool; performing image recognition on the video footage to determine image content characteristics of the video footage; obtaining music matching options from a music library based on the target attribute information and the image content features; compositing a user-selected target music matching option into the video footage in response to a user indication of a selection of the music matching option; A video song matching method comprising:

2. the video material includes a plurality of sub-video clips; obtaining music matching options from a music library based on the target attribute information and the image content features; Obtaining correlation parameters between adjacent sub-video clips; obtaining song matching options from a song library based on the correlation parameters and the target attribute information and image content features of each sub-video clip; The method of claim 1 , comprising:

3. obtaining song matching options from a song library based on the correlation parameters and target attribute information and image content features of each sub-video clip; determining adjacent sub-video clips whose correlation parameter is greater than a predetermined threshold as a combination of sub-video clips; Integrating the target attribute information and the image content features of each sub-video clip in the combination of sub-video clips; Obtaining song matching options from a song library as song matching options shared by each sub-video clip in the combination of sub-video clips based on the integrated target attribute information and image content features; The method of claim 2 , comprising:

4. Obtaining song matching options from a song library based on the integrated target attribute information and image content features includes: determining a weight of each sub video clip in the combination of sub video clips based on predetermined attribute information of the sub video clips; Determining a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature based on a weight of each sub-video clip in the combination of the sub-video clips, where a sub-video clip with a larger weight has a larger weight of the target attribute information and image content feature; Obtaining song matching options from a song library based on the integrated target attribute information and image content features and corresponding weights; The method of claim 3, comprising:

5. obtaining song matching options from a song library based on the correlation parameters and target attribute information and image content features of each sub-video clip; if there are no adjacent sub-video clips whose correlation parameters are greater than a predetermined threshold, respectively obtaining song matching options corresponding to each sub-video clip from a song library based on the target attribute information and image content features of each sub-video clip; The method of claim 2 , comprising:

6. the video material includes a plurality of sub-video clips; obtaining music matching options from a music library based on the target attribute information and the image content features; Integrating the target attribute information and the image content features of all sub-video clips; Obtaining song matching options from a song library as song matching options shared by all the sub-video clips based on the integrated target attribute information and image content features; The method of claim 1 , comprising:

7. Obtaining song matching options from a song library based on the integrated target attribute information and image content features includes: determining a weight for each sub video clip based on predetermined attribute information of the sub video clip; Determine a weight of each target attribute information and image content feature in the integrated target attribute information and image content feature according to the weight of each sub-video clip, where a sub-video clip with a larger weight has a larger weight of the target attribute information and image content feature; Obtaining song matching options from a song library based on the integrated target attribute information and image content features and corresponding weights; The method of claim 6, comprising:

8. Obtaining target attribute information of a video material to be matched with a music piece in a video track of a video editing tool includes: extracting key attribute information from attribute information of the video material to be matched with the music; obtaining derived attribute information based on the key attribute information, and determining the key attribute information and / or the derived attribute information as the target attribute information; The method according to any one of claims 1 to 7, comprising:

9. obtaining music matching options from a music library based on the target attribute information and the image content features; searching the music library for a predetermined number of songs that match the target attribute information, the image content characteristics, and current popularity information in a predetermined order of priority, and determining the songs as music matching options; The method according to any one of claims 1 to 7, comprising:

10. The method of claim 9 , wherein the predetermined priorities are, in descending order, target attribute information, image content features, and current popularity information.

11. compositing user-selected target music matching options into the video material, inputting user-selected target music matching selections into an audio track corresponding to said video material so as to composite said audio track into said video track; The method according to any one of claims 1 to 7, comprising:

12. an information extraction unit for obtaining target attribute information of a video material to be matched with a song in a video track of a video editing tool; a feature extraction unit for performing image recognition on said video material to determine image content features of the video material; a music matching recommendation unit for obtaining music matching options from a music library based on the target attribute information and the image content features; an editing unit for compositing a user-selected target music matching option into said video material in response to a user's selection of the music matching option; A video music matching device comprising:

13. at least one processor and a memory; the memory stores computer-executable instructions; An electronic device, wherein the at least one processor executes computer-executable instructions stored in the memory to cause the at least one processor to perform the method of any one of claims 1 to 11.

14. A computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, cause the processor to perform the method of any one of claims 1 to 11.

15. A computer program product comprising computer executable instructions which, when executed by a processor, implements the method of any one of claims 1 to 11.

Images