Video generation method and device, electronic equipment, medium and program product

Through the interaction between the client and the server, the music video generation process is simplified, the problem of low-efficiency generation of music videos is solved, and a more convenient and efficient production process is achieved.

CN119071592APending Publication Date: 2024-12-03BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 0 Cites 7 Cited by

Patent Information

Application Number
CN202411223249.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-02
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The generation of music videos is inefficient, requiring professional knowledge and skills, resulting in a long production time and a high threshold.

Method used

It provides a video generation method, through the interaction between the client and the server, display the interface to obtain audio and lyrics text, and generate music videos based on attribute selection, simplifying the production process of music videos.

Benefits of technology

It lowers the threshold for producing music videos, improves generation efficiency, enables users to more intuitively select attributes and preview effects, and simplifies the production process of music videos.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071592A_ABST
    Figure CN119071592A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of computer vision, and discloses a video generation method and device, electronic equipment, a medium and a program product. The invention provides a video generation method, which is applied to a client and comprises the following steps: displaying a first interface in response to a video generation operation of a user; obtaining a target audio in response to an interactive operation of a user on an audio obtaining component on the first interface; in response to an interaction operation of a user on a confirmation component on the first interface, obtaining a target lyric text of the target audio and a first attribute, and displaying a second interface; a second attribute of the music video is displayed in an attribute selection area of the second interface, a target music video is displayed in a music video display area of the second interface, and the target music video is determined based on the target lyric text, the first attribute and the second attribute. Therefore, the video generation process is more convenient, the making threshold of the music video can be effectively reduced, and the making efficiency of the music video is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer vision technology, and in particular to a method, device, electronic device, medium, and program product for generating a video. Background Art

[0002] In related technologies, when producing music videos, producers need to have certain professional knowledge and skills to complete tasks such as lyrics production, axis calibration, material shooting, and audio and video editing. This requires a lot of time and energy, which leads to low video generation efficiency. Summary of the invention

[0003] In view of this, the present disclosure provides a video generation method, device, electronic device, medium and program product to solve the problem of low efficiency in music video generation.

[0004] In a first aspect, the present disclosure provides a method for generating a video, which is applied to a client, and the method includes:

[0005] In response to a user's video generation operation, displaying a first interface;

[0006] In response to a user's interactive operation on the audio acquisition component on the first interface, acquiring target audio;

[0007] In response to the user's interactive operation on the confirmation component on the first interface, the target lyrics text and the first attribute of the target audio are obtained, and a second interface is displayed, wherein the second interface includes an attribute selection area of ​​the music video and a music video display area;

[0008] The second attribute of the music video is displayed in the attribute selection area, and the target music video is displayed in the music video display area. The target music video is determined based on the target lyrics text, the first attribute and the second attribute.

[0009] In a second aspect, the present disclosure provides a method for generating a video, which is applied to a server, and the method includes:

[0010] receiving an execution request for a music video generation task sent by a client, and determining a target audio for music video generation;

[0011] Analyze the target audio, obtain the target lyrics text and the first attribute of the target audio, and send the target lyrics text and the first attribute to the client;

[0012] Determine secondary attributes of music videos;

[0013] A target music video is generated based on the target lyric text, the first attribute, and the second attribute, and the target music video is sent to the client in response to the execution request.

[0014] In a third aspect, the present disclosure provides a video generation device, which is applied to a client, and the device includes:

[0015] A first display module, configured to display a first interface in response to a video generation operation of a user;

[0016] A first processing module, configured to acquire target audio in response to a user's interactive operation on the audio acquisition component on the first interface;

[0017] A second display module, for obtaining target lyrics text and the first attribute of the target audio in response to the user's interactive operation on the confirmation component on the first interface, and displaying a second interface, wherein the second interface includes an attribute selection area for the music video and a music video display area;

[0018] The third display module is used to display the second attribute of the music video in the attribute selection area and display the target music video in the music video display area, where the target music video is determined based on the target lyrics text, the first attribute and the second attribute.

[0019] In a fourth aspect, the present disclosure provides a video generation device, which is applied to a server, and the device includes:

[0020] A second processing module is used to receive an execution request for a music video generation task sent by a client, and determine a target audio for music video generation;

[0021] The third processing module is used to analyze the target audio, obtain the target lyrics text and the first attribute of the target audio, and send the target lyrics text and the first attribute to the client;

[0022] A determination module, used to determine a second attribute of the music video;

[0023] The fourth processing module is used to generate a target music video based on the target lyrics text, the first attribute and the second attribute, and send the target music video to the client in response to the execution request.

[0024] In a fifth aspect, the present disclosure provides an electronic device, comprising: a memory and a processor, the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the video generation method of the above-mentioned first aspect or any corresponding embodiment thereof or the video generation method of the above-mentioned second aspect or any corresponding embodiment thereof by executing the computer instructions.

[0025] In a sixth aspect, the present disclosure provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the method for generating a video of the first aspect or any corresponding embodiment thereof, or the method for generating a video of the second aspect or any corresponding embodiment thereof.

[0026] In a seventh aspect, the present invention provides a computer program product, comprising computer instructions for causing a computer to execute the method for generating a video of the first aspect or any corresponding embodiment thereof, or the method for generating a video of the second aspect or any corresponding embodiment thereof.

[0027] The video generation method provided in this embodiment displays a first interface after the client receives the user's video generation operation, which helps to clarify the production entry of the music video, and then responds to the user's interactive operation on the audio acquisition component on the first interface to obtain the target audio, and responds to the user's interactive operation on the confirmation component on the first interface to obtain the target lyrics text and the first attribute of the target audio, which can understand the audio information of the target audio from multiple dimensions. Displaying a second interface, and displaying the second attribute of the music video in the attribute selection area of ​​the second interface, and displaying the generated target music video in the music video display area of ​​the second interface, can enable users to more intuitively select the attributes of the music video and preview the generation effect, thereby making the video generation process more convenient and convenient, and can effectively lower the threshold for music video production and improve the efficiency of music video production. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the specific embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0029] Figure 1 is a flowchart of a method for generating a video according to an embodiment of the present disclosure;

[0030] Figure 2 is a display schematic diagram of a first interface provided according to an embodiment of the present disclosure;

[0031] Figure 3 is a display schematic diagram of a second interface provided according to an embodiment of the present disclosure;

[0032] Figure 4 is a flowchart of another method for generating a video according to an embodiment of the present disclosure;

[0033] Figure 5 is a display schematic diagram of a third interface provided according to an embodiment of the present disclosure;

[0034] Figure 6 is a display schematic diagram of an attribute selection area provided according to an embodiment of the present disclosure;

[0035] Figure 7 is a display schematic diagram of another second interface provided according to an embodiment of the present disclosure;

[0036] Figure 8 is a flowchart of another method for generating a video according to an embodiment of the present disclosure;

[0037] Fig. 9 is a flowchart of another method for generating a video according to an embodiment of the present disclosure;

[0038] Fig.10 is a flowchart of a method for generating a video according to another embodiment of the present disclosure;

[0039] Fig.11 is a flowchart of a method for generating a video according to an embodiment of the present disclosure;

[0040] Fig.12 is a structural block diagram of another video generation device provided according to an embodiment of the present disclosure;

[0041] Fig.13 It is a schematic diagram of the hardware structure of the electronic device provided by the embodiment of the present disclosure. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.

[0043] In the related art, when making a music video, it is necessary to prepare lyrics in advance and calibrate the time axis of the lyrics content with the audio so that the lyrics content can correspond to the audio playback. In order to enrich the video screen, it is necessary to shoot the material separately, and then combine the audio with lyrics with the shooting material with the editing tool to obtain the desired music video, resulting in a high threshold for the production of music videos and a long production time.

[0044] In view of this, the embodiment of the present disclosure provides a method for generating a video, wherein after the client receives the user's video generation operation, a first interface is displayed. In response to the user's interactive operation on the audio acquisition component on the first interface, the target audio is acquired, and in response to the user's interactive operation on the confirmation component on the first interface, the target lyrics text and the first attribute of the target audio are acquired, and a second interface is displayed, and then the second attribute of the music video is displayed in the attribute selection area of ​​the second interface, and the generated target music video is displayed in the music video display area of ​​the second interface, so that the video generation process is more convenient and convenient, which can effectively lower the threshold for making music videos and improve the efficiency of making music videos.

[0045] As an optional application scenario of the video generation method provided in an embodiment of the present invention, a target music video is generated based on the interaction between a client and a server. The first interface and the second interface are both displayed on the electronic device where the client is located. The server is used to determine the target lyrics text and the first attribute of the target audio, and generate the target music video based on the target lyrics text, the first attribute and the second attribute.

[0046] According to an embodiment of the present disclosure, an embodiment of a method for generating a video is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0047] In this embodiment, a method for generating a video is provided, which can be used for the above-mentioned client, such as a tablet, a notebook, a computer, etc. Figure 1 is a flowchart of a method for generating a video according to an embodiment of the present disclosure, such as Figure 1 As shown, the process includes the following steps:

[0048] Step S101: In response to a user's video generation operation, a first interface is displayed.

[0049] The user's video generation operation can be understood as an instruction for requesting the generation of a music video. When the user's video generation operation is received, it indicates that the user currently has a demand for generating a music video, and therefore, the first interface is displayed to respond to the user's video generation operation.

[0050] The first interface can be understood as an entrance for guiding users to make music videos. By displaying the first interface, it is convenient for users to clearly know where to start the video generation process, and then perform targeted operations, which helps to improve generation efficiency.

[0051] Step S102, in response to the user's interactive operation on the audio acquisition component on the first interface, acquiring the target audio.

[0052] like Figure 2 As shown, the first interface has an audio acquisition component that can acquire audio files. The audio acquisition component can have a module or button for acquiring audio files, which can be set according to needs. In response to the user's interactive operation on the audio acquisition component on the first interface, the acquisition source of the audio file can be clarified, and then the audio file for generating the music video can be obtained therefrom to meet the user's personalized needs, and also provide a basis for subsequent music video production.

[0053] Step S103, in response to the user's interactive operation on the confirmation component on the first interface, the target lyrics text and the first attribute of the target audio are obtained, and the second interface is displayed.

[0054] like Figure 2 As shown, a confirmation component is pre-set on the first interface so that the target audio finally selected by the user can be clarified based on the interactive operation with the confirmation component. The confirmation component can be a button, an icon or other interactive interface elements, depending on the actual layout requirements.

[0055] In response to the user's interactive operation on the confirmation component on the first interface, it is determined that the acquired target audio can be used to produce a music video. Therefore, in order to improve the accuracy of video generation, the target lyrics text of the target audio and the first attribute of the target audio are respectively obtained to clarify the music content in the target audio according to the target lyrics text, and clarify the audio style of the target audio according to the first attribute, so as to understand the audio information of the target audio from multiple dimensions. Among them, the first attribute may include attribute information such as the music style, music rhythm, instruments involved, and their performance and combination in the music in the target audio. Music styles may include: pop, rock, classical, jazz, etc. Music rhythm may include: the beat and speed of the music, for example: fast or slow.

[0056] In some optional examples, the initial lyrics text of the target audio is obtained by processing a preset voice-to-text conversion model. In other optional examples, the initial lyrics text of the target audio is obtained by searching from a preset lyrics library based on audio name matching.

[0057] After responding to the user's interactive operation on the confirmation component on the first interface, the following is also displayed: Figure 3The second interface shown in the figure is used so that the user can quickly preview the generated effect of the video through the second interface. The second interface includes a music video attribute selection area and a music video display area. The attribute selection area is used to determine the second attribute of the music video. The second attribute includes but is not limited to the picture style, video resolution, video ratio, etc. of the music video, which can be determined according to the needs. The video display area is used to display the generated effect of the video.

[0058] Therefore, by displaying the second interface, the user can more intuitively select the attributes of the music video and preview the generated effect, which helps to improve the efficiency of determining the target music video.

[0059] Step S104: display the second attribute of the music video in the attribute selection area, and display the target music video in the music video display area.

[0060] Among them, the target music video is determined based on the target lyrics text, the first attribute and the second attribute, which helps to ensure that the generated target music video is more in line with the content expressed by the music in the target audio and the user's generation needs.

[0061] The video generation method provided in this embodiment displays a first interface after the client receives the user's video generation operation, which helps to clarify the production entry of the music video, and then responds to the user's interactive operation on the audio acquisition component on the first interface to obtain the target audio, and responds to the user's interactive operation on the confirmation component on the first interface to obtain the target lyrics text and the first attribute of the target audio, which can understand the audio information of the target audio from multiple dimensions. Displaying a second interface, and displaying the second attribute of the music video in the attribute selection area of ​​the second interface, and displaying the generated target music video in the music video display area of ​​the second interface, can enable users to more intuitively select the attributes of the music video and preview the generation effect, thereby making the video generation process more convenient and convenient, and can effectively lower the threshold for music video production and improve the efficiency of music video production.

[0062] In this embodiment, a method for generating a video is provided, which can be used for the above-mentioned client, such as a tablet, a notebook, a computer, etc. Figure 4 is a flowchart of a method for generating a video according to an embodiment of the present disclosure, such as Figure 4 As shown, the process includes the following steps:

[0063] Step S401: In response to the user's video generation operation, display the first interface. Figure 1 Step S101 of the illustrated embodiment will not be described in detail here.

[0064] Step S402: In response to the user's interactive operation on the audio acquisition component on the first interface, the target audio is acquired. Figure 1 Step S102 of the illustrated embodiment will not be described in detail here.

[0065] Step S403, in response to the user's interactive operation on the confirmation component on the first interface, the target lyrics text and the first attribute of the target audio are obtained, and the second interface is displayed.

[0066] Specifically, the above step S403 includes:

[0067] Step S4031, in response to the user's interactive operation on the confirmation component on the first interface, the initial lyrics text and the first attribute of the target audio are obtained, and the second interface is displayed.

[0068] Among them, the initial lyrics text can be understood as the lyrics text that has not been modified and edited.

[0069] Step S4032, in response to the user's interactive operation on the lyrics control in the second interface, the initial lyrics text is displayed in the third interface.

[0070] The lyrics control is a button or icon used to trigger the display of lyrics. Figure 2 As shown, a lyrics control is pre-set in the second interface to meet the user's need to view the lyrics of the target audio.

[0071] In response to the user's interactive operation on the lyrics control in the second interface, indicating that the user needs to view the lyrics of the target audio, the third interface is displayed, and the initial lyrics text is displayed through the third display interface so that the user can browse the lyrics content more intuitively and clearly.

[0072] Step S4033, in response to the modification operation on the initial lyrics text, the target lyrics text is displayed on the third interface.

[0073] Since the initial lyrics text obtained may be inconsistent with the actual lyrics content of the target audio or may not meet the user's needs, the third interface also has a function of modifying the initial lyrics text. In response to the modification operation on the initial lyrics text, the initial lyrics text is modified, and the modification result is displayed on the third interface to obtain the target lyrics text finally displayed on the third interface. The modification operation may include deleting, adding, replacing text, adjusting the paragraph structure of the lyrics, and modifying the rhythm of the lyrics, etc., depending on the actual modification operation. That is, the target lyrics text can be understood as the final lyrics text after the modification operation is performed on the initial lyrics text. Among them, the number of modification operations performed on the initial lyrics text can be determined according to user needs.

[0074] By allowing modification operations on the initial lyrics text, it can be ensured that the target lyrics text obtained meets the needs of the user. When the target lyrics text is subsequently used to generate a music video, the generated target music video can be more in line with the user's needs, thereby improving the user experience.

[0075] In some optional implementations, the interface diagram of the third interface is as follows: Figure 5 As shown, the initial lyrics text includes lyrics and lyrics playback time corresponding to each other. The modification operation includes any one or more of the following combined operations: lyrics modification operation, time modification operation. Among them, the lyrics modification operation is triggered in response to the user's interactive operation on the lyrics editing component in the third interface, and the time modification operation is triggered in response to the user's interactive operation on the time editing component in the third interface. The lyrics editing component is used to edit the initial lyrics text of the corresponding lyrics, and the time editing component is used to edit the corresponding lyrics playback time.

[0076] That is, in the third interface, each lyric has a corresponding lyric editing component that can be modified, and each lyric playback time has a corresponding time editing component that can be modified. By setting a plurality of lyric editing components and time editing components on the third interface, the modification of the initial lyric text can be made more flexible and easier to meet personalized needs, so that the target lyric text can be more consistent with the music in the target audio, so that the quality of the generated music video can be improved when it is generated later.

[0077] Step S404: display the second attribute of the music video in the attribute selection area, and display the target music video in the music video display area.

[0078] The video generation method provided in this embodiment responds to the interactive operation with the lyrics control in the second interface and displays the initial lyrics text in the third interface during the music video generation process, which can simultaneously meet the user's needs for viewing and modifying lyrics, thereby not only increasing the interactivity with the user, but also making the generated target music video more in line with user expectations in terms of lyrics, thereby effectively improving the overall generation quality of the music video.

[0079] In some optional embodiments, such as Figure 6 As shown, the attribute selection area includes at least one type of attribute selection control, and the method further includes:

[0080] Step a1, in response to the user's interactive operation on the attribute selection control, determining the attribute selection result of the corresponding type;

[0081] Step a2, obtaining the second attribute of the music video based on the attribute selection result of the corresponding type.

[0082] Specifically, in order to make the generated target music video better meet the needs of users, the generated effect of the video presentation can also be set in a targeted manner through the attribute selection control in the attribute selection area in the second interface.

[0083] Each property selection control includes a plurality of property options corresponding to its type. In response to the user's interactive operation on the property selection control, the currently selected property option can be clarified, and then the selected property option is used as the property selection result of the corresponding type of the property selection control. For example: if the property type corresponding to the property selection control is video ratio, the corresponding property options can be: 16:9, 4:3, 3:2, 1:1, 9:16, 3:4, 2:3. In response to the user's interactive operation on the property selection control, when it is determined that the selected property option is 16:9, 16:9 is used as the property selection result of the video ratio.

[0084] If the property type corresponding to the property selection control is video resolution, the corresponding property options may be: 240p, 360p, 480p, 720p, 1080p. In response to the user's interactive operation on the property selection control, when it is determined that the selected property option is 720p, 720p is used as the property selection result of the video resolution.

[0085] If the property type corresponding to the property selection control is subtitle color, the corresponding property options may be: gradient color, white. In response to the user's interactive operation on the property selection control, when it is determined that the selected property option is gradient color, the gradient color is used as the property selection result of the video resolution.

[0086] When the attribute selection area includes only one type of attribute selection control, the attribute selection result of the type corresponding to the attribute selection control is used as the second attribute of the music video. However, when the attribute selection area includes multiple types of attribute selection controls, the second attribute of the music video is a collection of multiple attribute selection results. In some optional examples, the richer the types of attribute selection controls, the more the ultimately generated music video fits the user's generation needs.

[0087] Based on the interactive operation with the attribute selection control, the second attribute of the music video is determined, so that the final target music video can be more diversified, thereby meeting the user's generation needs in different scenarios, thereby making the video generation method more flexible and more targeted.

[0088] In some optional embodiments, in combination Figure 2 The first interface shown in the figure, in response to the user's interactive operation on the audio acquisition component on the first interface, the process of acquiring the target audio includes:

[0089] Step b1, in response to the user's interactive operation on the audio acquisition component on the first interface, displaying the audio input interface;

[0090] Step b2, acquiring target audio in response to an input instruction to the audio input interface.

[0091] Specifically, the audio acquisition component is used to trigger the display of the audio input interface so that the user can provide audio-related access information through the audio input interface. In response to the user's interactive operation on the audio acquisition component on the first interface, it is determined that the user needs to specify the target audio to be acquired, and then the audio input interface is displayed.

[0092] In response to an input instruction to the audio input interface, the acquisition source of the target audio is clarified, and then the target audio is obtained from the acquisition source. The input instruction includes at least one of an audio name input instruction and an audio path input instruction.

[0093] For example: If the input command is an audio name input command, the acquisition source can be the audio playback history or the search history of the relevant music platform. If the input command is an audio path input command, the acquisition source can be the storage path of the target audio, the audio link shared in the instant message, or the audio link of the specified audio resource. The storage path of the target audio can be a folder on the local device (local storage path) or a specific location in the cloud storage service (cloud storage path).

[0094] By obtaining the target audio in the above manner, the interaction process can be clarified, allowing users to more easily provide the required audio to the client for processing, thereby making the user's operation more convenient and effectively reducing the user's time and energy consumption in searching for and selecting audio, thereby helping to promote the production progress of music videos and improve generation efficiency.

[0095] In some optional embodiments, such as Figure 7 As shown, the second interface includes a name modification control, and the second interface is also used to display the name of the target music video. The method also includes:

[0096] Step c1, in response to the user's interactive operation on the name modification control, obtaining the modified name of the target music video;

[0097] Step c2, displaying the modified name of the target music video on the second interface.

[0098] Specifically, in order to facilitate the user to more conveniently identify and manage the generated target music video, the name of the target music video is displayed on the second display interface.

[0099] If the user is not satisfied with the name of the target music video, the name can be modified based on the interactive operation with the name modification control. The client can respond to the user's interactive operation on the name modification control, clarify the modification content, and then obtain the modified name of the target music video, and display it through the second display interface, so as to not only meet the personalized setting of the music video name, but also enable the user to intuitively see the modified result.

[0100] Based on the same inventive concept, the present invention also provides a method for generating a video applied to the above-mentioned server.

[0101] In this embodiment, a method for generating a video is provided, which can be used in the above-mentioned service end, such as a server, a cloud platform, etc. Figure 8 is a flowchart of a method for generating a video according to an embodiment of the present disclosure, such as Figure 8 As shown, the process includes the following steps:

[0102] Step S801, receiving an execution request for a music video generation task sent by a client, and determining a target audio for music video generation.

[0103] The execution request is used to request the server to execute the music video generation task. After the server receives the execution request sent by the client, the task information related to the music video generation task can be identified through the execution request, and the target audio for music video production can be obtained from the task information. In some examples, the task information includes the target audio or the source of the target audio, so that when the server starts to execute the music video generation task, the target audio can be obtained smoothly, thereby ensuring that the music video generation task can be successfully executed.

[0104] Step S802: Analyze the target audio, obtain the target lyrics text and the first attribute of the target audio, and send the target lyrics text and the first attribute to the client.

[0105] In order to reduce the computing pressure of the client, after the target audio is obtained, the target audio is subjected to targeted analysis to determine the target lyrics text and the first attribute of the target audio according to the analysis result.

[0106] The target lyrics text may be obtained by analyzing the speech recognition technology, for example, by recognizing the lyrics in the target audio through a preset voice-to-text conversion model, and converting the recognized lyrics into text, thereby obtaining the target lyrics text.

[0107] The first attribute can be obtained by analyzing the audio features of the target audio. For example, the rhythm, melody, pitch, timbre, volume and other features of the target audio can be used as the first attribute. By analyzing these audio features, some descriptive information about the target audio can be obtained, such as brisk rhythm, beautiful melody, high pitch, soft timbre, loud volume, etc. Alternatively, the first attribute can also be defined and selected according to actual needs and application scenarios. For example, in music classification, the music style (such as pop, rock, classical, etc.) can be used as the first attribute.

[0108] After the analysis is completed, the server sends the obtained target lyrics text and the first attribute back to the client so that the client can understand the relevant information of the target audio and provide a reference for subsequent operations.

[0109] Step S803: determine the second attribute of the music video.

[0110] In order to improve the quality of video generation, the second attribute of the music video is determined, so as to clarify the generation effect of the target video through the second attribute, thereby making the generated target music video more in line with the expectations and needs of users.

[0111] The second attribute may include, but is not limited to, attributes such as the video generation style (such as romantic, dynamic, retro, etc.), picture style, color matching, and editing rhythm, which can be determined based on actual needs.

[0112] Step S804, generating a target music video based on the target lyrics text, the first attribute and the second attribute, and sending the target music video to the client in response to the execution request.

[0113] After the target lyrics text, the first attribute and the second attribute are clearly defined, the images, video clips and other materials related to the target lyrics text can be combined and edited by using video editing technology to match the first attribute of the target audio. At the same time, according to the requirements such as the picture style, color matching and editing rhythm determined by the second attribute, the generated music video can be further optimized and adjusted to generate a target music video that matches the target audio. After the target music video is generated, the server sends the target music video back to the client so that the client can display the generated target music video to the user through the second interface, thereby completing the response to the execution request.

[0114] The video generation method provided in this embodiment lays the foundation for subsequent video generation work by receiving the execution request of the client and determining the target audio. By analyzing the target audio to obtain the lyrics text and the first attribute and sending them to the client, the client can better understand the audio content, and also provide a basis for generating a music video that better meets the needs. Then, according to the determined second attribute of the music video, the generation style and characteristics of the video can be further clarified, so that based on the target lyrics text, the first attribute and the second attribute, the target music video is generated and sent to the client, which can not only meet the user's music video generation needs, but also improve the efficiency and quality of music video generation.

[0115] In some optional implementations, the process of generating a target music video based on the target lyrics text, the first attribute, and the second attribute includes:

[0116] Step d1, understanding the text content of the target lyrics text, and based on the first attribute and the text content, processing through a preset storyboard generation model to obtain video storyboard content;

[0117] Step d2, generating a target music video based on the video storyboard content, the target lyrics text and the second attribute.

[0118] Specifically, when understanding the text content of the target lyrics, it is necessary to conduct in-depth analysis of the meaning and theme of the lyrics. At the same time, combined with the first attributes of the target audio, such as rhythm and style, more reference information is provided for the storyboard generation model.

[0119] The preset storyboard generation model will generate a series of video storyboard contents based on the input text content and the first attribute, based on the capabilities of the large language model, using deep learning algorithms and image processing technology. These storyboard contents will be comprehensively considered based on factors such as the plot development of the lyrics, the rhythm of the music, and the atmosphere, including planning of the camera angle, scene, movement, and picture composition. For example, if the target lyrics text describes a cheerful scene, and the target audio has a fast rhythm and a lively style, then the storyboard generation model may generate some dynamic shots, such as fast-switching close-ups and close-ups, and dynamic camera movements.

[0120] After obtaining the video storyboard content, it is combined with the target lyrics text and the second attribute of the music video for further processing and optimization to select suitable images, video materials or create pictures corresponding to the storyboard through animation production, thereby generating the final target music video.

[0121] In some optional examples, the above step d1 includes:

[0122] Step d11, generating a storyboard picture according to the storyboard content of the video and the second attribute;

[0123] Step d12, establishing a correspondence between the lyrics and the storyboard images based on the lyrics playing time in the target lyrics text;

[0124] Step d13, generating a target music video through the corresponding relationship.

[0125] Specifically, since the second attribute may involve requirements in terms of video style, color, etc., which will affect the generation of storyboard images, storyboard images are first produced based on the video storyboard content and the second attribute, and then the corresponding relationship between lyrics and storyboard images is constructed according to the playback time of the lyrics in the target lyrics text, so as to ensure that the content of the lyrics and the storyboard images can be accurately matched in time, thereby enhancing the expressiveness and coherence of the music video. For example, the target audio is a pop song with a cheerful rhythm and a vibrant style, and the target lyrics text describes a scene in which A enjoys life to the fullest in the summer. According to the video storyboard content and the second attribute, when generating storyboard images, the obtained video storyboard content may include scenes such as A running on the beach, surfing, and playing games with friends. The second attribute stipulates that the overall style of the music video should be full of sunshine and vitality, with bright colors. The generated storyboard images can be as follows: one picture is A running happily on the golden beach, with the background of the azure sea and bright sunshine, and the picture is colorful and full of vitality. Another picture is A standing on a surfboard, galloping on the rough sea, with splashing waves, and the picture is full of dynamics. There is also a picture of friends sitting on the beach, laughing and talking. The picture is warm and full of life.

[0126] Therefore, with the help of the correspondence established previously, the final target music video is generated, so that the generated target music video can express the content of the target audio in a rich and accurate manner through the picture, thereby improving the generation quality and reliability of the video.

[0127] In other optional examples, the desired storyboard content can be obtained by extracting key elements from the target lyrics text for visual conversion. For example, by carefully analyzing the target lyrics text, extracting key elements such as characters, scenes, actions, etc., and then combining the second attribute, performing visual conversion processing through a preset storyboard generation model, and obtaining the desired storyboard image.

[0128] In some optional implementations, the process of determining the second attribute of the music video includes: receiving music attribute information sent by the client, and determining the second attribute of the music video according to the music attribute information. That is, the second attribute is determined by the client, thereby ensuring the reliability of the second attribute, so that the video generation process is more targeted and easier to meet the needs of users.

[0129] In this embodiment, a method for generating a video is provided, which can be used in the above-mentioned service end, such as a server, a cloud platform, etc. Fig. 9 is a flowchart of a method for generating a video according to an embodiment of the present disclosure, such as Fig. 9 As shown, the process includes the following steps:

[0130] Step S901, receiving an execution request for a music video generation task sent by a client, and determining a target audio for music video generation.

[0131] Step S902: Analyze the target audio, obtain the target lyrics text and the first attribute of the target audio, and send the target lyrics text and the first attribute to the client.

[0132] Step S903: determine the second attribute of the music video.

[0133] Step S904, generating a target music video based on the target lyrics text, the first attribute and the second attribute, and sending the target music video to the client in response to the execution request.

[0134] Step S905, in response to the received status query instruction, determining the current execution status of the music video generation task.

[0135] When the server receives the status query instruction from the client, it starts to check the current progress of the music video generation task. This execution status may include the following situations: 1. Preparing materials, such as collecting music files, lyrics text, and images or video clips that may be needed. 2. Storyboard design is in progress, and the various shots and pictures of the video are determined according to the content of the music and lyrics. 3. Video editing is in progress, combining the materials into a complete video and adding special effects, transitions, etc. 4. Generation has been completed, the music video has been produced, and is waiting for subsequent processing (such as compression, uploading, etc.). 5. Errors occurred during the generation process, such as material loss, software failure, etc., which made the task unable to continue.

[0136] The server will determine the current stage based on the actual task execution status and use this information as the current execution status.

[0137] In some optional examples, the client sends a status query instruction in a polling manner through the queryTask interface so as to timely understand the execution progress of the music video generation task.

[0138] Step S906, sending the current execution status to the client, so that the client can control the progress of the music video generation task executed by the server based on the current execution status.

[0139] After the server determines the current execution status of the music video generation task, it will send this information back to the client. After receiving this status information, the client can take corresponding actions as needed to control the task progress of the server.

[0140] In some optional examples, the process in which the client controls the progress of the server's execution of the music video generation task based on the current execution state includes: if the current execution state indicates that the music video generation task has failed to execute or the execution time is longer than the specified execution time threshold, then it indicates that there is an abnormality in the execution process of the music video generation task. Among them, the execution failure indicates that some error occurred during the music video generation process, resulting in the inability to complete the task normally. For example, material processing errors, software crashes, data loss, etc. The execution time is longer than the specified execution time threshold, indicating that the execution time of the music video generation task exceeds the expected reasonable time (specified execution time threshold). For example, due to freezes in certain links, excessive resource usage or other performance issues, the task progresses slowly.

[0141] Therefore, in order to reduce the waiting time of the client and improve the efficiency of generating the target video, the server is controlled to re-execute the music video generation task to avoid possible problems from continuously affecting the completion of the music video generation task.

[0142] In other optional examples, if the current execution state indicates that the music video generation task is successfully executed, the generated target music video is directly obtained. If the current execution state indicates that the execution time of the music video generation task is less than the specified execution time threshold, it indicates that there is no abnormality in the execution process of the music video generation task, and therefore, the music video generation task can be controlled to continue to execute until the target music video is obtained.

[0143] The video generation method provided in this embodiment can be based on the interaction between the client and the server, so that the client can better understand the progress of the server in executing the music video generation task, and facilitate targeted management of the execution of the music video generation task, thereby achieving the purpose of improving the video generation efficiency.

[0144] As one or more specific application embodiments of the present disclosure, Fig.10 As shown, after acquiring the target audio, the client sends the target audio to the server for lyrics recognition processing to obtain the target lyrics text, and determines the first attribute of the target audio through the server. Among them, the user can correct the target lyrics text of the target audio in the third interface of the client. Based on the first attribute and the text content, the preset storyboard generation model is used for processing to obtain the video storyboard content. Based on the video storyboard content, the target lyrics text and the second attribute, the target music video is generated.

[0145] The video generation method provided by the present invention is easy to operate, which not only lowers the threshold for making music videos and improves the production efficiency of music videos, but also enriches the generation effect of the video.

[0146] In this embodiment, a video generation device is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0147] This embodiment provides a video generation device, which is applied to a client, such as Fig.11 As shown, including:

[0148] The first display module 1101 is used to display a first interface in response to a video generation operation of a user;

[0149] The first processing module 1102 is used to obtain target audio in response to the user's interactive operation on the audio acquisition component on the first interface;

[0150] The second display module 1103 is used to obtain the target lyrics text and the first attribute of the target audio in response to the user's interactive operation on the confirmation component on the first interface, and display the second interface, the second interface including the attribute selection area of ​​the music video and the music video display area;

[0151] The third display module 1104 is used to display the second attribute of the music video in the attribute selection area, and display the target music video in the music video display area, where the target music video is determined based on the target lyrics text, the first attribute and the second attribute.

[0152] In some optional embodiments, the second display module 1103 includes: an acquisition unit, used to respond to the user's interactive operation on the confirmation component on the first interface, acquire the initial lyrics text and the first attribute of the target audio, and display the second interface; a display switching unit, used to respond to the user's interactive operation on the lyrics control in the second interface, and display the initial lyrics text on the third interface; an adjustment unit, used to display the target lyrics text on the third interface in response to the modification operation on the initial lyrics text.

[0153] In some optional embodiments, the initial lyrics text includes one-to-one corresponding lyrics and lyrics playback time, the modification operation includes a lyrics modification operation and / or a time modification operation, the lyrics modification operation is triggered in response to a user's interaction operation on a lyrics editing component in a third interface, and the time modification operation is triggered in response to a user's interaction operation on a time editing component in the third interface, the lyrics editing component is used to edit the initial lyrics text of the corresponding lyrics, and the time editing component is used to edit the corresponding lyrics playback time.

[0154] In some optional embodiments, the attribute selection area includes at least one type of attribute selection control, and the device also includes: a selection module for determining a corresponding type of attribute selection result in response to a user's interactive operation on the attribute selection control; and an attribute determination module for obtaining a second attribute of the music video based on the corresponding type of attribute selection result.

[0155] In some optional embodiments, the first processing module 1102 includes: a first processing unit, used to display an audio input interface in response to a user's interactive operation on an audio acquisition component on the first interface; a second processing unit, used to acquire target audio in response to an input instruction to the audio input interface, the input instruction including at least one of an audio name input instruction and an audio path input instruction.

[0156] In some optional embodiments, the second interface includes a name modification control, and the second interface is also used to display the name of the target music video. The device also includes: an adjustment module, which is used to obtain the modified name of the target music video in response to the user's interactive operation on the name modification control; and a fourth display module, which is used to display the modified name of the target music video on the second interface.

[0157] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0158] This embodiment provides a video generation device, which is applied to a server, such as Fig.12 As shown, including:

[0159] The second processing module 1201 is used to receive an execution request for a music video generation task sent by a client, and determine a target audio for music video generation;

[0160] The third processing module 1202 is used to analyze the target audio, obtain the target lyrics text and the first attribute of the target audio, and send the target lyrics text and the first attribute to the client;

[0161] A determination module 1203, configured to determine a second attribute of the music video;

[0162] The fourth processing module 1204 is used to generate a target music video based on the target lyrics text, the first attribute and the second attribute, and send the target music video to the client in response to the execution request.

[0163] In some optional embodiments, the fourth processing module 1204 includes: a third processing unit, used to understand the text content of the target lyrics text, and based on the first attribute and the text content, process it through a preset storyboard generation model to obtain video storyboard content; a video generation unit, used to generate a target music video based on the video storyboard content, the target lyrics text and the second attribute.

[0164] In some optional embodiments, the video generation unit includes: a first execution unit, used to generate a storyboard picture according to the video storyboard content and a second attribute; a second execution unit, used to establish a correspondence between lyrics and the storyboard picture based on the lyrics playback time in the target lyrics text; and a third execution unit, used to generate a target music video through the correspondence.

[0165] In some optional implementations, the determination module 1203 includes: an attribute determination unit, configured to receive music attribute information sent by a client, and determine a second attribute of the music video according to the music attribute information.

[0166] In some optional embodiments, the device also includes: a status detection module, used to determine the current execution status of the music video generation task in response to a received status query instruction; a sending module, used to send the current execution status to the client, so that the client can control the progress of the server's execution of the music video generation task based on the current execution status.

[0167] In some optional embodiments, a device for controlling the progress of a music video generation task executed by a server on a client based on a current execution state includes: a control module for controlling the server to re-execute the music video generation task if the current execution state indicates that the music video generation task has failed to execute or the execution time is greater than a specified execution time threshold.

[0168] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0169] The video generation device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0170] The present disclosure also provides an electronic device having the above Fig.11 Or a device for generating the video shown in 12.

[0171] See also Fig.13 , Fig.13 is a schematic diagram of the structure of an electronic device provided by an optional embodiment of the present disclosure, such as Fig.13 As shown, the electronic device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Fig.13 A processor 10 is taken as an example.

[0172] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0173] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0174] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0175] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0176] The electronic device further includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30 and the output device 40 may be connected via a bus or other means. Fig.13 The example of connecting through bus is taken in the following.

[0177] The input device 30 can receive input digital or character information, and generate key signal input related to the user settings and function control of the electronic device, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator rod, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The above-mentioned display device includes but is not limited to a liquid crystal display, a light emitting diode, a display and a plasma display. In some optional embodiments, the display device can be a touch screen.

[0178] The embodiments of the present disclosure also provide a computer-readable storage medium. The above-mentioned method according to the embodiments of the present disclosure can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium and downloaded through a network, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memory. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0179] A part of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the existence of the computer program instruction in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc., and accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium accessible to the computer.

[0180] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0181] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0182] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0183] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0184] Although the embodiments of the present disclosure have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present disclosure, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A method for generating a video, characterized in that: Applied to a client, the method comprises: In response to a user's video generation operation, displaying a first interface; In response to a user's interactive operation on the audio acquisition component on the first interface, acquiring target audio; In response to the user's interactive operation on the confirmation component on the first interface, the target lyrics text and the first attribute of the target audio are obtained, and a second interface is displayed, wherein the second interface includes an attribute selection area of ​​the music video and a music video display area; The second attribute of the music video is displayed in the attribute selection area, and a target music video is displayed in the music video display area, wherein the target music video is determined based on the target lyric text, the first attribute, and the second attribute.

2. The method according to claim 1, characterized in that The method of obtaining the target lyrics text and the first attribute of the target audio and displaying the second interface in response to the user's interactive operation on the confirmation component on the first interface comprises: In response to the user's interactive operation on the confirmation component on the first interface, obtaining the initial lyrics text and the first attribute of the target audio, and displaying the second interface; In response to a user's interactive operation on the lyrics control in the second interface, displaying the initial lyrics text in the third interface; In response to the modification operation on the initial lyrics text, the target lyrics text is displayed on the third interface.

3. The method according to claim 2, characterized in that The initial lyrics text includes one-to-one corresponding lyrics and lyrics playback time, the modification operation includes a lyrics modification operation and / or a time modification operation, the lyrics modification operation is triggered in response to a user's interaction operation on a lyrics editing component in the third interface, and the time modification operation is triggered in response to a user's interaction operation on a time editing component in the third interface, the lyrics editing component is used to edit the initial lyrics text of the corresponding lyrics, and the time editing component is used to edit the corresponding lyrics playback time.

4. The method according to claim 1, characterized in that: The attribute selection area includes at least one type of attribute selection control, and the method further includes: In response to a user's interactive operation on the attribute selection control, determining an attribute selection result of a corresponding type; Based on the attribute selection result of the corresponding type, a second attribute of the music video is obtained.

5. The method according to claim 1, characterized in that The step of acquiring target audio in response to the user's interactive operation on the audio acquisition component on the first interface includes: In response to a user's interactive operation on the audio acquisition component on the first interface, displaying an audio input interface; In response to an input instruction to the audio input interface, the target audio is acquired, wherein the input instruction includes at least one of an audio name input instruction and an audio path input instruction.

6. The method according to claim 1, characterized in that The second interface includes a name modification control, and the second interface is also used to display the name of the target music video. The method further includes: In response to a user's interactive operation on the name modification control, obtaining a modified name of the target music video; The modified name of the target music video is displayed on the second interface.

7. A method for generating a video, characterized in that: Applied to the server, the method includes: receiving an execution request for a music video generation task sent by a client, and determining a target audio for music video generation; Analyze the target audio, obtain target lyrics text and a first attribute of the target audio, and send the target lyrics text and the first attribute to the client; determining a second attribute of the music video; A target music video is generated based on the target lyrics text, the first attribute, and the second attribute, and the target music video is sent to the client in response to the execution request.

8. The method according to claim 7, characterized in that The step of generating a target music video based on the target lyrics text, the first attribute, and the second attribute includes: Understanding the text content of the target lyrics text, and based on the first attribute and the text content, processing through a preset storyboard generation model to obtain video storyboard content; The target music video is generated based on the video storyboard content, the target lyrics text and the second attribute.

9. The method according to claim 8, characterized in that The step of generating the target music video based on the video storyboard content, the target lyrics text and the second attribute includes: Generate a storyboard picture according to the storyboard content of the video and the second attribute; Based on the lyrics playing time in the target lyrics text, establishing a corresponding relationship between the lyrics and the storyboard pictures; The target music video is generated through the corresponding relationship.

10. The method according to claim 7, characterized in that The determining the second attribute of the music video comprises: The music attribute information sent by the client is received, and a second attribute of the music video is determined according to the music attribute information.

11. The method according to claim 7, characterized in that The method further comprises: In response to the received status query instruction, determining the current execution status of the music video generation task; The current execution status is sent to the client, so that the client can control the progress of the music video generation task executed by the server based on the current execution status.

12. The method according to claim 11, characterized in that The process of the client controlling the progress of the server in executing the music video generation task based on the current execution state includes: If the current execution status indicates that the music video generation task has failed to execute or the execution time is longer than a specified execution time threshold, the server is controlled to re-execute the music video generation task.

13. A video generation device, characterized in that: Applied to a client, the device comprises: A first display module, configured to display a first interface in response to a video generation operation of a user; A first processing module, configured to acquire target audio in response to a user's interactive operation on the audio acquisition component on the first interface; A second display module, configured to obtain the target lyrics text and the first attribute of the target audio in response to the user's interactive operation on the confirmation component on the first interface, and display a second interface, wherein the second interface includes an attribute selection area for the music video and a music video display area; A third display module is used to display the second attribute of the music video in the attribute selection area, and to display a target music video in the music video display area, wherein the target music video is determined based on the target lyrics text, the first attribute, and the second attribute.

14. A video generation device, characterized in that: Applied to the server, the device comprises: A second processing module is used to receive an execution request for a music video generation task sent by a client, and determine a target audio for music video generation; A third processing module is used to analyze the target audio, obtain a target lyrics text and a first attribute of the target audio, and send the target lyrics text and the first attribute to the client; A determination module, used to determine a second attribute of the music video; A fourth processing module is used to generate a target music video based on the target lyrics text, the first attribute and the second attribute, and send the target music video to the client in response to the execution request.

15. An electronic device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the video generation method described in any one of claims 1 to 6 or the video generation method described in any one of claims 7 to 12 by executing the computer instructions.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the video generation method according to any one of claims 1 to 6 or the video generation method according to any one of claims 7 to 12.

17. A computer program product, characterized in that The method comprises computer instructions for causing a computer to execute the video generation method according to any one of claims 1 to 6 or the video generation method according to any one of claims 7 to 12.

Citation Information

Cited By

  • Method, medium and device for automatically generating MV suitable for digital audio-visual place

    CN120564676A

  • Music video generation method and device, equipment and storage medium

    CN120568158A

  • Task generation method, storage medium, electronic equipment and program product

    CN121541949A

  • Video generation method and apparatus, electronic device, medium, and program product

    WO2026046234A1

  • Method and apparatus for generating music video, device, and storage medium

    WO2026144510A1