Blank filling type video generation interaction method

Abstract

The invention provides a blank-filling type video generation interaction method. The method comprises the steps that a user describes the requirement of the user for a video; a user selects a video template which most meets the requirements of the user from the video templates provided by the system and carries out personalized customization on the video template; based on the video template, the system prompts a user to fill information of key elements; key elements are automatically adjusted and optimized according to the overall style and demand of the video template; the user selects corresponding audios from a music library and a sound effect library provided by the system according to the theme and atmosphere of the video template; the system quickly generates a video version preview; a user provides feedback opinions for the system during watching and previewing, and the system optimizes and improves the preliminarily generated video; after multiple times of optimization and satisfaction confirmation of the user, the system generates a high-quality video. The method has the advantages that a user can be helped to quickly and conveniently produce a high-quality video, and particularly, a video production solution easy to operate is provided for users without professional video production skills.

Description

Technical Field

[0001] The present invention relates to the technical field of multimedia and human-computer interaction, and in particular to a fill-in-the-blank video generation interaction method. Background Art

[0002] Some existing video production tools only provide limited ways to input requirements, such as only fixed template options, and cannot allow users to describe their requirements in detail in various ways such as text input, making it difficult for users to accurately convey their specific requirements for the video.

[0003] When filling in the blanks of key elements, some tools may require users to provide materials in a specific format, which results in poor compatibility. In addition, they lack intelligent material matching functions and cannot automatically optimize the materials provided by users by performing size adaptation, color adjustment, clarity enhancement and other optimization processes, resulting in incomplete display of materials, inconsistent colors, unclear picture quality and other issues in the video. Summary of the invention

[0004] The purpose of the present invention is to provide a fill-in-the-blank video generation interactive method, thereby solving the above-mentioned problems existing in the prior art.

[0005] In order to achieve the above object, the technical solution adopted by the present invention is as follows:

[0006] A fill-in-the-blank video generation interactive method comprises the following steps:

[0007] S1. Demand input: The user describes his / her demand for the video in the system display interface, including the theme, duration, and target audience of the video;

[0008] S2, template customization: the system provides a series of suitable video templates for the user according to the needs input by the user. The user selects a video template that best meets his needs and customizes the video template to obtain the final video template;

[0009] S3, key element filling: based on the final video template, the system prompts the user to fill in the key element information;

[0010] S4, Intelligent material matching: The system uses intelligent algorithms to analyze and process the key elements provided by users, and automatically adjusts and optimizes the key elements according to the overall style and requirements of the final video template;

[0011] S5, audio selection and editing: the user selects the corresponding audio from the music library and sound effect library provided by the system according to the subject and atmosphere of the final video template;

[0012] S6. Video generation preview: The system uses a pre-written video generation algorithm to quickly generate a preliminary video version preview, and the user can view the overall effect of the preliminary generated video in the preview;

[0013] S7, User feedback and optimization: After watching the preview, the user provides feedback to the system, and the system optimizes and improves the initially generated video based on the user's feedback;

[0014] S8, video generation: After multiple optimizations and user confirmation, the system will finally integrate all elements and settings to generate high-quality videos.

[0015] Preferably, the method for the user to input requirements in step S1 includes text input, selection box, and drop-down menu;

[0016] During the text input process, the system analyzes and prompts the user's input in real time, guiding the user to describe the needs more accurately;

[0017] During the input process of the selection box or drop-down menu, the system dynamically adjusts the content of other options based on the option selected by the user to guide the user to describe their needs more accurately.

[0018] Preferably, in step S2, the personalized customization of the video template includes adjusting the scene sequence, element layout, and color matching in the video template.

[0019] Preferably, in step S3, the key elements include text content and / or pictures and / or video clips; the text content includes titles, texts, and lines; the pictures include product pictures and character photos; and the video clips are video clips of specific scenes;

[0020] When users upload pictures, the system can automatically identify the resolution and format of the pictures and give suggestions on whether the pictures need to be adjusted.

[0021] Preferably, in step S3, when selecting elements from the material library, the system can make intelligent recommendations based on the key elements filled in by the user.

[0022] Preferably, in step S4, adjusting and optimizing the key elements specifically includes the following contents:

[0023] S41. If the color of the image does not match the overall style of the video, the system will automatically adjust the color balance, contrast and brightness to make the image blend into the video more naturally;

[0024] S42. For size adaptation, the system will crop, scale or stretch the image according to the resolution and layout requirements of the video to ensure that the image will not be deformed or have black edges in the video;

[0025] S43. If the image clarity is not enough, the system uses image enhancement algorithm to improve the image clarity and sharpness;

[0026] S44. For video clips, the system will analyze the content and rhythm of the video and automatically add appropriate transition effects to make the transition between video clips smoother;

[0027] S45. If the duration of the video clip is too long or too short, the system will edit and splice it to meet the overall duration requirement of the video;

[0028] S46. The system adjusts the color and contrast of the video according to the style of the video to make it consistent with other elements.

[0029] Preferably, in step S5,

[0030] The music in the system's music library is classified according to different styles, emotions and themes. Users can choose appropriate music from the corresponding categories according to the theme and atmosphere of the video;

[0031] The system sound effect library includes a variety of sound effects, and users can add appropriate sound effects based on the video content;

[0032] Users use audio editing software to edit music and sound effects through timeline operations, and mix them by adjusting the volume slider to obtain ideal audio effects.

[0033] Preferably, in step S6, the overall effect includes the smoothness of the picture, the coordination of elements, and the synchronization of audio and video;

[0034] The user checks whether the video playback is smooth and whether there is any lag or frame skipping. If the video playback is not smooth, the system optimizes the video encoding and playback algorithms.

[0035] The user checks whether each element in the video is consistent with the overall style and whether the layout is reasonable; if any inconsistency is found, return to step S2 and step S3 to make adjustments;

[0036] The user checks whether the content and rhythm of the audio and video match, and whether there is any audio advance or lag; if it is found that the audio and video are not synchronized, the system uses timestamp technology to synchronize the audio and video.

[0037] Preferably, in step S7,

[0038] When the user points out the problem of unclear picture, the system checks whether the resolution of the element is high enough, or whether excessive compression occurs during the video generation process. If it is an element problem, the user replaces the element with a higher resolution; if it is a compression problem, the system adjusts the video compression parameters to improve the picture quality; if the above problems are eliminated and the picture is still unclear, the system uses an image enhancement algorithm to improve the clarity of the element.

[0039] When users point out that the transition between elements is unnatural, the system optimizes the algorithm of the transition effect to make the switching between elements smoother.

[0040] Preferably, in step S8, the system will record the user's video generation process and analyze the user's preferences; the system will save the user's generation records and preferences to provide more accurate services and suggestions for the user's subsequent video generation.

[0041] The beneficial effects of the present invention are: the present invention greatly lowers the threshold for video production, improves video production efficiency, and enables non-professional users to easily create high-quality videos that meet their needs. The diversified output formats and personalized services provide users with more convenience and have broad application prospects and commercial value. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 is a flow chart of a method in an embodiment of the present invention. DETAILED DESCRIPTION

[0043] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation methods described herein are only used to explain the present invention and are not used to limit the present invention.

[0044] like Figure 1 As shown, in this embodiment, a fill-in-the-blank video generation interactive method is provided, including the following parts:

[0045] 1. Demand Input

[0046] Users can describe their general needs and expectations for the video in the interface, including basic information such as the video's theme, style, length, target audience, etc. The needs can be input using text input, selection boxes, drop-down menus, etc., to ensure that the needs are expressed clearly and unambiguously.

[0047] (1) During the text input process, the system can analyze and prompt the user's input content in real time. For example, when the user enters the video theme as "travel guide", the system can automatically pop up some relevant style suggestions, such as "fresh and natural style" and "energetic and adventurous style", to guide the user to describe the needs more accurately.

[0048] (2) For selection boxes and drop-down menus, the system can dynamically adjust the content of other options based on the options selected by the user. For example, if the user selects the video type as "advertisement", the target audience in the drop-down menu may automatically display some audience groups that are more suitable for the advertisement, such as "consumers" and "potential customers".

[0049] 2. Template customization

[0050] The system provides users with a series of suitable video templates based on the input requirements. These templates cover various common video types, such as advertising, education, entertainment, etc., and have different styles and structures. Users can choose a template that best suits their needs and then customize it. For example, adjust the scene order, element layout, color matching, etc. in the template.

[0051] When viewing a template preview, users can pause, play, fast forward, rewind, and other operations to carefully observe the details of the template, including scene switching methods, text animation effects, background music, etc. If users are not satisfied with some elements of a template, such as feeling that the colors are too bright, they can make adjustments immediately after selecting the template, such as reducing the color saturation or changing the color theme.

[0052] 3. Fill in the blanks of key elements

[0053] Based on the selected template, the system will prompt users to fill in the key elements, which can be text content, such as titles, copywriting, lines, etc.; or images or video clips, such as product pictures, photos of people, videos of specific scenes, etc. For example, when filling in the title, the system can give some popular title formats and styles to help users conceive more attractive titles.

[0054] When users upload images, the system can automatically identify the resolution and format of the image and give suggestions on whether it needs to be adjusted. If the image resolution is too low, the system can remind users that it may affect the video quality and provide some methods to increase the resolution or suggest using other higher quality image elements.

[0055] When selecting elements from the material library, the system can make intelligent recommendations based on the key elements that the user has filled in. For example, if the user's video theme is "food making", the material library will give priority to recommending pictures and video clips related to food, such as ingredients, cooking process, delicious finished products, etc.

[0056] 4. Intelligent material matching

[0057] When the user completes the key elements, the system will use intelligent algorithms to analyze and process the elements provided by the user. According to the overall style and needs of the video, the system will automatically adjust and optimize the elements, such as size adaptation, color adjustment, clarity enhancement, etc., to ensure that the elements are presented in the best effect in the video. The adjustment and optimization specifically include the following contents:

[0058] (1) If the color of the image does not match the overall style of the video, the system will automatically adjust parameters such as color balance, contrast, and brightness to make the image blend into the video more naturally;

[0059] (2) For size adaptation, the system will crop, scale, or stretch the image according to the resolution and layout requirements of the video to ensure that the image does not appear deformed or have black edges in the video;

[0060] (3) If the image clarity is not enough, the system can use image enhancement algorithms to improve the image clarity and sharpness;

[0061] (4) For video clips, the system will analyze the content and rhythm of the video and automatically add appropriate transition effects to make the transition between video clips smoother;

[0062] (5) If the duration of the video clip is too long or too short, the system can edit and splice it to meet the overall duration requirement of the video;

[0063] (6) At the same time, the system will adjust the color and contrast of the video according to the style of the video to make it consistent with other elements.

[0064] 5. Audio Selection and Editing

[0065] Users can choose the right audio for their videos. The system provides a rich library of music and sound effects, and users can choose the appropriate audio according to the theme and atmosphere of the video. At the same time, users can also use audio editing software to edit through timeline operations and mix by adjusting the volume slider to achieve the ideal audio effect.

[0066] (1) The system's music library is classified according to different styles, emotions and themes, such as happy, sad, tense, romantic, etc., as well as specific music types such as pop, classical, electronic, etc. Users can select appropriate music from the corresponding categories based on the theme and atmosphere of the video. For example, a sports-themed video can choose music with a brisk rhythm and vitality.

[0067] (2) The sound effects library contains various common sound effects, such as natural sounds (wind, rain, waves, etc.), animal calls, mechanical sounds, etc. Users can add appropriate sound effects based on the content of the video to enhance the realism and fun of the video. For example, add bird calls and flowing water sounds to a video of an outdoor adventure.

[0068] 6. Video generation preview

[0069] After completing steps 1 to 5, the system will use the pre-written video generation algorithm to quickly generate a preliminary video version preview, in which users can view the overall effect of the video, including the smoothness of the picture, the coordination of elements, the synchronization of audio and video, etc. If the user is not satisfied with the preview result, he can return to the previous step to modify and adjust it.

[0070] (1) Picture smoothness: Users observe whether the video playback is smooth and whether there is any lag or frame skipping. This mainly depends on the frame rate of the video and the processing power of the system. If the video is not smooth, the system may need to optimize the video encoding and playback algorithms.

[0071] (2) Element coordination: Check whether the various elements in the video, such as text, pictures, icons, etc., are consistent with the overall style and whether the layout is reasonable. If any inconsistency is found, the user can return to steps 2 and 3 to make adjustments.

[0072] (3) Synchronization of audio and video: Ensure that the content and rhythm of the audio and video match, and there is no audio advance or lag. The system uses timestamp technology to achieve audio and video synchronization.

[0073] 7. User Feedback and Optimization

[0074] After watching the preview, users can provide feedback to the system. The system will further optimize and improve the video based on the user's feedback. For example, based on the problems pointed out by users, such as unclear images and unnatural element transitions, targeted adjustments and optimizations will be made.

[0075] (1) Unclear picture: After the user points out the problem of unclear picture, the system can check whether the resolution of the element is high enough or whether excessive compression occurred during the video generation process. If it is an element problem, the user can replace the element with a higher resolution; if it is a compression problem, the system can adjust the video compression parameters to improve the picture quality. After eliminating other problems, if the picture is still unclear, the system uses image enhancement algorithms to improve the clarity of the element.

[0076] (2) Unnatural transition of elements: To solve the problem of unnatural transition of elements, the system can optimize the algorithm of transition effect. For example, it can add transition effects such as fade-in, slide, and rotation to make the switching between elements smoother.

[0077] 8. Video Generation

[0078] After multiple optimizations and user confirmation, the system will integrate all elements and settings to generate the final high-quality video. During this process, the system will use more sophisticated video encoding and compression algorithms to ensure that the quality and size of the video meet the requirements.

[0079] (1) The system provides a variety of output formats and resolution options to facilitate users to download, share or use on different platforms and scenarios.

[0080] (2) The system will record the user's generation process, including selected templates, uploaded elements, audio selections, editing operations, etc. At the same time, it will also analyze the user's preferences, such as favorite styles and commonly used element types.

[0081] The system will save the user's generation records and preferences in order to provide more accurate services and suggestions for the user's subsequent video generation. These records and preferences can be used to provide more accurate services and suggestions for the user's subsequent video generation. For example, the next time the user uses the system again, the system can recommend similar templates and elements based on the user's history records to improve the user's production efficiency.

[0082] By adopting the above technical solution disclosed in the present invention, the following beneficial effects are obtained:

[0083] The present invention provides a fill-in-the-blank video generation interactive method, which greatly lowers the threshold for video production and improves video production efficiency, so that non-professional users can easily create high-quality videos that meet their needs. Diversified output formats and personalized services provide users with more convenience and have broad application prospects and commercial value.

[0084] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be considered as the scope of protection of the present invention.

Claims

1. A fill-in-the-blank video generation interactive method, characterized in that: The following steps are included: S1. Demand input: The user describes his / her demand for the video in the system display interface, including the theme, duration, and target audience of the video; S2, template customization: the system provides a series of suitable video templates for the user according to the needs input by the user. The user selects a video template that best meets his needs and customizes the video template to obtain the final video template; S3, key element filling: based on the final video template, the system prompts the user to fill in the key element information; S4, Intelligent material matching: The system uses intelligent algorithms to analyze and process the key elements provided by users, and automatically adjusts and optimizes the key elements according to the overall style and requirements of the final video template; S5, audio selection and editing: the user selects the corresponding audio from the music library and sound effect library provided by the system according to the subject and atmosphere of the final video template; S6. Video generation preview: The system uses a pre-written video generation algorithm to quickly generate a preliminary video version preview, and the user can view the overall effect of the preliminary generated video in the preview; S7, User feedback and optimization: After watching the preview, the user provides feedback to the system, and the system optimizes and improves the initially generated video based on the user's feedback; S8, video generation: After multiple optimizations and user confirmation, the system will finally integrate all elements and settings to generate high-quality videos.

2. The fill-in-the-blank video generation interactive method according to claim 1, characterized in that: In step S1, the user inputs the requirements in the form of text input, selection box, and drop-down menu; During the text input process, the system analyzes and prompts the user's input in real time, guiding the user to describe the needs more accurately; During the input process of the selection box or drop-down menu, the system dynamically adjusts the content of other options based on the option selected by the user to guide the user to describe their needs more accurately.

3. The fill-in-the-blank video generation interactive method according to claim 1, characterized in that: In step S2, the personalized customization of the video template includes adjusting the scene sequence, element layout, and color matching in the video template.

4. The fill-in-the-blank video generation interactive method according to claim 1, characterized in that: In step S3, the key elements include text content and / or pictures and / or video clips; the text content includes titles, texts, and lines; the pictures include product pictures and character photos; and the video clips are video clips of specific scenes; When users upload pictures, the system can automatically identify the resolution and format of the pictures and give suggestions on whether the pictures need to be adjusted.

5. The fill-in-the-blank video generation interactive method according to claim 1, characterized in that: In step S3, when selecting elements from the material library, the system can make intelligent recommendations based on the key elements filled in by the user.

6. The fill-in-the-blank video generation interactive method according to claim 1, characterized in that: In step S4, the key elements are adjusted and optimized, including the following contents: S41. If the color of the image does not match the overall style of the video, the system will automatically adjust the color balance, contrast and brightness to make the image blend into the video more naturally; S42. For size adaptation, the system will crop, scale or stretch the image according to the resolution and layout requirements of the video to ensure that the image will not be deformed or have black edges in the video; S43. If the image clarity is not enough, the system uses image enhancement algorithm to improve the image clarity and sharpness; S44. For video clips, the system will analyze the content and rhythm of the video and automatically add appropriate transition effects to make the transition between video clips smoother; S45. If the duration of the video clip is too long or too short, the system will edit and splice it to meet the overall duration requirement of the video; S46. The system adjusts the color and contrast of the video according to the style of the video to make it consistent with other elements.

7. The fill-in-the-blank video generation interactive method according to claim 1, characterized in that: In step S5, The music in the system's music library is classified according to different styles, emotions and themes. Users can choose appropriate music from the corresponding categories according to the theme and atmosphere of the video; The system sound effect library includes a variety of sound effects, and users can add appropriate sound effects based on the video content; Users use audio editing software to edit music and sound effects through timeline operations, and mix them by adjusting the volume slider to obtain ideal audio effects.

8. The fill-in-the-blank video generation interactive method according to claim 1, characterized in that: In step S6, the overall effect includes the smoothness of the picture, the coordination of elements, and the synchronization of audio and video; The user checks whether the video playback is smooth and whether there is any lag or frame skipping. If the video playback is not smooth, the system optimizes the video encoding and playback algorithms. The user checks whether each element in the video is consistent with the overall style and whether the layout is reasonable; if any inconsistency is found, return to step S2 and step S3 to make adjustments; The user checks whether the content and rhythm of the audio and video match, and whether there is any audio advance or lag; if it is found that the audio and video are not synchronized, the system uses timestamp technology to synchronize the audio and video.

9. The fill-in-the-blank video generation interactive method according to claim 1, characterized in that: In step S7, When the user points out the problem of unclear picture, the system checks whether the resolution of the element is high enough, or whether it is over-compressed during the video generation process. If it is an element problem, the user replaces the element with a higher resolution; If it is a compression problem, the system adjusts the video compression parameters to improve the picture quality; if the picture is still unclear after eliminating the above problems, the system uses image enhancement algorithms to improve the clarity of the elements. When users point out that the transition between elements is unnatural, the system optimizes the algorithm of the transition effect to make the switching between elements smoother.

10. The fill-in-the-blank video generation interactive method according to claim 1, characterized in that: In step S8, the system will record the user's video generation process and analyze the user's preferences; the system will save the user's generation records and preferences in order to provide more accurate services and suggestions for the user's subsequent video generation.

Images