Short video generation method, system and terminal

Abstract

The invention relates to a short video generation method and system and a terminal, and relates to the technical field of video production, and the method comprises the steps: obtaining image material information and short video demand information uploaded by a common user; calling demand style information and a demand duration value based on the short video demand information; determining material demand characteristics according to the demand style information; performing identification according to the material demand features and the image material information to determine selected material information; calling style demand material information from a preset video material library based on the demand style information, and combining the selected material information with the style demand material information to form use material information; and synthesizing and editing the use material information according to the demand style information and the demand duration value to generate short video output information, and outputting the short video output information to a terminal held by a common user for display. The method and the device have the effect of facilitating a common user to make the short video.

Description

Technical Field

[0001] The present invention relates to the technical field of video production, and in particular to a short video generation method, system and terminal. Background Art

[0002] With the rapid development of products and technologies in the field of mobile Internet, short video products of mobile Internet have become the most advanced and popular ecology in the current Internet industry. The creation and dissemination of short video content is an important means and method to provide content services to Internet users.

[0003] Currently, when producing short videos, producers generally need to formulate a detailed shooting plan based on the script or outline, and use different shooting techniques to create unique visual effects, create an atmosphere suitable for the storyline, collect materials, and then import the captured video and audio materials into special video editing software, edit and sort the materials, add video effects and special effects as needed, adjust audio materials, choose suitable background music and sound effects, enhance the viewing experience, and then choose to publish and share short videos on different social media platforms.

[0004] Because in the process of making short videos, producers need to import the captured video and audio materials into special video editing software for production, and special video editing software requires producers to master certain editing, audio processing and other technical and artistic skills, which makes it inconvenient for ordinary users to make short videos. Summary of the invention

[0005] In order to facilitate ordinary users to make short videos, the present invention provides a short video generation method, system and terminal.

[0006] In a first aspect, the present invention provides a short video generation method, which adopts the following technical solution: A short video generation method, comprising: Obtain image material information and short video demand information uploaded by ordinary users; Based on the short video demand information, the required style information and required duration value are retrieved; Determine the material requirements based on the required style information; Identify and select material information based on material requirement characteristics and image material information; Based on the required style information, retrieve the style required material information from the preset video material library, and combine the selected material information with the style required material information to form the used material information; The material information is synthesized and edited according to the required style information and the required duration value to generate short video output information, and the short video output information is output to a terminal held by an ordinary user for display.

[0007] Optionally, methods for determining material requirement characteristics include: Retrieve style vocabulary based on required style information; According to the correspondence between the style vocabulary and the preset synonymous vocabulary, the synonymous vocabulary corresponding to the style vocabulary is determined; Determine the synonymous comprehensive vocabulary based on the style vocabulary and synonyms; According to the correspondence between the synonymous comprehensive vocabulary and the preset style-related vocabulary, the style-related vocabulary corresponding to the synonymous comprehensive vocabulary is determined; Based on the synonymous comprehensive vocabulary and style-related vocabulary, a style comprehensive vocabulary is formed; According to the correspondence between the style comprehensive vocabulary and the preset style material features, the style material features corresponding to the style comprehensive vocabulary are determined, and the style material features are used as the material demand features.

[0008] Optionally, the method for determining the synonymous comprehensive vocabulary includes: Determine whether there is only one style word; If yes, then summarize and form a synonymous comprehensive vocabulary based on the style vocabulary and synonyms; If not, then based on the consistency between the style vocabulary and the synonymous vocabulary, the consistent vocabulary is determined; When consistent vocabulary does not exist, style vocabulary and synonyms are aggregated to form a comprehensive synonym vocabulary; When consistent vocabulary exists, the style vocabulary is adjusted based on the consistent vocabulary and used as the style adjustment vocabulary; According to the correspondence between the style adjustment vocabulary and the preset synonym adjustment vocabulary, the synonym adjustment vocabulary corresponding to the style adjustment vocabulary is determined; Based on the style adjustment vocabulary and the synonym adjustment vocabulary, they are summarized and formed into a synonym comprehensive vocabulary.

[0009] Optionally, the method for determining the selected material information includes: Based on the material requirement features, identification and matching are performed from the image material information to form matching material information; Determine matching remaining information according to the image material information and the matching material information; Retrieving remaining image features based on matching remaining information; Determine feature association values ​​based on remaining image features and material requirement features; Determine whether the feature association value is greater than a preset association reference value; If yes, then selecting the matching residual information corresponding to the remaining image features based on the feature association value to obtain image selection information; Based on the matching material information and the image selection information, the information is combined and used as the selected material information; If not, the matching material information will be used as the selected material information.

[0010] Optionally, a method for determining a feature association value includes: According to the correspondence between the material demand characteristics and the preset demand local characteristics, the demand local characteristics corresponding to the material demand characteristics are determined; Determine whether the remaining image features are consistent with the required local features; If yes, then determine the feature similarity value based on the required local features; According to the correspondence between the feature similarity value and the preset similarity association value, a similarity association value corresponding to the feature similarity value is determined, and the similarity association value is used as the feature association value; If not, then according to the correspondence between the material demand feature and the preset demand feature type information, determine the demand feature type information corresponding to the material demand feature; Determining the residual feature type information corresponding to the residual image feature according to the correspondence between the residual image feature and the preset residual feature type information; The category association value is determined according to the required feature category information and the remaining feature category information, and the category association value is used as the feature association value.

[0011] Optionally, a method for determining a category-related value includes: Determine whether the required feature type information is consistent with the remaining feature type information; If yes, the preset category consistent association value is output as the category association value; If not, then determining the category initial association value corresponding to the required feature category information and the remaining feature category information according to the correspondence between the required feature category information, the remaining feature category information and the preset category initial association value; When the category initial association value is greater than the preset category base association value, the category initial association value is used as the category association value; When the category initial association value is not greater than the preset category base association value, determining the demand-associated category information corresponding to the demand-associated category information according to the correspondence between the demand-associated category information and the preset demand-associated category information; According to the correspondence between the demand-related category information, the remaining feature category information and the preset category secondary association value, the category secondary association value corresponding to the demand-related category information and the remaining feature category information is determined; The sum of the initial association value of the category and the secondary association value of the category is calculated and used as the comprehensive association value of the category, and the comprehensive association value of the category is used as the category association value.

[0012] Optionally, the method for generating short video output information includes: According to the correspondence between the required style information and the preset style duration value, the style duration value corresponding to the required style information is determined; Calculate the difference between the required duration value and the style duration value and use it as the duration remaining value; According to the correspondence between the used material information and the preset material duration value, the material duration value corresponding to the used material information is determined; Determine whether the material duration value is greater than the remaining duration value; If yes, then calculate the ratio between the material duration value and the remaining duration value and use it as the material duration ratio value; Based on the material duration ratio value, the material information is adjusted and synthesized and edited to generate short video output information; If not, the difference between the material duration value and the duration remaining value is calculated and used as the duration missing value; Determine the remaining material information according to the selected material information and the image material information; Determine the duration and supplement the material information based on the missing duration value and the remaining material information; The supplementary material information is combined with the used material information according to the duration and synthesized and edited to generate short video output information.

[0013] Optionally, the method for determining the duration supplementary material information includes: Determine the remaining material duration value corresponding to the remaining material information according to the correspondence between the remaining material information and the preset remaining material duration value; Calculate the ratio between the remaining material duration value and the missing duration value and use it as the remaining material ratio value; According to the correspondence between the remaining material ratio value and the preset remaining material ratio influence value, the remaining material ratio influence value corresponding to the remaining material ratio value is determined; Retrieving remaining material features based on remaining material information; Determine the remaining correlation value based on the remaining material characteristics and the material demand characteristics; According to the correspondence between the residual correlation value and the preset residual correlation influence value, the residual correlation influence value corresponding to the residual correlation value is determined; Calculate the sum of the remaining material proportion impact value and the remaining associated impact value and use it as the remaining material comprehensive impact value; The remaining materials are sorted from large to small based on their comprehensive impact values, and the remaining material information is selected according to the sorting results and the missing values ​​of the duration to form material selection information, and the material selection information is used as the duration supplementary material information.

[0014] In a second aspect, the present invention provides a short video generation system, which adopts the following technical solution: A short video generation system, comprising: An acquisition module is used to obtain image material information and short video demand information; A memory, used to store a program of the short video generation method as described in any one of the first aspects; The processor loads and executes the program in the memory.

[0015] In a third aspect, the present invention provides an intelligent terminal, which adopts the following technical solution: A smart terminal comprises a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executes a short video generation method as described in any one of the first aspects.

[0016] In summary, the present invention includes at least one of the following beneficial technical effects: 1. By acquiring image material information and short video demand information and retrieving demand style information and demand duration value, the selected material information is selected according to the style and the style demand material information is retrieved, and then combined to form the use material information and synthesized and edited to generate short video output information and output it to the terminal held by ordinary users for display, so that ordinary users can input materials and automatically generate short videos after the materials are input and can be adjusted by ordinary users later, thereby facilitating ordinary users to make short videos; 2. Retrieve style words through the required style information and query to determine synonyms, then determine the synonymous comprehensive words and query to determine the style-related words, then summarize to form a style comprehensive word and query to determine the style material features, and then use the style material features as the material requirement features, thereby improving the accuracy of the obtained material requirement features; 3. By judging whether there is only one style vocabulary, if there is only one, directly aggregate the style vocabulary and synonyms to form a synonymous comprehensive vocabulary; if there is more than one, the consistent vocabulary is determined and aggregated according to the existence to form a synonymous comprehensive vocabulary, thereby improving the accuracy of the obtained synonymous comprehensive vocabulary. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 This is a flow chart of a method for generating a short video according to an embodiment of the present application; Figure 2 is a flow chart of a method for determining material demand characteristics according to an embodiment of the present application; Figure 3 is a flow chart of a method for determining a synonymous comprehensive vocabulary according to an embodiment of the present application; Figure 4 is a flow chart of a method for determining selected material information according to an embodiment of the present application; Figure 5 is a flow chart of a method for determining a feature association value in an embodiment of the present application; Figure 6 is a flow chart of a method for determining a category association value in an embodiment of the present application; Figure 7 This is a flow chart of a method for generating short video output information according to an embodiment of the present application. DETAILED DESCRIPTION

[0018] The present invention is further described in detail below in conjunction with the accompanying drawings and embodiments.

[0019] A short video generation method obtains image material information and short video demand information, selects materials according to vocabulary corresponding to the style, adjusts the materials according to the required duration, synthesizes and edits them to generate short videos and outputs them, so that ordinary users can input materials and short videos are automatically generated after the materials are input, and ordinary users can make subsequent adjustments, thereby facilitating ordinary users to make short videos.

[0020] Reference Figure 1 , an embodiment of the present invention discloses a short video generation method, which includes: Step S100: Obtain image material information and short video demand information uploaded by ordinary users.

[0021] Among them, image material information refers to the material information uploaded by ordinary users for short video production, and short video demand information refers to the style and duration of the short video that ordinary users need to produce. Image material information and short video demand information are obtained after being uploaded by ordinary users.

[0022] Step S101: Retrieve the required style information and required duration value based on the short video demand information.

[0023] The required style information refers to the style information of the short video that the ordinary user needs to make, and the required duration value refers to the duration value of the short video that the ordinary user needs to make. The required style information and the required duration value are retrieved through the short video demand information to facilitate subsequent use.

[0024] Step S102: Determine material requirement characteristics according to the required style information.

[0025] The material demand characteristics refer to the shape, color and other characteristics corresponding to the style required by ordinary users. The material demand characteristics are determined by analyzing the required style information to facilitate subsequent use. The specific steps for determining the material demand characteristics refer to steps S200 to S205.

[0026] Step S103: Identify and select material information based on material requirement characteristics and image material information.

[0027] Among them, the selected material information refers to the material information after selecting the materials uploaded by ordinary users. The material requirement characteristics are identified with the image material information, and the materials in the image material information that are consistent with the material requirement characteristics are used as the selected material information, so as to facilitate subsequent use.

[0028] Step S104: based on the required style information, retrieve the style required material information from the preset video material library, and combine the selected material information with the style required material information to form the used material information.

[0029] The video material library refers to a database storing materials of various styles, and the video material library is obtained by pre-input. Style requirement material information refers to the material information corresponding to the required style, and usage material information refers to the corresponding material information required to be used when making short videos. By retrieving materials that match the required style information from the preset video material library and using them as style requirement material information, the selected material information is combined with the style requirement material information to form usage material information, which is convenient for subsequent use.

[0030] Step S105: Synthesize and edit the used material information according to the required style information and the required duration value to generate short video output information, and output the short video output information to a terminal held by an ordinary user for display.

[0031] Among them, short video output information refers to the short video information that needs to be output, and the terminal held by the ordinary user refers to the terminal that the ordinary user can receive and display the short video. The terminal held by the ordinary user can be a mobile phone or a computer. By synthesizing and editing the required style information and the required duration value to use the material information, the short video output information is generated, and the short video output information is output to the terminal held by the ordinary user for display, so that the ordinary user can input the material and the short video is automatically generated after the material is used, and the ordinary user can make adjustments later, thereby facilitating the ordinary user to make short videos.

[0032] exist Figure 1 In step S102, in order to further ensure the rationality of the material demand characteristics, it is necessary to further analyze and calculate the material demand characteristics. Figure 2 The steps shown are explained in detail.

[0033] Reference Figure 2 , the method for determining the material demand characteristics includes the following steps: Step S200: Retrieving style vocabulary based on required style information.

[0034] Among them, style vocabulary refers to the vocabulary corresponding to the style produced by ordinary users' needs. The style vocabulary is retrieved through the required style information to facilitate subsequent use.

[0035] Step S201: Determine a synonymous word corresponding to a style word according to a correspondence between the style word and preset synonymous words.

[0036] Among them, synonyms refer to words that have the same meaning as style words. Different style words correspond to different synonyms. Synonyms are obtained by querying from a database that stores different style words and corresponding synonyms. The database is obtained after pre-input. Synonyms are determined by querying style words to facilitate subsequent use.

[0037] Step S202: Determine a synonymous comprehensive vocabulary according to the style vocabulary and the synonymous vocabulary.

[0038] The synonymous comprehensive vocabulary refers to the vocabulary corresponding to the comprehensive style vocabulary and the synonymous vocabulary. The style vocabulary and the synonymous vocabulary are analyzed to determine the synonymous comprehensive vocabulary for subsequent use. The specific steps for determining the synonymous comprehensive vocabulary refer to steps S300 to S306.

[0039] Step S203: determining the style-related vocabulary corresponding to the synonymous comprehensive vocabulary according to the correspondence between the synonymous comprehensive vocabulary and the preset style-related vocabulary.

[0040] Among them, style-related words refer to words that are mutually related to synonymous comprehensive words. Different synonymous comprehensive words correspond to different style-related words. The style-related words are obtained by querying from a database storing different synonymous comprehensive words and corresponding style-related words. The database is obtained after pre-input. The style-related words are determined by querying the synonymous comprehensive words to facilitate subsequent use.

[0041] Step S204: Summarize the synonymous comprehensive words and the style-related words to form a style comprehensive word.

[0042] Among them, the style comprehensive vocabulary refers to the comprehensive vocabulary corresponding to the required style. The synonymous comprehensive vocabulary and style-related vocabulary are summarized, and the summarized vocabulary is used as the style comprehensive vocabulary to facilitate subsequent use.

[0043] Step S205: determining the style material features corresponding to the style comprehensive vocabulary according to the correspondence between the style comprehensive vocabulary and the preset style material features, and using the style material features as the material requirement features.

[0044] Among them, the style material feature refers to the material feature of the item corresponding to the comprehensive vocabulary of the required style. Different style comprehensive vocabulary corresponds to different style material features. The style material feature is obtained by querying from a database storing different style comprehensive vocabulary and the corresponding style material features. The database is obtained after pre-input. The style material feature is determined by querying the style comprehensive vocabulary, and the style material feature is used as the material demand feature, thereby improving the accuracy of the obtained material demand feature.

[0045] exist Figure 2 In step S202, in order to further ensure the rationality of the synonymous comprehensive vocabulary, it is necessary to further analyze and calculate the synonymous comprehensive vocabulary separately, specifically by Figure 3 The steps shown are explained in detail.

[0046] Reference Figure 3 , the method for determining the synonymous comprehensive vocabulary includes the following steps: Step S300: Determine whether there is only one style word. If yes, execute step S301; if no, execute step S302.

[0047] Here, by judging whether there is only one style word, it is judged whether the words can be directly merged and summarized.

[0048] Step S301: Summarize style words and synonyms to form a synonymous comprehensive word.

[0049] Among them, when there is only one style word, it means that the words can be directly merged and summarized at this time, so the style words and synonyms are summarized and formed into a synonymous comprehensive word, thereby improving the accuracy of the obtained synonymous comprehensive word.

[0050] Step S302: determining consistent words based on the consistency between the style words and the synonymous words.

[0051] Among them, consistent vocabulary refers to the corresponding vocabulary when there is consistency between style vocabulary and synonymous vocabulary. When there is more than one style vocabulary, it means that the vocabulary cannot be directly merged and summarized at this time. Consistent vocabulary is formed by analyzing the consistency between style vocabulary and synonymous vocabulary.

[0052] Step S303: When the consistent vocabulary does not exist, the style vocabulary and the synonymous vocabulary are aggregated to form a synonymous comprehensive vocabulary.

[0053] Among them, when consistent vocabulary does not exist, it means that there is no need to delete the vocabulary at this time, so the style vocabulary and synonymous vocabulary are summarized and formed into a synonymous comprehensive vocabulary, thereby improving the accuracy of the obtained synonymous comprehensive vocabulary.

[0054] Step S304: When a consistent vocabulary exists, the style vocabulary is adjusted based on the consistent vocabulary and used as the style adjustment vocabulary.

[0055] Among them, the style adjustment vocabulary refers to the vocabulary corresponding to the style vocabulary after adjustment. When consistent vocabulary exists, it means that the vocabulary needs to be deleted at this time. Therefore, the consistent vocabulary in the style vocabulary is deleted and adjusted, and the deleted vocabulary is used as the style adjustment vocabulary for convenience in subsequent use.

[0056] Step S305: determining a synonymous adjustment word corresponding to the style adjustment word according to the correspondence between the style adjustment word and the preset synonymous adjustment word.

[0057] The synonymous adjustment words refer to words with the same meaning as the style adjustment words. Different style adjustment words correspond to different synonymous adjustment words. The synonymous adjustment words are obtained by querying from a database storing different style adjustment words and corresponding synonymous adjustment words. The database is obtained after pre-input. The synonymous adjustment words are determined by querying the style adjustment words to facilitate subsequent use.

[0058] Step S306: Summarize the style-adjusted words and the synonym-adjusted words to form a synonym-comprehensive word.

[0059] Among them, the accuracy of the acquired synonymous comprehensive vocabulary is improved by aggregating the style adjustment vocabulary and the synonym adjustment vocabulary to form the synonymous comprehensive vocabulary.

[0060] exist Figure 1 In step S103, in order to further ensure the rationality of the selected material information, it is necessary to further analyze and calculate the selected material information. Figure 4 The steps shown are explained in detail.

[0061] Reference Figure 4 , the method for determining the selected material information includes the following steps: Step S400: performing identification and matching from the image material information based on the material requirement characteristics to form matching material information.

[0062] Among them, the matching material information refers to the material information corresponding to the successful matching based on the material requirement characteristics. The material corresponding to the characteristics consistent with the material requirement characteristics is identified and matched from the image material information and used as the matching material information for convenience in subsequent use.

[0063] Step S401: determining matching remaining information according to the image material information and the matching material information.

[0064] The matching residual information refers to the material information remaining after the successful matching in the image material uploaded by the ordinary user. The matching material information in the image material information is removed, and the remaining material in the image material information is used as the matching residual information for convenience in subsequent use.

[0065] Step S402: Retrieving the remaining image features based on the matching remaining information.

[0066] The remaining image features refer to the features existing in the remaining images in the uploaded image material. The features of the images in the matching remaining information are retrieved and used as the remaining image features for convenience in subsequent use.

[0067] Step S403: determining a feature association value according to the remaining image features and the material requirement features.

[0068] The feature association value refers to the association value corresponding to the association between the remaining image features and the material requirement features. The feature association value is determined by analyzing the remaining image features and the material requirement features, which is convenient for subsequent use. The specific steps for determining the feature association value refer to steps S500 to S506.

[0069] Step S404: Determine whether the feature association value is greater than a preset association reference value. If yes, execute step S405; if no, execute step S407.

[0070] The correlation reference value refers to the minimum value corresponding to when the features are correlated. By judging whether the feature correlation value is greater than the preset correlation reference value, it is judged whether there is a correlation between the remaining image features and the material requirement features.

[0071] Step S405: Select the matching residual information corresponding to the remaining image features based on the feature association value to obtain image selection information.

[0072] The image selection information refers to the image information corresponding to the remaining images in the uploaded image material after selection. When the feature association value is greater than the preset association reference value, it means that there is an association between the remaining image features and the material requirement features. Therefore, the remaining image features corresponding to the feature association value greater than the preset association reference value are selected, and then the matching remaining information corresponding to the selected remaining image features is retrieved and used as the image selection information, so as to facilitate subsequent use.

[0073] Step S406: combining the matching material information with the image selection information and using the selected material information as the selected material information.

[0074] Among them, by combining the matching material information with the image selection information, and using the combined material as the selected material information, the accuracy of the obtained selected material information is improved.

[0075] Step S407: using the matched material information as the selected material information.

[0076] Among them, when the feature association value is not greater than the preset association reference value, it means that there is no association between the remaining image features and the material requirement features at this time, so the matching material information is used as the selected material information, thereby improving the accuracy of the obtained selected material information.

[0077] exist Figure 4 In step S403, in order to further ensure the rationality of the feature association value, it is necessary to further analyze and calculate the feature association value. Figure 5 The steps shown are explained in detail.

[0078] Reference Figure 5 , the method for determining the feature association value includes the following steps: Step S500: Determine the demand local feature corresponding to the material demand feature according to the correspondence between the material demand feature and the preset demand local feature.

[0079] Among them, the demand local feature refers to the overall feature corresponding to only a part of the material demand feature. Different material demand features correspond to different demand local features, which are obtained by querying from a database storing different material demand features and corresponding demand local features. The database is obtained after pre-input. Determine the demand local feature through material demand feature query to facilitate subsequent use.

[0080] Step S501: Determine whether the remaining image features are consistent with the required local features. If yes, execute step S502; if no, execute step S504.

[0081] Here, by judging whether the remaining image features are consistent with the required local features, it is judged whether the remaining images in the uploaded image material are directly related.

[0082] Step S502: Determine feature similarity values ​​according to required local features.

[0083] The feature similarity value refers to the similarity value corresponding to the existence of similar features. Different required local features correspond to different feature similarity values. When the remaining image features are consistent with the required local features, it means that the remaining images in the uploaded image material are directly related. Therefore, the feature similarity value is retrieved through the required local features that are consistent with the remaining image features, which is convenient for subsequent use.

[0084] Step S503: Determine the similarity association value corresponding to the feature similarity value according to the correspondence between the feature similarity value and the preset similarity association value, and use the similarity association value as the feature association value.

[0085] Among them, the similarity association value refers to the association value corresponding to the similarity of the features. Different feature similarity values ​​correspond to different similarity association values. The similarity association value is obtained by querying from a database storing different feature similarity values ​​and the corresponding similarity association values. The database is obtained after pre-input. The similarity association value is determined by querying the feature similarity value, and the similarity association value is used as the feature association value, thereby improving the accuracy of the obtained feature association value.

[0086] Step S504: Determine the demand feature category information corresponding to the material demand feature according to the correspondence between the material demand feature and the preset demand feature category information.

[0087] Among them, the demand feature category information refers to the category information to which the material demand feature belongs. Different material demand features correspond to different demand feature category information. The demand feature category information is obtained by querying from a database that stores different material demand features and corresponding demand feature category information. The database is obtained after pre-input.

[0088] When the remaining image features are not consistent with the required local features, it means that there is no direct correlation between the remaining images in the uploaded image material at this time. Therefore, the required feature type information is determined through the material required feature query to facilitate subsequent use.

[0089] Step S505: determining the remaining feature type information corresponding to the remaining image features according to the correspondence between the remaining image features and the preset remaining feature type information.

[0090] The residual feature category information refers to the category information to which the residual image features belong. Different residual image features correspond to different residual feature category information. The residual feature category information is obtained by querying from a database storing different residual image features and the corresponding residual feature category information. The database is obtained after pre-input. The residual feature category information is determined by querying the residual image features to facilitate subsequent use.

[0091] Step S506: Determine a category association value according to the required feature category information and the remaining feature category information, and use the category association value as the feature association value.

[0092] The category association value refers to the association value corresponding to the category when there is a correlation. The category association value is determined by analyzing the demand feature category information and the remaining feature category information, and the category association value is used as the feature association value to improve the accuracy of the acquired feature association value. For the specific steps of determining the category association value, refer to steps S600 to S606.

[0093] exist Figure 5 In step S506, in order to further ensure the rationality of the category association value, it is necessary to further analyze and calculate the category association value. Figure 6 The steps shown are explained in detail.

[0094] Reference Figure 6 , the method for determining the category association value includes the following steps: Step S600: Determine whether the required feature type information is consistent with the remaining feature type information. If yes, execute step S601; if no, execute step S602.

[0095] Here, by judging whether the required feature category information is consistent with the remaining feature category information, it is judged whether there is a consistent association between the categories.

[0096] Step S601: Outputting a preset category consistent association value as the category association value.

[0097] The category consistent association value refers to the association value corresponding to the category consistent, and the category consistent association value is obtained after pre-input. When the required feature category information is consistent with the remaining feature category information, it means that there is a consistent association between the categories at this time, so the preset category consistent association value is output and used as the category association value, thereby improving the accuracy of the obtained category association value.

[0098] Step S602: According to the correspondence between the demand feature category information, the remaining feature category information and the preset category initial association value, determine the category initial association value corresponding to the demand feature category information and the remaining feature category information.

[0099] Among them, the category initial association value refers to the initial association value corresponding to when there is an association between categories. Different demand feature category information and remaining feature category information correspond to different category initial association values. The category initial association value is obtained by querying from a database that stores different demand feature category information and remaining feature category information and the corresponding category initial association values. The database is obtained after pre-input.

[0100] When the required feature category information is inconsistent with the remaining feature category information, it means that there is no consistent association between the categories at this time. Therefore, the initial category association value is determined by querying the required feature category information and the remaining feature category information to facilitate subsequent use.

[0101] Step S603: When the category initial association value is greater than the preset category reference association value, the category initial association value is used as the category association value.

[0102] The category base association value refers to the minimum association value corresponding to the category association, and the category base association value is obtained by pre-input. When the category initial association value is greater than the preset category base association value, it means that there is an association between the categories at this time, so the category initial association value is used as the category association value, thereby improving the accuracy of the obtained category association value.

[0103] Step S604: when the category initial association value is not greater than the preset category reference association value, the demand-associated category information corresponding to the demand-associated category information is determined according to the correspondence between the demand-associated category information and the preset demand-associated category information.

[0104] Among them, the demand-related category information refers to the related category information that is mutually related to the demand feature category. Different demand feature category information corresponds to different demand-related category information. The demand-related category information is obtained by querying from a database storing different demand feature category information and corresponding demand-related category information. The database is obtained after pre-input. When the category initial association value is not greater than the preset category base association value, it means that there is no direct association between the categories at this time. Therefore, the demand-related category information is determined by querying the demand feature category information to facilitate subsequent use.

[0105] Step S605: According to the correspondence between the demand-related category information, the remaining feature category information and the preset category secondary association value, determine the category secondary association value corresponding to the demand-related category information and the remaining feature category information.

[0106] Among them, the category secondary association value refers to the association value corresponding to the category when there is a secondary correlation. Different demand-related category information and remaining feature category information correspond to different category secondary association values. The category secondary association value is obtained by querying from a database storing different demand-related category information and remaining feature category information and the corresponding category secondary association values. The database is obtained after pre-input. The category secondary association value is determined by querying the demand-related category information and the remaining feature category information for convenience in subsequent use.

[0107] Step S606: Calculate the sum of the category initial association value and the category secondary association value and use it as the category comprehensive association value, and use the category comprehensive association value as the category association value.

[0108] Among them, the comprehensive association value of the category refers to the comprehensive association value corresponding to the category when there is an association. The sum of the initial association value of the category and the secondary association value of the category is calculated and used as the comprehensive association value of the category, and then the comprehensive association value of the category is used as the category association value to improve the accuracy of the obtained category association value.

[0109] exist Figure 1 In step S105, in order to further ensure the rationality of the short video output information, it is necessary to further analyze and calculate the short video output information separately, specifically by Figure 7 The steps shown are explained in detail.

[0110] Reference Figure 7 , the method for generating short video output information includes the following steps: Step S700: determining a style duration value corresponding to the required style information according to a correspondence between the required style information and a preset style duration value.

[0111] The style duration value refers to the reference duration value corresponding to the style in the process of making a short video. Different required style information corresponds to different style duration values. The style duration value is obtained by querying from a database storing different required style information and corresponding style duration values. The database is obtained after pre-input. The style duration value is determined by querying the required style information to facilitate subsequent use.

[0112] Step S701: Calculate the difference between the required duration value and the style duration value and use it as the duration remaining value.

[0113] The remaining duration value refers to the remaining duration value corresponding to the required duration excluding the style reference duration. The difference between the required duration value and the style duration value is calculated and used as the remaining duration value for convenience in subsequent use.

[0114] Step S702: determining the material duration value corresponding to the material information according to the correspondence between the material information and the preset material duration value.

[0115] The material duration value refers to the duration value corresponding to the normal production of the material used. Different material information used corresponds to different material duration values. The material duration value is obtained by querying from a database storing different material information used and corresponding material duration values. The database is obtained after pre-input. The material duration value is determined by querying the material information used, which is convenient for subsequent use.

[0116] Step S703: Determine whether the material duration value is greater than the remaining duration value. If yes, execute step S704; if no, execute step S706.

[0117] Among them, by judging whether the material duration value is greater than the remaining duration value, it is determined whether the used material can be used to directly produce a short video.

[0118] Step S704: Calculate the ratio between the material duration value and the duration remaining value and use it as the material duration ratio value.

[0119] Among them, the material duration ratio value refers to the ratio between the material duration and the remaining duration. When the material duration value is greater than the remaining duration value, it means that the material used at this time can be used to directly produce a short video. Therefore, the ratio between the material duration value and the remaining duration value is calculated and used as the material duration ratio value for subsequent use.

[0120] Step S705: adjusting and synthesizing the material information based on the material duration ratio value to generate short video output information.

[0121] Among them, the duration of the used material information is adjusted according to the material duration ratio value, and the adjusted material is synthesized and edited to generate short video output information, thereby improving the accuracy of the acquired short video output information.

[0122] Step S706: Calculate the difference between the material duration value and the duration remaining value and use it as the duration missing value.

[0123] Among them, the missing value of duration refers to the missing value corresponding to the existence of missing duration. When the material duration value is not greater than the remaining value of duration, it means that the material used at this time cannot be used to directly produce a short video. Therefore, the difference between the material duration value and the remaining value of duration is calculated and used as the missing value of duration for subsequent use.

[0124] Step S707: Determine remaining material information according to the selected material information and the image material information.

[0125] The remaining material information refers to the remaining material information after the uploaded material is selected. The selected material information in the image material information is deleted and adjusted, and the adjusted image material information is used as the remaining material information to facilitate subsequent use.

[0126] Step S708: Determine the duration to supplement the material information according to the missing duration value and the remaining material information.

[0127] The duration supplementary material information refers to the material information corresponding to the material supplemented according to the duration, and the duration supplementary material information is determined by analyzing the missing value of the duration and the remaining material information, so as to facilitate subsequent use. The specific steps for determining the duration supplementary material information refer to steps S800 to S807.

[0128] Step S709: The supplementary material information is combined with the used material information according to the duration and synthesized and edited to generate short video output information.

[0129] Among them, by combining the time-length supplementary material information with the used material information, and then synthesizing and editing the combined materials to generate short video output information, the accuracy of the acquired short video output information is improved.

[0130] exist Figure 7 In step S708 shown, in order to further ensure the rationality of the duration supplementary material information, it is necessary to perform further separate analysis and calculation on the duration supplementary material information, which is specifically described in detail through the following steps.

[0131] The method for determining the duration supplementary material information includes the following steps: Step S800: determining the remaining material duration value corresponding to the remaining material information according to the correspondence between the remaining material information and the preset remaining material duration value.

[0132] The remaining material duration value refers to the duration value corresponding to the remaining material when making a short video. Different remaining material information corresponds to different remaining material duration values. The remaining material duration value is obtained by querying from a database storing different remaining material information and corresponding remaining material duration values. The database is obtained after pre-input. The remaining material duration value is determined by querying the remaining material information to facilitate subsequent use.

[0133] Step S801: Calculate the ratio between the remaining material duration value and the duration missing value and use it as the remaining material ratio value.

[0134] The remaining material ratio value refers to the ratio between the remaining material duration and the missing duration. The ratio between the remaining material duration and the missing duration is calculated and used as the remaining material ratio value to facilitate subsequent use.

[0135] Step S802: determining a remaining material proportion influence value corresponding to the remaining material proportion value according to a correspondence between the remaining material proportion value and a preset remaining material proportion influence value.

[0136] The remaining material ratio impact value refers to the value of the degree of influence of the ratio between the remaining material duration and the missing duration on the material selection. Different remaining material ratio values ​​correspond to different remaining material ratio impact values. The remaining material ratio impact value is obtained by querying from a database storing different remaining material ratio values ​​and corresponding remaining material ratio impact values. The database is obtained after pre-input. The remaining material ratio impact value is determined by querying the remaining material ratio value to facilitate subsequent use.

[0137] Step S803: Retrieving remaining material features based on the remaining material information.

[0138] The remaining material features refer to the features contained in the image corresponding to the remaining material. The remaining material features are retrieved through the remaining material information to facilitate subsequent use.

[0139] Step S804: determining the remaining correlation value according to the remaining material characteristics and the material demand characteristics.

[0140] The remaining association value refers to the association value corresponding to the association between the remaining material features and the material demand features. The remaining association value is determined by analyzing the remaining material features and the material demand features, which is convenient for subsequent use. The step of determining the remaining association value can refer to steps S500 to S506.

[0141] Step S805: determining a residual correlation influence value corresponding to the residual correlation value according to a correspondence between the residual correlation value and a preset residual correlation influence value.

[0142] The residual association impact value refers to the value of the degree of influence on the material selection according to the residual association value. Different residual association values ​​correspond to different residual association impact values. The residual association impact value is obtained by querying from a database storing different residual association values ​​and corresponding residual association impact values. The database is obtained after pre-input. The residual association impact value is determined by querying the residual association value to facilitate subsequent use.

[0143] Step S806: Calculate the sum of the remaining material proportion impact value and the remaining associated impact value and use it as the remaining material comprehensive impact value.

[0144] The comprehensive impact value of the remaining materials refers to the comprehensive impact value generated by selecting the remaining materials. The sum of the remaining material proportion impact value and the remaining associated impact value is calculated and used as the comprehensive impact value of the remaining materials to facilitate subsequent use.

[0145] Step S807: Sort the remaining materials from large to small based on their comprehensive impact values, and select the remaining material information according to the sorting result and the missing value of duration to form material selection information, and use the material selection information as the duration supplementary material information.

[0146] Among them, the material selection information refers to the material information corresponding to the remaining materials after the selection. The comprehensive impact values ​​of the remaining materials are sorted from large to small, and the selection is carried out in sequence according to the sorting results. The consistency of the sum of the durations corresponding to the selected remaining material information and the missing value of the duration is analyzed. When they are consistent, the selected remaining material information is directly used as the material selection information. When they are inconsistent, the selection is adjusted again according to the sorting results until the sum of the durations corresponding to the selected remaining material information is consistent with the missing value of the duration. The material selection information is then used as the duration supplementary material information, thereby improving the accuracy of the acquired duration supplementary material information.

[0147] Based on the same inventive concept, an embodiment of the present invention provides a short video generation system, including: An acquisition module is used to obtain image material information and short video demand information; A memory, used to store a program of the short video generation method as described above; The processor loads and executes the program in the memory.

[0148] Based on the same inventive concept, an embodiment of the present invention provides a smart terminal, including a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and execute the short video generation method as described above.

[0149] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0150] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A short video generation method, characterized in that: include: Obtain image material information and short video demand information uploaded by ordinary users; Based on the short video demand information, the required style information and required duration value are retrieved; Determine the material requirements based on the required style information; Identify and select material information based on material requirement characteristics and image material information; Based on the required style information, retrieve the style required material information from the preset video material library, and combine the selected material information with the style required material information to form the used material information; The material information is synthesized and edited according to the required style information and the required duration value to generate short video output information, and the short video output information is output to a terminal held by an ordinary user for display.

2. The short video generation method according to claim 1, characterized in that: Methods for determining material demand characteristics include: Retrieve style vocabulary based on required style information; According to the correspondence between the style vocabulary and the preset synonymous vocabulary, the synonymous vocabulary corresponding to the style vocabulary is determined; Determine the synonymous comprehensive vocabulary based on the style vocabulary and synonyms; According to the correspondence between the synonymous comprehensive vocabulary and the preset style-related vocabulary, the style-related vocabulary corresponding to the synonymous comprehensive vocabulary is determined; Based on the synonymous comprehensive vocabulary and style-related vocabulary, a style comprehensive vocabulary is formed; According to the correspondence between the style comprehensive vocabulary and the preset style material features, the style material features corresponding to the style comprehensive vocabulary are determined, and the style material features are used as the material demand features.

3. The short video generation method according to claim 2, characterized in that: The methods for determining synonymous comprehensive words include: Determine whether there is only one style word; If yes, then summarize and form a synonymous comprehensive vocabulary based on the style vocabulary and synonyms; If not, then based on the consistency between the style vocabulary and the synonymous vocabulary, the consistent vocabulary is determined; When consistent vocabulary does not exist, style vocabulary and synonyms are aggregated to form a comprehensive synonym vocabulary; When consistent vocabulary exists, the style vocabulary is adjusted based on the consistent vocabulary and used as the style adjustment vocabulary; According to the correspondence between the style adjustment vocabulary and the preset synonym adjustment vocabulary, the synonym adjustment vocabulary corresponding to the style adjustment vocabulary is determined; Based on the style adjustment vocabulary and the synonym adjustment vocabulary, they are summarized and formed into a synonym comprehensive vocabulary.

4. The short video generation method according to claim 1, characterized in that: Methods for determining selected material information include: Based on the material requirement features, identification and matching are performed from the image material information to form matching material information; Determine matching remaining information according to the image material information and the matching material information; Retrieving remaining image features based on matching remaining information; Determine feature association values ​​based on remaining image features and material requirement features; Determine whether the feature association value is greater than a preset association reference value; If yes, then selecting the matching residual information corresponding to the remaining image features based on the feature association value to obtain image selection information; Based on the matching material information and the image selection information, the information is combined and used as the selected material information; If not, the matching material information will be used as the selected material information.

5. The short video generation method according to claim 4, characterized in that: Methods for determining feature association values ​​include: According to the correspondence between the material demand characteristics and the preset demand local characteristics, the demand local characteristics corresponding to the material demand characteristics are determined; Determine whether the remaining image features are consistent with the required local features; If yes, then determine the feature similarity value based on the required local features; According to the correspondence between the feature similarity value and the preset similarity association value, a similarity association value corresponding to the feature similarity value is determined, and the similarity association value is used as the feature association value; If not, then according to the correspondence between the material demand feature and the preset demand feature type information, determine the demand feature type information corresponding to the material demand feature; Determining the residual feature type information corresponding to the residual image feature according to the correspondence between the residual image feature and the preset residual feature type information; The category association value is determined according to the required feature category information and the remaining feature category information, and the category association value is used as the feature association value.

6. The short video generation method according to claim 5, characterized in that: Methods for determining category-related values ​​include: Determine whether the required feature type information is consistent with the remaining feature type information; If yes, the preset category consistent association value is output as the category association value; If not, then determining the category initial association value corresponding to the required feature category information and the remaining feature category information according to the correspondence between the required feature category information, the remaining feature category information and the preset category initial association value; When the category initial association value is greater than the preset category base association value, the category initial association value is used as the category association value; When the category initial association value is not greater than the preset category base association value, determining the demand-associated category information corresponding to the demand-associated category information according to the correspondence between the demand-associated category information and the preset demand-associated category information; According to the correspondence between the demand-related category information, the remaining feature category information and the preset category secondary association value, the category secondary association value corresponding to the demand-related category information and the remaining feature category information is determined; The sum of the initial association value of the category and the secondary association value of the category is calculated and used as the comprehensive association value of the category, and the comprehensive association value of the category is used as the category association value.

7. The short video generation method according to claim 4, characterized in that: The method for generating short video output information includes: According to the correspondence between the required style information and the preset style duration value, the style duration value corresponding to the required style information is determined; Calculate the difference between the required duration value and the style duration value and use it as the duration remaining value; According to the correspondence between the used material information and the preset material duration value, the material duration value corresponding to the used material information is determined; Determine whether the material duration value is greater than the remaining duration value; If yes, then calculate the ratio between the material duration value and the remaining duration value and use it as the material duration ratio value; Based on the material duration ratio value, the material information is adjusted and synthesized and edited to generate short video output information; If not, the difference between the material duration value and the duration remaining value is calculated and used as the duration missing value; Determine the remaining material information according to the selected material information and the image material information; Determine the duration and supplement the material information based on the missing duration value and the remaining material information; The supplementary material information is combined with the used material information according to the duration and synthesized and edited to generate short video output information.

8. The short video generation method according to claim 7, characterized in that: Methods for determining the duration supplementary material information include: Determine the remaining material duration value corresponding to the remaining material information according to the correspondence between the remaining material information and the preset remaining material duration value; Calculate the ratio between the remaining material duration value and the missing duration value and use it as the remaining material ratio value; According to the correspondence between the remaining material ratio value and the preset remaining material ratio influence value, the remaining material ratio influence value corresponding to the remaining material ratio value is determined; Retrieving remaining material features based on remaining material information; Determine the remaining correlation value based on the remaining material characteristics and the material demand characteristics; According to the correspondence between the residual correlation value and the preset residual correlation influence value, the residual correlation influence value corresponding to the residual correlation value is determined; Calculate the sum of the remaining material proportion impact value and the remaining associated impact value and use it as the remaining material comprehensive impact value; The remaining materials are sorted from large to small based on their comprehensive impact values, and the remaining material information is selected according to the sorting results and the missing values ​​of the duration to form material selection information, and the material selection information is used as the duration supplementary material information.

9. A short video generation system, characterized in that: include: An acquisition module is used to obtain image material information and short video demand information; A memory, used to store a program of the short video generation method according to any one of claims 1 to 8; The processor loads and executes the program in the memory.

10. An intelligent terminal, characterized in that: The device comprises a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and execute the short video generation method as described in any one of claims 1 to 8.

Images