Video script template generation method, computing device, computer storage medium and computer program product

By analyzing target videos and using artificial intelligence to generate storyboard descriptions and script descriptions, the problem of low efficiency in manually generating video script templates in existing technologies has been solved, and efficient script template generation has been achieved.

CN118972674APending Publication Date: 2024-11-1558 CHANG LIFE (BEIJING) INFORMATION TECH CO LTD

Patent Information

Application Number
CN202411252633.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-06
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

In existing technologies, video script templates are usually generated manually by users, which causes creators to spend a lot of time and energy, and is prone to omissions and errors, thus limiting the efficiency and popularity of video creation.

Method used

By acquiring the target video, it is parsed into multiple storyboard videos and voice-over scripts. Using a large artificial intelligence model, storyboard description information and script description information are generated, and a script template is generated according to the script structure.

Benefits of technology

It improves the efficiency of script template generation, simplifies the creation process, reduces human error, and lowers the requirements for creators' professional skills.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118972674A_ABST
    Figure CN118972674A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a video script template generation method, computing equipment, a computer storage medium and a computer program product. The video script template generation method is applied to a server and comprises the following steps: acquiring a target video; analyzing the target video to obtain a plurality of split videos and mouth playing copywriting corresponding to the plurality of split videos respectively; generating sub-mirror description information and copywriting description information of each sub-mirror video based on the plurality of sub-mirror videos and the oral copywriting corresponding to the sub-mirror videos by using an artificial intelligence large model; wherein the split description information is used for describing the picture content of the split video; the copywriting description information is used for describing the copywriting type of the split video; and generating a script template according to the script structure formed by the plurality of split videos and the split description information and the copywriting description information of each split video. According to the technical scheme provided by the embodiment of the invention, the generation efficiency of the script template is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present application relate to the field of video processing technology, and in particular to a method for generating a video script template, a computing device, a computer storage medium, and a computer program product. Background Art

[0002] In today's era of highly developed digital content creation, video has become an important form of information dissemination and entertainment. As the blueprint for video creation, video scripts play a key role in ensuring the coherence, logic and attractiveness of video content.

[0003] Video script templates provide creators with a standardized framework and guidance, which helps to improve creative efficiency and ensure the quality of works. However, in the process of realizing the concept of this application, the inventors found that in the related art, video script templates are usually manually generated by users. This means that creators need to spend a lot of time and energy to conceive, plan and organize, including planning the storyboards of the video, designing the spoken text, and describing each storyboard and text in detail. This manual generation method is not only cumbersome and complicated, prone to omissions and errors, but also requires high professionalism and experience from the creators, which limits the efficiency and popularity of video creation and makes it difficult to meet the growing demand for video creation. Summary of the invention

[0004] Embodiments of the present application provide a method for generating a video script template, a computing device, a computer storage medium, and a computer program product.

[0005] In a first aspect, an embodiment of the present application provides a method for generating a video script template, which is applied to a server, and the method includes:

[0006] Get the target video;

[0007] Parsing the target video to obtain a plurality of storyboard videos and spoken texts corresponding to the plurality of storyboard videos;

[0008] Generate storyboard description information and text description information of each storyboard video based on the multiple storyboard videos and the oral texts corresponding to the storyboard videos by using an artificial intelligence big model; wherein the storyboard description information is used to describe the screen content of the storyboard video; and the text description information is used to describe the text type of the storyboard video;

[0009] A script template is generated according to the script structure composed of the multiple storyboard videos and the storyboard description information and text description information of each storyboard video.

[0010] In a second aspect, an embodiment of the present application provides a device for generating a video script template, comprising:

[0011] A video acquisition module is used to acquire a target video;

[0012] A video parsing module, used for parsing the target video to obtain a plurality of storyboard videos and spoken texts corresponding to the plurality of storyboard videos;

[0013] A copywriting generation module, used to generate storyboard description information and copywriting description information of each storyboard video based on the multiple storyboard videos and the oral copywriting corresponding to the storyboard videos by using an artificial intelligence big model; wherein the storyboard description information is used to describe the screen content of the storyboard video; and the copywriting description information is used to describe the copywriting type of the storyboard video;

[0014] The template generation module is used to generate a script template according to the script structure composed of the multiple storyboard videos and the storyboard description information and text description information of each storyboard video.

[0015] In a third aspect, an embodiment of the present application provides a computing device, including a processing component and a storage component;

[0016] The storage component stores one or more computer instructions; the one or more computer instructions are used to be called and executed by the processing component to implement the method for generating a video script template provided in an embodiment of the present application.

[0017] In a fourth aspect, a computer-readable storage medium is provided in an embodiment of the present application, on which a computer program is stored. When the computer program is executed by a processing component, the method for generating a video script template provided in an embodiment of the present application is implemented.

[0018] In a fifth aspect, a computer program product is provided in an embodiment of the present application, including a computer program / instruction, which, when executed by a processing component, implements a method for generating a video script template provided in an embodiment of the present application.

[0019] The embodiment of the present application provides a method for generating a video script template, by adopting the following steps: acquiring a target video; parsing the target video to obtain a plurality of storyboard videos and spoken texts corresponding to the plurality of storyboard videos; using an artificial intelligence big model to generate storyboard description information and text description information for each storyboard video based on the plurality of storyboard videos and the spoken texts corresponding to the storyboard videos; wherein the storyboard description information is used to describe the picture content of the storyboard video; and the text description information is used to describe the text type of the storyboard video; a technical solution for generating a script template according to the script structure composed of the plurality of storyboard videos and the storyboard description information and text description information of each storyboard video can reversely parse the target video, thereby generating a script template according to the structure of the target video, thereby improving the efficiency of generating the script template.

[0020] These and other aspects of the present application will become more clearly understood in the description of the following embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0022] Figure 1 A system architecture diagram provided by an embodiment of the present application is shown;

[0023] Figure 2 A flowchart of a method for generating a video script template provided by an embodiment of the present application is shown;

[0024] Figure 3 A framework diagram of the video generation method provided by the present application is shown;

[0025] Figure 4 A block diagram of a device for generating a video script template provided by an embodiment of the present application is shown;

[0026] Figure 5 A block diagram of a computing device provided by an embodiment of the present application is shown. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0028] In some of the processes described in the specification and claims of this application and the above-mentioned figures, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed in the order in which they appear in this article or executed in parallel. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish between different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit the "first" and "second" to be different types.

[0029] It should be noted that the embodiments of the present application may involve the use of user data. In actual applications, user-specific personal data can be used in the scheme described herein within the scope permitted by applicable laws and regulations, subject to the requirements of applicable laws and regulations of the country where the user is located (for example, with the user's explicit consent, effective notification to the user, etc.).

[0030] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0031] It should be noted that the technical solution of the embodiment of the present application is applicable to a network virtual environment. The users described generally refer to "virtual users". Real users can register user accounts in the server through registration to obtain user identities in the network environment. In the embodiment of the present application, the same user account can be used to log in to the server through different types of clients, so that the server can identify the same user. Of course, different user accounts can also be used to log in to the server through different types of clients. The server stores binding relationships between different user accounts, so that different user accounts with binding relationships can be considered to be the same user.

[0032] In today's era of highly developed digital content creation, video has become an important form of information dissemination and entertainment. As the blueprint for video creation, video scripts play a key role in ensuring the coherence, logic and attractiveness of video content.

[0033] Video script templates provide creators with a standardized framework and guidance, which helps to improve creative efficiency and ensure the quality of works. However, in the process of realizing the concept of this application, the inventors found that in the related art, video script templates are usually manually generated by users. This means that creators need to spend a lot of time and energy to conceive, plan and organize, including planning the storyboards of the video, designing the spoken text, and describing each storyboard and text in detail. This manual generation method is not only cumbersome and complicated, prone to omissions and errors, but also requires high professionalism and experience from the creators, which limits the efficiency and popularity of video creation and makes it difficult to meet the growing demand for video creation.

[0034] An embodiment of the present application provides a method for generating a video script template, by: acquiring a target video; parsing the target video to obtain multiple storyboard videos and spoken texts corresponding to the multiple storyboard videos; using an artificial intelligence big model to generate storyboard description information and text description information for each storyboard video based on the multiple storyboard videos and the spoken texts corresponding to the storyboard videos; wherein the storyboard description information is used to describe the picture content of the storyboard video; the text description information is used to describe the text type of the storyboard video; a technical solution for generating a script template according to the script structure composed of multiple storyboard videos and the storyboard description information and text description information of each storyboard video can reversely parse the target video, thereby generating a script template according to the structure of the target video, thereby improving the efficiency of generating the script template.

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0036] Figure 1 A system architecture diagram of a technical solution of an embodiment of the present application that can be applied to extraction is shown, and the system architecture may include a user terminal 101 and a server terminal 102. (Or: it may include a server terminal and multiple user terminals; or it may include a server terminal, a first user terminal and a second user terminal, etc.)

[0037] Among them, a connection is established between the user terminal 101 and the server terminal 102 through a network. The network provides a medium for the communication link between the user terminal 101 and the server terminal 102. The network may include various connection types, such as wired, wireless communication links or optical fiber cables, etc. Optionally, the server can be connected to the user terminal through a mobile network. Accordingly, the network standard of the mobile network can be any one of 2G (GSM), 2.5G (GPRS), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G+ (LTE+), 5G, WiMax, etc. Optionally, the user terminal can also establish a communication connection with the server through Bluetooth, WiFi, infrared, etc.

[0038] The client 101 can interact with the server 102 through the network to receive or send messages, etc.

[0039] Among them, the user terminal 101 can be a browser, an APP (Application), or a web application such as an H5 (HyperText Markup Language 5, Hypertext Markup Language Version 5) application, or a light application (also known as a mini-program, a lightweight application) or a cloud application, etc. The user terminal 101 can be deployed in an electronic device and needs to rely on the device to run or some apps in the device to run, etc. The electronic device can, for example, have a display screen and support information browsing, such as a personal mobile terminal such as a mobile phone, a tablet computer, a personal computer, a desktop computer, a smart speaker, a smart watch, etc. For ease of understanding, Figure 1 The user end is mainly represented by a device image. Various other types of applications can usually be configured in electronic devices, such as human-computer dialogue applications, model training applications, text processing applications, web browser applications, shopping applications, search applications, instant messaging tools, email clients, social platform software, etc. Electronic devices can refer to devices used by users, which have the functions of computing, surfing the Internet, communicating, etc. required by users, such as mobile phones, tablet computers, personal computers, wearable devices, etc. Electronic devices can usually include at least one processing component and at least one storage component. Electronic devices may also include basic configurations such as network card chips, IO buses, audio and video components, which are not limited in this application. Optionally, according to the implementation form of the electronic device, some peripheral devices may also be included, such as keyboards, mice, input pens, printers, etc., which are not limited in this application.

[0040] The server 102 may include servers that provide various services, such as a server for background training that provides support for the model used on the user terminal 101, or a server that processes interactive information sent by the user terminal.

[0041] It should be noted that the server 102 can be implemented as a distributed server cluster consisting of multiple servers, or as a single server. The server can also be a server of a distributed system, or a server combined with a blockchain. The server can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology.

[0042] It should be noted that the method for generating a video script template provided in the embodiment of the present application is generally executed by the server 102, and the corresponding video script template generation device is generally set in the server 102. However, in other embodiments of the present application, the user terminal 101 may also have similar functions to the server 102, so as to execute the method for generating a video script template provided in the embodiment of the present application. In other embodiments, the method for generating a video script template provided in the embodiment of the present application may also be jointly executed by the user terminal 101 and the server 102.

[0043] It should be understood that Figure 1 The number of the user terminals and the server terminals in the figure is only for illustration. Any number of the user terminals and the server terminals may be provided according to the implementation requirements.

[0044] The implementation details of the technical solution of the embodiment of the present application are elaborated in detail below.

[0045] Figure 2 A flowchart of a method for generating a video script template provided by an embodiment of the present application is shown. The method for generating a video script template can be applied to a server, such as Figure 2 As shown, the method for generating a video script template may specifically include the following steps:

[0046] 201, obtaining a target video;

[0047] 202, parsing the target video to obtain a plurality of storyboard videos and spoken texts corresponding to the plurality of storyboard videos;

[0048] 203, using the artificial intelligence big model based on the multiple storyboard videos and the oral texts corresponding to the storyboard videos, generating storyboard description information and text description information for each storyboard video; wherein the storyboard description information is used to describe the screen content of the storyboard video; and the text description information is used to describe the text type of the storyboard video;

[0049] 204, generating a script template according to the script structure composed of multiple storyboard videos and the storyboard description information and text description information of each storyboard video.

[0050] Among them, the user can provide the target video through the client, but not limited to this, the user can also provide the access link of the target video through the client, so that the server obtains the target video based on the access link. In addition, the target video may not be provided by the client, but can be actively obtained by the server. For example, the server can obtain the target video from the Internet using crawler technology; wherein, the target video, for example, may include a video that is used to display content related to the target object and has a high popularity, that is, a more popular video. Among them, the target object may include a commodity, and the target video may be used to introduce and promote the commodity represented by the target object. The above-mentioned commodities may include tangible products or intangible services; tangible products may refer to commodities that can be touched and physically owned, such as electronic products, clothing or daily necessities; intangible services may include services provided by merchants, such as nanny services, cleaning services, maintenance services or any products and services that do not have a physical form.

[0051] After obtaining the target video, the script structure of the target video can be determined by parsing the target video. The script structure can refer to the number of storyboards, each storyboard can be used to display specific content, and each storyboard can include corresponding oral copy. Take the three-segment script structure as an example. This structure divides the video content into three main parts or storyboards. First, storyboard 1 can focus on emotional marketing, with the purpose of establishing a connection with the audience through emotional resonance and stimulating the audience's interest and emotional response; storyboard 2 is dedicated to service introduction, where the characteristics and advantages of the provided services can be introduced in detail to ensure that the audience has a clear understanding of the service itself. Finally, storyboard 3 shows the applicable population of the service and shares the feedback and evaluation of the experiencer, which helps the audience understand the actual application effect of the service and enhances the sense of trust. Among them, the oral copy corresponding to storyboard 1 can include text content used to express "emotional marketing", and accordingly, the oral copy of storyboard 2 can include text introducing the service, and the oral copy of storyboard 3 can be text related to the introduction of the applicable population of the service.

[0052] After parsing the target video and obtaining the spoken copy of the target video, the artificial intelligence model can be used to generate the storyboard description information and copy description information corresponding to each storyboard. Then, based on the script structure composed of multiple storyboard videos and the storyboard description information and copy description information of each storyboard video, a script template can be generated. The script template can be a template of a video script, and the script template can have a script structure corresponding to the video script of the target video.

[0053] Among them, the copy description information can be used to describe the copy type of the storyboard video, so that when the video script is generated based on the script template, the oral copy of the storyboard is generated based on the copy description information. In one embodiment of the present application, the copy description information may include, for example, "focusing on emotional marketing, the purpose is to establish a connection with the audience through emotional resonance, stimulate the audience's interest and emotional response", "dedicated to service introduction, here you can introduce the characteristics and advantages of the services provided in detail to ensure that the audience has a clear understanding of the service itself", "showing the applicable population of the service, and sharing the feedback and evaluation of the experiencers, which helps the audience understand the actual application effect of the service and enhances the sense of trust".

[0054] By reverse parsing the target video, the video script of the target video can be obtained, and a promotional video with a style and structure similar to the target video can be generated based on the video script.

[0055] In some embodiments, parsing the target video to obtain multiple storyboard videos may be specifically implemented as follows:

[0056] The target video is segmented according to content similarity to obtain multiple storyboard videos.

[0057] The target video may be long, and may show multiple different themes. Therefore, the target video can be split. By splitting the target video, the longer target video can be divided into multiple shorter storyboard videos according to different themes or contents.

[0058] In some embodiments, segmenting the target video according to content similarity to obtain multiple storyboard videos may be specifically implemented as follows:

[0059] Perform frame extraction on the target video to obtain multiple video frames;

[0060] Use a large AI model to convert multiple video frames into video features;

[0061] The content similarity between video frames is calculated based on video features, and video frames whose content similarity meets preset conditions are merged into a storyboard video.

[0062] In a possible implementation, the server can perform frame extraction processing on the target video to extract a series of separate video frames from the target video. The server can perform similarity calculation between consecutive video frames, and calculate the similarity between consecutive video frames by comparing the visual content between consecutive frames, such as color, texture, shape, and motion features. The similarity calculation can be calculated, for example, by pixel comparison, feature vector matching, or the output of a deep learning model. Based on the calculated similarity results, the server can determine the splitting points of the target video, i.e., key frames. The splitting points can be located at positions where the similarity drops significantly, which can indicate that the video content is changing or switching to a new scene. Thus, the server can split the target video into multiple segmented videos on these key frames, and each segmented video can contain a series of visually similar continuous frames, so that the consistency of the content of each segmented video can be guaranteed. In addition, when performing segmentation processing, the server can also consider the contextual information and semantic information of the video to improve the accuracy and relevance of the segmentation; for example, if the dialogue or narrative in the video logically belongs to the same subject, it may not be split into different segments even if there are slight visual changes.

[0063] In some embodiments, calculating the content similarity between video frames based on video features and merging video frames whose content similarity meets a preset condition into a storyboard video may be specifically implemented as follows:

[0064] Traverse multiple video frames and calculate the content similarity between the current frame and the previous frame. If the content similarity is greater than a preset threshold, merge the current frame into the previous frame. Otherwise, use the current frame as the starting frame for content similarity calculation.

[0065] In the embodiment of the present application, during the process of segmenting the target video, the server can decide how to segment the video based on the content similarity between frames, so that the server can identify and retain continuous frame segments with high similarity in the video while maintaining the original structure and narrative flow of the video.

[0066] Specifically, the server can start from the first frame of the target video and traverse to the last frame in sequence, calculating the similarity between consecutive frames in real time. When encountering consecutive frames with high similarity, the server can merge these frames as a whole to form a storyboard video.

[0067] For example, if the content similarity between the first frame to the tenth frame of the target video is high during the inspection process, these frames will be merged into storyboard video 1. Then, the system continues to traverse, and when it is found that the fifteenth frame to the twentieth frame also show a high similarity, these frames will also be merged to form storyboard video 2. Even if there is a high similarity between the first frame to the tenth frame and the fifteenth frame to the twentieth frame, the server will still regard them as two independent storyboard videos because there is a frame gap between them, which indicates that they represent different scenes or actions in the video.

[0068] In this way, the video can be segmented into multiple logical segments without destroying the coherence of the video content. Each segment contains visually similar and continuous frames. Such segmentation can effectively extract key information from the video while preserving the original narrative structure of the video.

[0069] In some embodiments, obtaining the target video may be specifically implemented as follows:

[0070] In response to the video parsing instruction sent by the client, a target video indicated by the video parsing instruction is obtained.

[0071] In one embodiment of the present application, the target video may be provided by a user through a client.

[0072] In some embodiments, the method for generating a video script template may further include:

[0073] Send the script template to the client;

[0074] In response to the client sending a video script generation instruction for a target object, obtaining object description information of the target object;

[0075] In some embodiments, after the script template is generated, the method for generating the video script template may further include:

[0076] Generate the spoken copy for each storyboard using the artificial intelligence model based on the object description information and the copy description information in the script template;

[0077] The script content of each storyboard is composed of the storyboard description information and oral copy corresponding to each storyboard;

[0078] The script contents corresponding to the multiple storyboards are combined into a video script according to the script structure corresponding to the script template.

[0079] The object description information may include the name, characteristics, purpose, advantages, etc. of the target object, and may serve as the basis for the video content. For example, the following is the object description information for a cleaning service: "Professional home cleaning service, covering whole house cleaning, including kitchens, bathrooms, bedrooms and other areas, meticulous service, and the use of environmentally friendly cleaning agents." Through the object description information, the name of the target object may be introduced, such as "home cleaning service", where the service content of "home cleaning service" includes "whole house cleaning, including kitchens, bathrooms, bedrooms and other areas", and the service advantages and characteristics are "meticulous service, the use of environmentally friendly cleaning agents".

[0080] Among them, the spoken copy may include the narration or dialogue text in the current storyboard, and the storyboard description information may be used to illustrate the visual content of each storyboard, for example, it may include scene layout, character actions, camera angles, lens movement, etc.

[0081] The artificial intelligence large model can understand the overall framework of the video and the order of each storyboard based on the script structure, and understand the basis of the script content based on the object description information of the target object, so that the script content of each storyboard can be intelligently generated.

[0082] In one embodiment of the present application, after the script template is generated, the script template can be first sent to the client. After the user obtains the script template, the server can send a video script generation instruction for the target object to the server. After receiving the video script generation instruction for the target object, the server can generate the script template according to the pre-generated script template based on the acquired object description information.

[0083] In some embodiments, the method for generating a video script template may further include:

[0084] In response to a video script generation instruction for a target object sent by a client, determine object description information of the target object and a target video;

[0085] In some embodiments, after the script template is generated, the method for generating the video script template may further include:

[0086] Generate the spoken copy for each storyboard based on the object description information and the copy description information in the script template using the artificial intelligence big model;

[0087] The script content of each storyboard is composed of the storyboard description information and oral copy corresponding to each storyboard;

[0088] The script contents corresponding to the multiple storyboards are combined into a video script according to the script structure corresponding to the script template.

[0089] The object description information may include the name, characteristics, purpose, advantages, etc. of the target object, and may serve as the basis for the video content. For example, the following is the object description information for a cleaning service: "Professional home cleaning service, covering whole house cleaning, including kitchens, bathrooms, bedrooms and other areas, meticulous service, and the use of environmentally friendly cleaning agents." Through the object description information, the name of the target object may be introduced, such as "home cleaning service", where the service content of "home cleaning service" includes "whole house cleaning, including kitchens, bathrooms, bedrooms and other areas", and the service advantages and characteristics are "meticulous service, the use of environmentally friendly cleaning agents".

[0090] Among them, the spoken copy may include the narration or dialogue text in the current storyboard, and the storyboard description information may be used to illustrate the visual content of each storyboard, for example, it may include scene layout, character actions, camera angles, lens movement, etc.

[0091] The artificial intelligence large model can understand the overall framework of the video and the order of each storyboard based on the script structure, and understand the basis of the script content based on the object description information of the target object, so that the script content of each storyboard can be intelligently generated.

[0092] In one embodiment of the present application, after generating the script template, the server can automatically generate a corresponding video script based on the script template.

[0093] In some embodiments, the method for generating a video script template may further include:

[0094] The video script and / or the download address of the video script is sent to the client so that the client can save the video script.

[0095] In some embodiments, obtaining the target video may be specifically implemented as follows:

[0096] Get the target video uploaded by the user through the client;

[0097] Obtain the target video based on the access address sent by the user through the client;

[0098] or,

[0099] Crawl target videos that meet video requirements from the Internet.

[0100] In one embodiment of the present application, users can upload target videos that meet their requirements through the client, so that the server can directly obtain the target videos provided by these users.

[0101] In another embodiment of the present application, the server can also actively search and grab videos that meet specific requirements on the network as target videos. The specific requirement can be, for example, that the target video is popular. In this case, the server can evaluate the popularity of the video by referring to its views, likes, comments, shares, and other indicators, and use it as the target video if the popularity is higher than a preset popularity threshold.

[0102] In an embodiment of the present application, after generating a script template and / or generating a video script, a corresponding promotional video can also be generated based on the script template.

[0103] In some embodiments, the method for generating a video script template may further include:

[0104] Responding to the video generation instruction for the target object sent by the client, determining the object description information and the video script type of the target object;

[0105] Determine a target script structure corresponding to the script template; the target script structure includes multiple storyboards;

[0106] Generate the target oral copy for each storyboard based on the object description information and the target script structure using the artificial intelligence big model;

[0107] Convert the spoken text corresponding to each storyboard into spoken audio;

[0108] Searching for a target material video that matches the storyboard description information of each storyboard and the target object from the material library;

[0109] The spoken audio of each storyboard is combined with the corresponding target material video into a target storyboard video;

[0110] According to the target script structure, target storyboard videos corresponding to multiple storyboards are synthesized to obtain a promotional video for the target object.

[0111] The video script can be used to guide the elements and links in the video generation process, and different types of video scripts can be used to generate different types of promotional videos. The video script can include multiple storyboards, each of which can be used to guide the generation of a video segment of the promotional video, and the video segment can be a link in the process of generating the promotional video.

[0112] After receiving the video generation instruction, the video script type can be determined based on the target object, promotion purpose, etc.; alternatively, the user can specify the desired video script type in the video generation instruction.

[0113] After determining the type of video script, you can determine the script structure corresponding to the type of video script. The script structure can refer to the number of storyboards, and each storyboard can be used to display specific content. Take the three-part script structure as an example. This structure divides the video content into three main parts or storyboards. First, storyboard 1 can focus on emotional marketing, with the goal of establishing a connection with the audience through emotional resonance, stimulating the audience's interest and emotional response; storyboard 2 is dedicated to service introduction, where the characteristics and advantages of the service provided can be introduced in detail to ensure that the audience has a clear understanding of the service itself. Finally, storyboard 3 shows the applicable population of the service and shares the feedback and evaluation of the experiencers, which helps the audience understand the actual application effect of the service and enhances the sense of trust.

[0114] Through this structured approach, the video script can be developed in an orderly manner, with each storyboard designed for specific goals and content, thus forming a coherent and persuasive video narrative. This clear script structure not only helps guide video shooting and production, but also helps ensure that the final video content can effectively convey information, attract target audiences, and achieve established marketing goals.

[0115] Among them, the spoken copy may include the narration or dialogue text in the current storyboard, and the storyboard description information may be used to illustrate the visual content of each storyboard, for example, it may include scene layout, character actions, camera angles, lens movement, etc.

[0116] The artificial intelligence large model can understand the overall framework of the video and the order of each storyboard based on the script structure, and understand the basis of the script content based on the object description information of the target object, so that the script content of each storyboard can be intelligently generated.

[0117] The storyboard description information can ensure that the generated promotional video images can accurately convey the intended information and emotions, and can also maintain consistency with the spoken copy.

[0118] After the spoken copy is generated, the spoken copy of each storyboard can be converted into spoken audio using text-to-speech conversion technology. Next, according to the storyboard description information of the storyboard and the screen content described in the storyboard description information, the material content that matches the screen content described in the storyboard description information and matches the target object can be searched from the material library. Among them, matching the target object can refer to the material content that matches the product corresponding to the target object.

[0119] By searching for source videos based on the storyboard description information and the target object, it is possible to ensure that the visual content of the generated promotional video matches the target object and the usage scenario of the target object.

[0120] For the material video and spoken audio corresponding to each storyboard, the corresponding material video and spoken audio can be synthesized and synchronized to generate a target storyboard video.

[0121] Then, according to the script structure, multiple target storyboard videos can be synthesized in an orderly manner to generate a promotional video for the target object.

[0122] In some embodiments, using the artificial intelligence big model based on the object description information and the target script structure to generate the target oral copy for each storyboard can be specifically implemented as follows:

[0123] Get target script requirements;

[0124] Generate prompt words according to the prompt template by using the object description information, the script template and the target script requirements;

[0125] Input the prompt words into the artificial intelligence big model, so as to use the artificial intelligence big model to generate the spoken text for each storyboard based on the object description information, refer to the script template and follow the script requirements.

[0126] Among them, the target script requirements can be used to indicate the length, style, target audience, content requirements, format requirements, etc. of the script expected to be generated based on the target script structure.

[0127] The prompt template can be a predefined framework or structure for guiding and standardizing the content input into the artificial intelligence model. In an embodiment of the present application, the prompt template can include elements such as script structure, target audience, copy length, format requirements, language and tone, and specific requirements.

[0128] The prompt words can be generated by filling the object description letter, target script template and target script requirements into the corresponding elements of the prompt template.

[0129] By inputting the prompt words into the artificial intelligence big model, the artificial intelligence big model can generate the spoken text for each storyboard based on the object description information, refer to the target script template and follow the script requirements.

[0130] The following may be a possible implementation of a prompt word provided for an embodiment of the present application. It should be noted that the prompt word is only an example.

[0131] #Setting a Purpose#

[0132] 1. I want to make a short video content of "product and service promotion.

[0133] 2. Please generate the narration material for this promotional short video by analyzing and extracting the core content of #post information#.

[0134] #Script structure#

[0135] Generate narration corpus according to the following structure:

[0136] Part 1: Based on the characteristics of your product or service and the industry classification information, create a fictional experience from a first-person perspective (close to the experiences of ordinary people and ordinary companies) to trigger everyone's emotional resonance.

[0137] Part 2: From a third-person perspective, recommend this product or service to your friends and talk about what kind of people this product or service is suitable for.

[0138] Part 3: From a third-person perspective, talk about the impact this product has on your daily life and work.

[0139] #Content Requirements#

[0140] 1. The number of words in the generated narration is within 240 words;

[0141] 2. Part 1 should not exceed 60 words;

[0142] 3. Part 2 should not exceed 140 words;

[0143] 4. Part 3 should not exceed 40 words;

[0144] 5. Descriptions such as "our products", "our services", "contact us", etc. are prohibited.

[0145] #Format requirements#

[0146] 1. Please use "part1:", "part2:", "part3:" to distinguish each paragraph. The text must be divided into 3 paragraphs, with the second paragraph being the longest.

[0147] 2. Each paragraph must not be empty.

[0148] #Sample copy#

[0149] Oh, my pile of shoes is a disaster! A pile of dirty shoes is a headache. I really don't want to wash them by myself, it feels too difficult!

[0150] So, I suddenly had an idea and decided to hand over these troublesome things to a shoe cleaning company. Do you know that a shoe cleaning company is an "old shoe doctor" with many years of experience, specializing in cleaning all kinds of shoes and is well-known.

[0151] I heard that they use advanced equipment and environmentally friendly materials, and the door-to-door pickup and delivery service is also convenient and efficient. It's great to think that my shoes will be brand new under their "magic hands". Moreover, if you have any questions during the cleaning process, there are specialists to answer them immediately!

[0152] What makes me even more excited is that XXXX shoe cleaning also offers low prices and guaranteed quality. When I think of the limited-time discounts and generous gifts waiting for me, I feel that this choice is simply a "treasure"!

[0153] Letting my shoes be washed by XYZ makes me feel confident in every step. Choosing XYZ to wash my shoes makes my life easier and more comfortable!

[0154] In the above prompt words, #sample copy# can be the target script template, #content requirements# and #format requirements# can be the target script requirements, and #post information# can be the object description information (the specific content of the post information is not provided in the above prompt words).

[0155] In some embodiments, the method for generating a video script template may further include:

[0156] Based on the spoken audio of each storyboard, a digital human image of the digital human broadcasting the spoken audio is generated;

[0157] Among them, Digital Human (or Virtual Human) can be a computer-generated character with human-like appearance, behavior and communication ability. Digital Human can be two-dimensional or three-dimensional and can be created through computer graphics (CGI) and artificial intelligence technology.

[0158] The digital human screen can be used to display the facial movements of the digital human that match the spoken audio, such as facial expressions and lip movements.

[0159] In some embodiments, synthesizing the spoken audio of each storyboard with the corresponding target material video into a target storyboard video may be specifically implemented as follows:

[0160] Combine the spoken audio of each storyboard with the digital human image to form a digital human video;

[0161] In the case that a target material video exists in any storyboard, the digital human video and the target material video are combined into a target storyboard video;

[0162] When there is no target material video for any storyboard, the digital human video is used as the target storyboard video.

[0163] After synthesizing the spoken audio and the digital human image into a digital human video, the digital human can broadcast the spoken audio according to facial movements that match the spoken audio and use corresponding timbre, intonation and emotional expression, so that the visual and auditory elements of the digital human video are coordinated.

[0164] When there is a target material video in any storyboard, the digital human video can be added to the layer above the target material video layer, so that the digital human image is integrated into the target material video, and the target material video is used as the background for the digital human image to perform voice broadcasting, thereby improving the display effect.

[0165] In the case that there is no target material video in any storyboard, the digital human video can be used independently as the video content of the storyboard. In this case, appropriate background elements can be added to the digital human video to ensure the richness and visual appeal of the picture.

[0166] In some embodiments, the video generation method may further include:

[0167] Sending digital human selection prompt information of multiple digital humans to the client;

[0168] According to the digital human selection request sent by the client, the target digital human selected by the user is determined.

[0169] The digital human selection prompt information may include a brief introduction, characteristics, appearance, etc. of each digital human among the multiple digital humans. After the client receives the digital human selection prompt information, the user may send a digital human selection request through the client according to preferences or specific purposes. The digital human selection request may include identification information of the digital human selected by the user.

[0170] In response to the digital human selection request, the server can determine the target digital human selected by the user based on the information in the digital human selection request.

[0171] In some embodiments, based on the spoken audio of each storyboard, generating a digital human screen in which the digital human broadcasts the spoken audio may be specifically implemented as follows:

[0172] Generate the lip shape features of the target digital person based on the spoken audio;

[0173] The lip shape features are synthesized into the digital human model corresponding to the target digital human to generate a digital human image.

[0174] The server can analyze the spoken audio to determine the rhythm, intonation, and pronunciation of the speech, thereby generating lip features synchronized with the audio. Lip features may include, for example, the opening and closing of the lips, the position of the tongue, and possible accompanying facial expressions.

[0175] In a possible implementation of the present application, speech recognition and analysis technology can be used to decompose the audio signal of the oral audio into individual factors and syllables. Then, an artificial intelligence model can be used to map the decomposed factors and syllables to specific lip movements. Among them, the artificial intelligence model can, for example, be based on a machine learning algorithm and have the ability to identify the lip shape, tongue position and facial expression corresponding to different factors. After the artificial intelligence model identifies the lip shape corresponding to each factor, these lip movements can be synthesized using technologies such as facial animation to create a coherent lip animation sequence. In this process, it is necessary to accurately synchronize the lip shape of the digital person with the pronunciation in the oral audio to achieve a natural and smooth visual effect. In addition, in order to enhance the expressive ability of the digital person, the server can also analyze the emotions and intonation in the audio, and integrate these emotional factors into the lip shape and facial expressions, so that the digital person can convey information more vividly. Finally, the generated lip shape features and facial animations can be integrated into the target digital human model, and the digital human screen can be generated through real-time rendering technology to ensure that the lip shape, facial expression and overall performance of the digital person match the audio content when the voice is broadcast.

[0176] In some embodiments, synthesizing the digital human video and the target material video into the target storyboard video may be specifically implemented as follows:

[0177] The background image in the digital human video is replaced with the material image of the target material video to generate a target storyboard video.

[0178] In some embodiments, the video generation method may further include:

[0179] Obtain at least one object video sent by the client;

[0180] Segment each object video according to content similarity to obtain multiple segmented videos;

[0181] Use a large artificial intelligence model to convert multiple segmented videos into video features;

[0182] The multiple segmented videos are respectively used as material videos, and are saved in the material library in correspondence with their respective video features and the object types corresponding to the object videos.

[0183] The object video may be a video associated with the target object, shot by the user, generated by specific software, or downloaded from the Internet. The object video may be long, and may display multiple different themes. Therefore, in order to increase the number and richness of material videos when generating promotional videos, the object video provided by the user may be split. By splitting the object video, a longer object video can be divided into multiple shorter material videos according to different themes or contents.

[0184] The server can determine the splitting position of the object video by identifying key frames, scene changes or other important content points in the object video, and split the object video at each splitting position to obtain multiple segmented videos.

[0185] In a possible implementation, the server can perform frame extraction processing on the object video to extract a series of separate video frames from the object video. The server can perform similarity calculation between consecutive video frames, and calculate the similarity between consecutive video frames by comparing the visual content between consecutive frames, such as color, texture, shape, and motion features. The similarity calculation can be calculated, for example, by pixel comparison, feature vector matching, or the output of a deep learning model. Based on the calculated similarity results, the server can determine the split point of the object video, that is, the key frame. The split point can be located at a position where the similarity drops significantly, which can indicate that the video content is changing or switching to a new scene. Thus, the server can split the object video into multiple segmented videos on these key frames, and each segmented video can contain a series of visually similar continuous frames, so that the consistency of the content of each segmented video can be guaranteed. In addition, when performing segmentation processing, the server can also consider the contextual information and semantic information of the video to improve the accuracy and relevance of the segmentation; for example, if the dialogue or narrative in the video logically belongs to the same subject, it may not be split into different segments even if there is a slight visual change.

[0186] Searching the target material videos from the material library that match the storyboard description information of each storyboard and the target object includes:

[0187] Performing feature extraction processing on the storyboard description information to generate storyboard description features;

[0188] Based on the matching degree between the storyboard description information of each storyboard and the video features, a target material video matching each storyboard is searched from a plurality of material videos in the material library that match the object type of the target object.

[0189] In some embodiments, searching the material library for the material video that matches the storyboard description information of each storyboard and the target object may be specifically implemented as follows:

[0190] Performing feature extraction processing on the storyboard description information to generate storyboard description features;

[0191] Based on the matching degree between the storyboard description information of each storyboard and the video features, a target material video matching each storyboard is searched from a plurality of material videos in the material library that match the object type of the target object.

[0192] The server can analyze the storyboard description information of each storyboard, extract the visual and content features of the storyboard description information, and convert these features into a storyboard description feature vector. The storyboard description feature vector can contain the core elements of the storyboard, such as scene, role, action, color and emotion, to provide a basis for searching and matching video materials.

[0193] After generating the storyboard description feature vector, the server can match the storyboard description feature vector with the video feature vector in the material library. The video materials in the material library can be pre-analyzed and converted into their own video feature vectors, which can be used to describe the visual content of the video. By calculating the similarity between the storyboard description feature vector and the video feature vector, the server can quantify the degree of match between each video material and a specific storyboard.

[0194] When matching video materials, the server not only considers the matching degree of feature vectors, but also searches for video materials that are consistent with the type of the target object in the classified material videos, and selects matching material videos from the material library in combination with the object type of the target object.

[0195] In some embodiments, when no material video having storyboard description information corresponding to any storyboard and matching the target object is found in the material library, the method for generating a video script template may further include:

[0196] Utilize the AI ​​big model to generate material content based on storyboard description information.

[0197] The material content may include synthesized videos and / or synthesized pictures;

[0198] Generate target material video based on the material content.

[0199] The artificial intelligence model can parse the storyboard description information, understand the required visual content and style requirements, and use deep learning algorithms to create synthetic material content that matches the visual content and style requirements described in the storyboard description information.

[0200] By using an artificial intelligence model to generate corresponding material content when there is a lack of target material matching the storyboard description information in the material library, the continuity and integrity of video generation can be ensured in the absence of video material.

[0201] In some embodiments, the method for generating a video script template may further include:

[0202] Get the background music that matches any storyboard description information.

[0203] The server can analyze the storyboard description information of each storyboard, including scene content, emotional tone, rhythm and atmosphere, to determine the required music style and emotional color. Then, the server can search for matching music in the music library based on this information. The music library may contain music of various styles and emotions to adapt to different types of video content.

[0204] During the search process, the server can consider the rhythm, speed and volume of the music to ensure that the music matches the rhythm and emotion of the storyboard. In addition, the server can also check the copyright of the music to avoid using copyrighted music and ensure the legality of the video.

[0205] Once suitable candidate music is found, the server can analyze and screen it to further confirm whether the music is coordinated with the storyboard content. If necessary, the server can also make technical adjustments to the music, such as adjusting the volume, length and tone, to ensure that the music is integrated with the video content.

[0206] In some embodiments, synthesizing the spoken audio of each storyboard with the corresponding target material video into a target storyboard video may be specifically implemented as follows:

[0207] Combine spoken audio, target material video and background music into the target storyboard video.

[0208] In some embodiments, the method for generating a video script template further includes:

[0209] Sending the promotional video to the object providing system so that the client can obtain the promotional video through the object providing system; or,

[0210] Store the promotional video to a storage device.

[0211] The following describes the method for generating a video script template provided in an embodiment of the present application in conjunction with a specific application scenario.

[0212] Suppose a cleaning service company wants to produce a series of promotional videos to showcase the professionalism and diversity of its services. The server can first respond to the video parsing instructions sent by the client to obtain target videos related to cleaning services. The target video can be uploaded by the user through the client, such as the cleaning process shot by the company's employees themselves; or it can be obtained based on the access address sent by the user through the client, such as high-quality videos obtained from other professional cleaning websites; and some are crawled from the Internet, such as popular cleaning skills sharing videos.

[0213] Next, the server can segment these target videos according to content similarity. First, the target video is processed by frame extraction to obtain multiple video frames, and then these video frames are converted into video features using the artificial intelligence model. The content similarity between video frames is calculated based on these video features. If the content similarity is greater than the preset threshold, the current frame is merged into the previous frame. Otherwise, the current frame is used as the starting frame for content similarity calculation, and finally multiple storyboard videos are obtained.

[0214] Then, the server can parse the target video to obtain multiple storyboard videos and the corresponding spoken copy for each storyboard video. Then, the AI ​​big model is used to generate the storyboard description information and copy description information for each storyboard video based on these storyboard videos and spoken copy. The storyboard description information describes in detail the cleaning scenes in the storyboard video, such as cleaning the kitchen, wiping the windows, etc.; the copy description information explains the copy type of the storyboard video, such as introducing the use of tools, emphasizing the cleaning steps, etc.

[0215] Then, a script template may be generated according to the script structure consisting of multiple storyboard videos and the storyboard description information and text description information of each storyboard video.

[0216] Afterwards, the server can respond to the client's instruction to generate a video script for the cleaning service and obtain the object description information of the cleaning service, such as the company's special services and advantages. The artificial intelligence big model is used to generate the spoken copy for each storyboard based on these object description information and the copy description information in the script template. The storyboard description information and the spoken copy corresponding to each storyboard constitute the script content of each storyboard. Finally, the script content corresponding to multiple storyboards constitutes a complete cleaning service promotional video script according to the script structure corresponding to the script template, and the video script and / or the download address of the video script are sent to the client for the client to save and use.

[0217] Figure 3 The framework diagram of the method for generating a video script template provided by the present application is shown. Through the framework, it is possible to generate a script template by reverse parsing the target video, and generate a promotional video based on the script template.

[0218] like Figure 3 As shown, the video generation method provided in the embodiment of the present application includes a script service 301, a director service 302, and a material service 303.

[0219] Wherein, the script service 301 is used to generate a video script. In one embodiment of the present application, the script service 301 can be specifically used to extract and generate a target script from the target video by reverse parsing the target video. Wherein, the video tracking module 3011 can be used to track popular hot videos from the Internet, and then the target video is segmented by the video storyboard parsing module 3012 to obtain multiple storyboard videos. The first prompt word generation module 3013 can be used to generate a copy prompt word, which can be used to instruct the artificial intelligence large model to generate a spoken copy. The second prompt word generation module 3014 can be used to generate a storyboard prompt word, which can be used to instruct the artificial intelligence large model to generate a storyboard description information. The framework generation module 3015 can be used to generate a script template, wherein there can be multiple storyboards in the script template. After the script template is generated, it can be submitted to the review module 3016 for review. The review module 3016 can be used to review whether the logic of the script template is smooth, whether the theme is clear, etc. If the script template passes the review, the script template can be saved. If the script template does not pass the review, it can return to the regeneration step, such as regenerating the storyboard, regenerating the prompt words, etc.

[0220] In the editing and directing service 302, the video frame matching module 3021 can be used to determine the corresponding video script for the user's video generation instruction. The oral content generation module 3022 can be used to generate oral copy based on the copy prompt words generated by the first prompt word generation module 3013; the storyboard description generation module 3023 can be used to generate storyboard description information based on the storyboard prompt words generated by the second prompt word generation module 3014. The oral copy generated by the oral content generation module 3021 can generate corresponding oral audio through the oral audio generation module 3024. The storyboard video generation / matching module 3025 can be used to match the corresponding video material for the storyboard description information from the material library, or generate corresponding synthetic content for the storyboard description information. The background music matching module 3026 can be used to match the background music of the corresponding style for the storyboard. The video material time piling module 3027 can be used to pile the oral copy and the video material in the storyboard video, so that when the storyboard video broadcasts the oral copy, the matching video material is played accordingly. The video synthesis module 3028 can be used to synthesize multiple storyboard videos into a promotional video.

[0221] In the material service 303, the material capture module 3031 can capture videos that can be used as video materials from the Internet and classify the video materials. The material generation module 3032 can be used to provide picture generation and video generation capabilities for the storyboard video generation / matching module 3025. The material management module 3033 can be used for material cleaning and material review to improve the quality of video materials and filter out material videos that do not meet the requirements. The material preprocessing module 3034 can be used to segment the video captured by the material capture module 3031 or the video provided by the user according to the video content, and vectorize each segmented video, and store the video features in the material storage module 3035.

[0222] Figure 4 A device for generating a video script template provided by an embodiment of the present application is shown. Figure 4 As shown, the device for generating the video script template may include:

[0223] The video acquisition module 401 is used to acquire the target video;

[0224] The video parsing module 402 is used to parse the target video to obtain a plurality of storyboard videos and the spoken texts corresponding to the plurality of storyboard videos;

[0225] The information generation module 403 is used to generate the storyboard description information and the text description information of each storyboard video based on the multiple storyboard videos and the oral texts corresponding to the storyboard videos by using the artificial intelligence big model; wherein the storyboard description information is used to describe the screen content of the storyboard video; and the text description information is used to describe the text type of the storyboard video;

[0226] The template generation module 404 is used to generate a script template according to the script structure composed of the multiple storyboard videos and the storyboard description information and text description information of each storyboard video.

[0227] In some embodiments, the video parsing module 402 is specifically used to:

[0228] The target video is segmented according to content similarity to obtain the multiple storyboard videos.

[0229] In some embodiments, the video parsing module 402 is specifically used to:

[0230] Performing frame extraction processing on the target video to obtain multiple video frames;

[0231] Using an artificial intelligence big model to convert the multiple video frames into video features respectively;

[0232] The content similarity between the video frames is calculated based on the video features, and the video frames whose content similarity meets a preset condition are merged into a storyboard video.

[0233] In some embodiments, the video parsing module 402 is specifically used to:

[0234] The multiple video frames are traversed to calculate the content similarity between the current frame and the previous frame. If the content similarity is greater than a preset threshold, the current frame is merged into the previous frame. Otherwise, the current frame is used as the starting frame for content similarity calculation.

[0235] In some embodiments, the video acquisition module 401 is specifically used for:

[0236] In response to a video parsing instruction sent by a client, obtaining a target video indicated by the video parsing instruction;

[0237] In some embodiments, the video script template generation device may further include:

[0238] A template sending module, used for sending the script template to the client;

[0239] An information acquisition module, configured to acquire object description information of a target object in response to a video script generation instruction sent by a client.

[0240] In some embodiments, after generating the script template, the video script template generating device may further include:

[0241] A first copywriting generation module is used to generate a spoken copy for each storyboard based on the object description information and the copywriting description information in the script template using an artificial intelligence big model;

[0242] A first content generation module is used to form the script content of each storyboard from the storyboard description information and the oral copy corresponding to each storyboard;

[0243] The first script generation module is used to construct a video script according to the script structure corresponding to the script template using the script contents corresponding to the multiple storyboards.

[0244] In some embodiments, the video script template generation device may further include:

[0245] A video determination module, configured to determine object description information and a target video of the target object in response to a video script generation instruction for the target object sent by the client;

[0246] In some embodiments, after generating the script template, the video script template generating device may further include:

[0247] A second copywriting generation module is used to generate a spoken copy for each storyboard based on the object description information and the copywriting description information in the script template using an artificial intelligence big model;

[0248] The second content generation module is used to form the script content of each storyboard from the storyboard description information and the oral copy corresponding to each storyboard;

[0249] The second script generation module is used to compose a video script according to the script structure corresponding to the script template using the script contents corresponding to the multiple storyboards.

[0250] In some embodiments, the video script template generation device may further include:

[0251] A script sending module is used to send the video script and / or the download address of the video script to the client so that the client can save the video script.

[0252] In some embodiments, the video script template generation device may further include:

[0253] An acquisition module, used to acquire a target video uploaded by a user through a client;

[0254] An access module, used for obtaining the target video based on an access address sent by a user through the client;

[0255] or,

[0256] The video crawling module is used to crawl target videos that meet the video requirements from the Internet.

[0257] Figure 4 The video script template generation device can execute Figure 2 The implementation principle and technical effect of the method for generating the video script template described in the illustrated embodiment will not be described in detail. The specific manner in which each module and unit performs operations in the device for generating the video script template in the above embodiment has been described in detail in the embodiment of the method, and will not be described in detail here.

[0258] The present application also provides a computing device, such as Figure 5 As shown, the device may include a storage component and a processing component;

[0259] The storage component stores one or more computer instructions, wherein the one or more computer instructions are called and executed by the processing component to implement the method for generating a video script template provided in an embodiment of the present application.

[0260] Of course, the computing device may also include other components, such as input / output interfaces, display components, communication components, etc.

[0261] The processing components in the computing device are used to implement the following Figure 2 In the case of the method for generating the video script template shown, the computing device may also include a display component to perform corresponding display operations.

[0262] The input / output interface provides an interface between the processing component and the peripheral interface module, which may be an output device, an input device, etc. The communication component is configured to facilitate wired or wireless communication between the computing device and other devices.

[0263] The processing component may include one or more processors to execute computer instructions to complete all or part of the steps in the above method. Of course, the processing component may also be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0264] The storage component is configured to store various types of data to support operations at the terminal. The storage component can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0265] The display component may be an electroluminescent (EL) element, a liquid crystal display or a micro display having a similar structure, or a retinal direct display or a similar laser scanning display.

[0266] It should be noted that the above computing device implements Figure 2 In the case of the method for generating the video script template shown, it can be a physical device or an elastic computing host provided by a cloud computing platform, etc. It can be implemented as a distributed cluster consisting of multiple servers or terminal devices, or as a single server or a single terminal device.

[0267] It should be noted that the above computing device can be a physical device or an elastic computing host provided by a cloud computing platform, etc. It can be implemented as a distributed cluster consisting of multiple servers or terminal devices, or as a single server or a single terminal device.

[0268] The present application also provides a computer-readable storage medium storing a computer program, wherein the computer program can achieve the above-mentioned Figure 2 The method for generating a video script template of the embodiment shown. The computer-readable medium may be included in the electronic device described in the above embodiment; or it may exist independently without being assembled into the electronic device.

[0269] The present application also provides a computer program product, which includes a computer program carried on a computer-readable storage medium. When the computer program is executed by a computer, the computer program can achieve the above-mentioned Figure 2 The method for generating a video script template of the illustrated embodiment. In such an embodiment, the computer program can be downloaded and installed from a network, and / or installed from a removable medium. When the computer program is executed by a processor, various functions defined in the system of the present application are executed.

[0270] It should be noted that the embodiments of the present application may involve the use of user data. In actual applications, user-specific personal data can be used in the scheme described herein within the scope permitted by applicable laws and regulations, subject to the requirements of applicable laws and regulations of the country where the user is located (for example, with the user's explicit consent, effective notification to the user, etc.).

[0271] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0272] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0273] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0274] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for generating a video script template, characterized in that: Applied to the server, the method includes: Get the target video; Parsing the target video to obtain a plurality of storyboard videos and spoken texts corresponding to the plurality of storyboard videos; Generate storyboard description information and text description information of each storyboard video based on the multiple storyboard videos and the oral texts corresponding to the storyboard videos by using an artificial intelligence big model; wherein the storyboard description information is used to describe the screen content of the storyboard video; and the text description information is used to describe the text type of the storyboard video; A script template is generated according to the script structure composed of the multiple storyboard videos and the storyboard description information and text description information of each storyboard video.

2. The method according to claim 1, characterized in that The step of parsing the target video to obtain a plurality of storyboard videos comprises: The target video is segmented according to content similarity to obtain the multiple storyboard videos.

3. The method according to claim 2, characterized in that The segmenting of the target video according to content similarity to obtain the plurality of storyboard videos comprises: Performing frame extraction processing on the target video to obtain multiple video frames; Using an artificial intelligence big model to convert the multiple video frames into video features respectively; The content similarity between the video frames is calculated based on the video features, and the video frames whose content similarity meets a preset condition are merged into a storyboard video.

4. The method according to claim 3, characterized in that The calculating the content similarity between the video frames based on the video features and merging the video frames whose content similarity meets a preset condition into a storyboard video comprises: The multiple video frames are traversed to calculate the content similarity between the current frame and the previous frame. If the content similarity is greater than a preset threshold, the current frame is merged into the previous frame. Otherwise, the current frame is used as the starting frame for content similarity calculation.

5. The method according to claim 1, characterized in that The acquiring of the target video comprises: In response to a video parsing instruction sent by a client, obtaining a target video indicated by the video parsing instruction; The method further comprises: Sending the script template to the client; In response to the client sending a video script generation instruction for a target object, obtaining object description information of the target object; After generating the script template, the method further includes: Generate a spoken copy for each storyboard using an artificial intelligence model based on the object description information and the copy description information in the script template; The script content of each storyboard is composed of the storyboard description information and oral copy corresponding to each storyboard; The script contents corresponding to the multiple storyboards respectively constitute a video script according to the script structure corresponding to the script template.

6. The method according to claim 1, characterized in that The method further comprises: In response to a video script generation instruction for a target object sent by a client, determine object description information of the target object and a target video; After generating the script template, the method further includes: Generate a spoken copy for each storyboard using an artificial intelligence model based on the object description information and the copy description information in the script template; The script content of each storyboard is composed of the storyboard description information and oral copy corresponding to each storyboard; The script contents corresponding to the multiple storyboards respectively constitute a video script according to the script structure corresponding to the script template.

7. The method according to claim 5 or 6, characterized in that: The method further comprises: The video script and / or the download address of the video script are sent to the client so that the client can save the video script.

8. The method according to claim 1, characterized in that The acquiring of the target video comprises: Get the target video uploaded by the user through the client; Obtaining the target video based on the access address sent by the user through the client; or, Crawl target videos that meet video requirements from the Internet.

9. A computing device, characterized in that including a processing component and a storage component; The storage component stores one or more computer instructions; the one or more computer instructions are used to be called and executed by the processing component to implement the method for generating a video script template as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by the processing component, the method for generating a video script template as described in any one of claims 1 to 8 is implemented.

11. A computer program product, characterized in that It includes computer programs / instructions, which, when executed by a processing component, implement a method for generating a video script template as described in any one of claims 1 to 8.

Citation Information

Patent Citations

  • Video scripting method

    CN113923521A

  • Video editing template generation method and device, equipment and storage medium

    CN116261012A

  • Propaganda video generation method and device, and storage medium

    CN117241087A

  • Video processing method and device, equipment and medium

    CN117527989A

  • Video generating method and electronic device

    WO2023005194A1

Cited By

  • Scenario generation method and related device

    CN120032374A

  • Generation method of digital human broadcast video, electronic equipment, medium and program product

    CN120935429A

  • Video generation method and device, equipment and storage medium

    CN121126087A

  • Sub-mirror generation method and device, equipment, storage medium and computer program product

    CN121924332A