Video generation method, apparatus, device, storage medium, and program product

Abstract

The present disclosure relates to a video generation method, device, equipment, storage medium and program product, the method comprising: in response to a first instruction triggered for input text, generating first video editing data based on the input text; wherein the first video editing data comprises a first video segment and an audio segment, and a first target video segment in the first video segment is a blank segment; displaying the first video segment and the audio segment on a video editing track of a video editor; in response to a second instruction triggered for a target video segment on the video editor, filling the target video in the first target video segment to obtain second video editing data; and generating a first target video based on the second video editing data. The embodiments of the present disclosure generate first video editing data based on input text, and in the first video editing data, a user can freely select image materials for video editing according to his / her own preferences, thereby meeting the personalized video production requirements.

Description

Technical Field

[0001] This disclosure relates to the field of video processing technology, and in particular to a video generation method, apparatus, device, storage medium, and program product. Background Technology

[0002] With the rapid development of computer and mobile communication technologies, various video platforms based on electronic devices have become widely used, greatly enriching people's daily lives. More and more users are happy to share their video creations on these platforms for other users to watch.

[0003] In related technologies, the process of video production involves: acquiring user-input text; matching the corresponding video image to the input text using an intelligent matching algorithm; and synthesizing the corresponding target video based on the input text and the video image.

[0004] In the video production process described above, the video images are obtained through an intelligent matching algorithm, which may not meet the user's personalized video production needs. Summary of the Invention

[0005] To address the aforementioned technical problems, this disclosure provides a video generation method, apparatus, device, storage medium, and program product. It generates first video editing data based on input text, allowing users to freely select image materials for video editing according to their preferences, thus meeting the needs for personalized video production.

[0006] In a first aspect, embodiments of this disclosure provide a video generation method, including:

[0007] In response to a first instruction triggered by input text, first video editing data is generated based on the input text; wherein, the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively correspond to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment correspond to a target text segment in the at least one text segment, the target audio segment is used to fill in the reading speech matched by the target text segment, and the first target video segment is an empty segment;

[0008] Import the first video editing data into the video editor so that the at least one first video segment and the at least one audio segment are displayed on the video editing track of the video editor, wherein the first target video segment and the target audio segment have the same track timeline interval;

[0009] In response to triggering a second instruction for the first target video segment on the video editor, based on the first video editing data, a first target video is filled into the first target video segment to obtain second video editing data; the first target video is a video obtained based on the first target image material indicated by the second instruction;

[0010] The first target video is generated based on the second edited video data.

[0011] Secondly, embodiments of this disclosure provide a video generation apparatus, comprising:

[0012] A first video editing data determination module is used to generate first video editing data based on the input text in response to a first instruction triggered for the input text; wherein the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively correspond to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment correspond to a target text segment in the at least one text segment, the target audio segment is used to fill the reading voice matched by the target text segment, and the first target video segment is an empty segment of input text;

[0013] The first video editing data import module is used to import the first video editing data into the video editor so that at least one first video segment and at least one audio segment are displayed on the video editing track of the video editor, wherein the first target video segment and the target audio segment have the same track timeline interval.

[0014] The second video editing data determination module is configured to respond to a second instruction triggered on the video editor for the first target video segment, and based on the first video editing data, fill the first target video segment with a first target video to obtain the second video editing data; the first target video is a video obtained based on the first target image material indicated by the second instruction;

[0015] The first target video generation module is used to generate the first target video based on the second edited video data.

[0016] Thirdly, embodiments of this disclosure provide an electronic device, the electronic device comprising:

[0017] One or more processors;

[0018] Storage device for storing one or more programs;

[0019] When the one or more programs are executed by the one or more processors, the one or more processors implement the video generation method as described in any one of the first aspects above.

[0020] Fourthly, embodiments of this disclosure provide a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the video generation method as described in any one of the first aspects above.

[0021] Fifthly, embodiments of this disclosure provide a computer program product comprising a computer program or instructions that, when executed by a processor, implement the video generation method as described in any one of the first aspects above.

[0022] This disclosure provides a video generation method, apparatus, device, storage medium, and program product. The method includes: generating first video editing data based on the input text in response to a first instruction triggered for input text; wherein the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, and the target audio segment being used to fill in a reading phrase matched by the target text segment. The first target video segment is an empty segment; the first video editing data is imported into a video editor so that at least one first video segment and at least one audio segment are displayed on the video editing track of the video editor, and the timeline interval of the first target video segment and the target audio segment are the same; in response to triggering a second instruction for the first target video segment on the video editor, a first target video is filled into the first target video segment based on the first video editing data to obtain second video editing data; the first target video is a video obtained based on the first target image material indicated by the second instruction; a first target video is generated based on the second edited video data. This embodiment of the disclosure generates first video editing data based on input text, in which users can freely select image materials for video editing according to their preferences, meeting the needs for personalized video production. Attached Figure Description

[0023] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0024] Figure 1 An architecture diagram of a video production scenario provided by an embodiment of this disclosure is shown;

[0025] Figure 2 This is a flowchart illustrating a video generation method according to an embodiment of the present disclosure;

[0026] Figure 3 This is a schematic diagram of a video production page according to an embodiment of the present disclosure;

[0027] Figure 4 This is a schematic diagram of a video editing page according to an embodiment of the present disclosure;

[0028] Figure 5 This is a schematic diagram of an image selection page according to an embodiment of the present disclosure;

[0029] Figure 6 This is a schematic diagram of a text editing page according to an embodiment of the present disclosure;

[0030] Figure 7 This is a schematic diagram of a network address identification page according to an embodiment of the present disclosure;

[0031] Figure 8 This is a schematic diagram of another network address identification page in an embodiment of this disclosure;

[0032] Figure 9 This is a schematic diagram of the structure of a video generation device according to an embodiment of the present disclosure;

[0033] Figure 10 This is a schematic diagram of the structure of an electronic device according to an embodiment of this disclosure. Detailed Implementation

[0034] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0035] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0036] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0037] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0038] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0039] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0040] Before providing a further detailed description of the embodiments of this disclosure, the nouns and terms involved in the embodiments of this disclosure will be explained, and the nouns and terms involved in the embodiments of this disclosure shall be interpreted as follows.

[0041] In related technologies, users can create videos on mobile terminals such as smartphones, tablets, and laptops, or other electronic devices. Currently, a common video creation method involves the user pre-writing input text, but lacking suitable images or video materials. In this case, the user typically inputs the text; the video creation client uses an intelligent matching algorithm to match the input text with corresponding image materials, and then synthesizes the target video based on the input text and image materials.

[0042] In the video production process described above, video images are obtained through an intelligent matching algorithm. Users cannot interfere with the image materials matched by this algorithm, which may prevent the matched images from meeting the user's personalized video production needs. For example, a user might want to create a cooking video. The user has pre-written a recipe, specifying the required ingredients and the steps involved, and has taken corresponding photos or short videos for each ingredient and step. Current video production methods would require intelligent matching of image materials based on the recipe. However, for example, the cooking steps involve a specific order and sequence of ingredients. Current intelligent matching algorithms may not be able to accurately match images that meet the user's needs.

[0043] To address the aforementioned technical issues, this disclosure provides a video generation method, comprising: generating first video editing data based on input text in response to a first instruction triggered for input text; wherein the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, the target audio segment being used to fill in the reading speech matched by the target text segment, and the first target video segment being an empty segment; importing the first video editing data into a video editor such that the at least one first video segment and the at least one audio segment are displayed on the video editing track of the video editor, the timeline interval of the first target video segment and the target audio segment being the same; filling in a first target video in the target video segment based on the first video editing data in response to a second instruction triggered for the first target video segment on the video editor, thereby obtaining second video editing data; the first target video being a video obtained based on a first target image material indicated by the second instruction; and generating a first target video based on the second video editing data.

[0044] This embodiment of the disclosure generates first video editing data based on input text. In the first video editing data, users can freely select image materials to edit the video according to their own preferences, thus meeting the needs for personalized video production.

[0045] The embodiments of this disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the same reference numerals will be used to refer to the same elements described in different drawings.

[0046] Figure 1 This is a system that can be used to implement the interactive methods provided in the embodiments of this disclosure. For example... Figure 1 As shown, the system 100 may include multiple user terminals 110, a network 120, a server 130, and a database 140. For example, the system 100 may be used to implement the video generation method described in any embodiment of this disclosure.

[0047] It is understood that user terminal 110 can be any other type of electronic device capable of performing data processing, including but not limited to: mobile phone, site, unit, device, multimedia computer, multimedia tablet, Internet node, communicator, desktop computer, laptop computer, notebook computer, netbook computer, tablet computer, personal communication system (PCS) device, personal navigation device, personal digital assistant (PDA), audio / video player, digital camera / camcorder, positioning device, television receiver, radio broadcast receiver, e-book device, gaming device, or any combination thereof, including accessories and peripherals of such devices, or any combination thereof.

[0048] Users can operate the system through an application installed on user terminal 110. The application transmits user behavior data to server 130 via network 120, and user terminal 110 can also receive data transmitted by server 130 via network 120. The embodiments of this disclosure do not limit the hardware or software system of user terminal 110. For example, user terminal 110 can be based on ARM, x86, or other processors, and can have input / output devices such as a camera, touchscreen, and microphone. It can run operating systems such as Windows, iOS, Linux, Android, and HarmonyOS.

[0049] For example, the application on user terminal 110 can be a video editing application, such as a video editing application based on multimedia resources such as video, images, and text. Taking a video editing application based on multimedia resources such as video, images, and text as an example, users can use the video editing application on user terminal 110 to shoot videos, create scripts, produce videos, and edit videos. They can also watch or browse videos posted by other users and perform operations such as liking, commenting, and forwarding.

[0050] User terminal 110 can implement the video generation method provided in this disclosure embodiment by running a process or thread. In some examples, user terminal 110 can use its built-in application to execute the video generation method. In other examples, user terminal 110 can execute the video generation method by calling an application stored externally on user terminal 110.

[0051] Network 120 can be a single network or a combination of at least two different networks. For example, network 120 can be one or more of the following: local area network (LAN), wide area network (WAN), public network, private network, etc. Network 120 can be a computer network such as the Internet and / or various telecommunications networks (e.g., 3G / 4G / 5G mobile communication networks, Wi-Fi, Bluetooth, ZigBee, etc.), and the embodiments disclosed herein are not limited thereto.

[0052] Server 130 can be a single server, a server cluster, or a cloud server, with servers within the cluster connected via wired or wireless networks. A server cluster can be centralized, such as in a data center, or distributed. Server 130 can be local or remote. Server 130 can communicate with user terminal 110 via wired or wireless networks. The embodiments of this disclosure do not limit the hardware or software systems of server 130.

[0053] Database 140 can refer to any device with storage capabilities. Database 140 is primarily used to store various data used, generated, and output by user terminal 110 and server 130 during their operation. For example, taking the video production application based on multimedia resources such as video, images, and text on user terminal 110 as an example, the data stored in database 140 can include resource data such as videos and text uploaded by users through user terminal 110, as well as interactive operation data such as likes and comments.

[0054] Database 140 can be local or remote. Database 140 may include various types of storage, such as Random Access Memory (RAM), Read Only Memory (ROM), etc. The storage devices mentioned above are merely examples, and the storage devices that system 100 can use are not limited thereto. The embodiments of this disclosure do not limit the hardware and software systems of database 140; for example, it can be a relational database or a non-relational database.

[0055] Database 140 can be interconnected or communicate with server 130 or a part thereof via network 120, or directly interconnected or communicate with server 130, or a combination of the above two methods.

[0056] In some examples, database 140 may be a standalone device. In other examples, database 140 may be integrated into at least one of user terminal 110 and server 130. For example, database 140 may be located on user terminal 110 or on server 130. Alternatively, database 140 may be distributed, with one part located on user terminal 110 and another part on server 130.

[0057] Figure 2 This is a flowchart of a video generation method according to an embodiment of the present disclosure. This embodiment is applicable to situations where video is generated based on input text. The method can be executed by a video generation device, which can be implemented in software and / or hardware. Figure 1 In the electronic devices described herein.

[0058] like Figure 2 As shown, the video generation method provided in this embodiment mainly includes steps S101-S104.

[0059] S101. In response to a first instruction triggered by the input text, generate first video editing data based on the input text; wherein the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively correspond to at least one text segment divided from the input text, the first target video segment in the at least one first video segment and the target audio segment in the at least one audio segment correspond to the target text segment in the at least one text segment, the target audio segment is used to fill the reading voice matched by the target text segment, and the first target video segment is an empty segment.

[0060] Wherein, "responding to" is used to indicate the conditions or states on which the operation performed depends. When the conditions or states on which it depends are met, one or more operations performed can be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0061] The video editing data can be understood as a video editing draft or editing project file, used to record and reproduce the user's video editing process, specifically including the audio and video materials being edited and the instructions for the editing operations performed on the audio and video materials.

[0062] In one embodiment of this disclosure, the first instruction can be understood as an instruction to instruct the client to generate first video editing data based solely on the input text, without requiring intelligent matching of image materials based on the input text. The first instruction triggered in response to the input text may be a response to a user's triggering operation on a first control on the video production page.

[0063] In one embodiment of this disclosure, when a user wants to create a video based on input text, a video creation application can be pre-launched, and one of the subroutines of this application has the function of creating a video based on input text. Alternatively, a video creation application that creates a video based on input text can be launched.

[0064] In one embodiment of this disclosure, the method further includes: displaying a video production page in response to a trigger operation on a video production control, wherein the video production page includes a first control, a second control, and a text editing area, the first control being used to trigger the first instruction in response to a user's trigger operation, the second control being used to trigger the third instruction in response to a user's trigger operation, and the text editing area being used to obtain input text in response to a user's editing operation.

[0065] In this embodiment, a video editing application is launched, and its interface is displayed. The application interface includes video editing controls. In response to a user's triggering action on the video editing controls, a video editing page is displayed. The triggering action can be one or a combination of clicks, long presses, hovering, touches, etc., and is not limited in this embodiment.

[0066] In embodiments of this disclosure, such as Figure 3 As shown, the video production page 30 includes a first control 301, a second control 302, and a text editing area 303. The first control 301 is used to trigger the first instruction in response to the user's trigger operation. The second control 302 is used to trigger the third instruction in response to the user's trigger operation. The text editing area 303 is used to obtain the input text in response to the user's editing operation.

[0067] In this embodiment of the disclosure, a first instruction is triggered in response to a user's operation on the first control, targeting the input text. In response to this first instruction, first video editing data is generated based on the input text. The input text refers to the text stored and displayed in the text editing area when the first instruction is responded to.

[0068] Furthermore, in response to the user's triggering operation on the first control, the first control is selected. Then, in response to the video production control 304 included in the video production page 30, a first instruction triggered based on the input text is triggered. In response to the first instruction, first video editing data is generated based on the input text. The input text refers to the text saved and displayed in the text editing area when the first instruction is responded to.

[0069] In an embodiment of the present disclosure, the input text is divided into at least one text segment, the corresponding reading speech of each target text segment is obtained through intelligent matching, the track timeline alignment is performed on the target text segment and its corresponding reading speech to obtain the corresponding target audio segment, and a vacant segment is acquired as the first target video segment corresponding to the text segment. The first target video segment and the target audio segment are synthesized to obtain a first video segment. The above operations are performed for each target text segment to obtain a plurality of first video segments, and the plurality of first video segments are synthesized according to the sequence of the target text segments in the input text to obtain first video editing data.

[0070] That the first target video segment, the target audio segment and the target text segment correspond to each other can be understood as that the timelines of the three segments are aligned, and the contents expressed are mutually corresponding. For example, the timelines are all segments between 1 minute 55 seconds and 1 minute 57 seconds. For example, the target text segment is "high-temperature stir-frying", and the target audio segment is the reading speech of the four characters "high-temperature stir-frying".

[0071] The first target video segment can be understood as any one of at least one first video segment, and that the first target video segment is vacant can be understood as setting the first target video segment to be vacant in the first video editing data. The vacancy may mean that no image material is set on the video track, or a preset image material is set on the video track, where the preset image material is set by the system and cannot be changed arbitrarily by the user, that is, no matter what the content of the input text is, the corresponding first target video segment is always the set image material. For example, the image material may be a black image. In other words, regardless of the content of the input text, the corresponding first target video segment is always a black picture.

[0072] In an implementation manner of the present disclosure, the first video editing data includes at least one subtitle segment, a target subtitle segment in the at least one subtitle segment corresponds to a target text segment in the at least one text segment, and the target subtitle segment is configured to fill in the text subtitle matched with the target text segment.

[0073] A text subtitle matching the target text segment is added to the first target video segment, so that the user can intuitively see the subtitle corresponding to the reading speech during the process of watching the video, and the user's viewing experience is improved.

[0074] S102. Import the first video editing data into a video editor, so that the at least one first video segment and the at least one audio segment are displayed on a video editing track of the video editor, and the track timeline interval of the first target video segment is the same as that of the target audio segment.

[0075] In the embodiments disclosed herein, such as Figure 4 As shown, the video editing page 40 of the video editor mainly includes a video preview area 401 and a video editing area 402. The video editing area 402 displays video editing tracks, including a video track 403, an audio track 404, and a subtitle track 405. Further, a first video clip is imported into video track 403, an audio clip into audio track 404, and text subtitles into subtitle track 405. In response to operations on the aforementioned video editing tracks, the content imported onto those tracks can be edited. For example, in audio track 404, an audio style can be selected, such as a sweet style, a serious style, etc. Timbre, contrast, etc., can also be edited in audio track 404. That is, all audio-related parameters can be edited on audio track 404. Similarly, all text subtitle-related parameters can be edited on subtitle track 405, such as subtitle color, subtitle appearance method, subtitle font, etc.

[0076] It should be noted that the editing of the above-mentioned tracks can be performed on all audio segments or on a single target audio segment; this embodiment of the present disclosure does not specify a particular limitation. Similarly, the editing of the above-mentioned tracks can be performed on all subtitle segments or on a single target subtitle segment; this embodiment of the present disclosure does not specify a particular limitation.

[0077] In one embodiment of this disclosure, the first target video segment and the target audio segment have the same timeline interval, for example, their timelines are both segments between 1 minute 55 seconds and 1 minute 57 seconds.

[0078] S103. In response to triggering a second instruction for the first target video segment on the video editor, based on the first video editing data, fill the first target video segment with a first target video to obtain second video editing data; the first target video is a video obtained based on the first target image material indicated by the second instruction.

[0079] The first target video segment can be any one of at least one first video segment. Furthermore, the first target video segment can be the video segment that the current user needs to edit.

[0080] In the embodiments disclosed herein, such as Figure 4 As shown, in response to a trigger operation on the first target video segment 406, the page redirects to the image selection page, as follows. Figure 5As shown, the image selection page 50 includes an image preview area 501 and an image selection area 502. The image selection area 502 further includes a local image control 503, a network image control 504, an emoticon control 505, and an image browsing area 506.

[0081] The local image control 503, in response to a user's trigger operation, retrieves images or videos from the local photo album and displays them in the image browsing area. The network image control 504, in response to a user's trigger operation, retrieves images or videos from the network or a database corresponding to the client and displays them in the image browsing area. The emoticon control 505, in response to a user's trigger operation, retrieves commonly used or popular emoticons and displays them in the image browsing area. The image browsing area 506, in response to a user's vertical swipe operation, displays multiple images or short videos by moving them up and down. Furthermore, the image browsing area 506 also responds to a user's trigger operation on an image, designating the image corresponding to the trigger operation as the first target image material, and displays the first target image material in the image preview area 501 for the user to preview.

[0082] Furthermore, the image selection page 50 also includes a shooting control, which is used to respond to the user's operation, call the camera in the terminal to take a picture, and obtain the first target image material.

[0083] Furthermore, the first target image material can be a single image or a video clip. If the first target image material is a single image, image-to-video technology can be used to process the image and obtain the first target video. For example, image-to-video effects or freeze-frame videos. If the first target image material is a video clip, if the video length is different from the target video clip length, the video can be trimmed to the same length as the target video clip. If the video length is the same as the target video clip length, the video can be directly trimmed and inserted into the first target video clip.

[0084] S104. Generate the first target video based on the second edited video data.

[0085] In this embodiment of the disclosure, in response to a trigger operation for video generation, a first target video is generated based on second video editing data. The trigger operation for video generation may refer to a trigger operation on the export control 407 in the video editing page 40. The export method may be to save the first target video locally or to share it to other video sharing platforms or websites. This embodiment of the disclosure does not impose specific limitations.

[0086] Based on the above embodiments, the method further includes: generating third video editing data based on the input text in response to a third instruction triggered for the input text; wherein the third video editing data includes at least one second video segment and the at least one audio segment, the at least one second video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a second target video segment in the at least one second video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, the second target video segment being a video obtained based on a second target image material, the second target image material matching the target text segment; importing the third video editing data into a video editor such that the at least one second video segment and the at least one audio segment are displayed on the video editing track of the video editor, the second target video segment and the target audio segment having the same timeline interval; and generating a second target video based on the third video editing data.

[0087] The third instruction refers to an instruction used to intelligently match image materials for the input text, thereby generating the first video data. The second target image material is matched based on the target text fragment, and is obtained by matching image materials for the target text fragment using an intelligent matching algorithm.

[0088] In one embodiment of this disclosure, after obtaining the third video editing data, in response to the triggering operation of video generation, a target video is generated based on the edited third video editing data.

[0089] In one embodiment of this disclosure, after obtaining the third video editing data, it can be imported into a video editor for editing. The specific editing method can be referred to the description in the above embodiments, and will not be repeated in this embodiment. After editing the third video editing data, in response to the trigger operation for video generation, the target video is generated based on the edited third video editing data.

[0090] This disclosure provides a video generation method, comprising: generating first video editing data based on the input text in response to a first instruction triggered for input text; wherein the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, the target audio segment being used to fill in the reading speech matched by the target text segment, and the first target video segment being an empty segment; importing the first video editing data into a video editor such that the at least one first video segment and the at least one audio segment are displayed on the video editing track of the video editor, the timeline interval of the first target video segment and the target audio segment being the same; in response to a second instruction triggered on the video editor for the first target video segment, filling the first target video segment with a first target video based on the first video editing data to obtain second video editing data; the first target video being a video obtained based on a first target image material indicated by the second instruction; and generating a first target video based on the second edited video data. This embodiment of the disclosure generates first video editing data based on input text. In the first video editing data, users can freely select image materials to edit the video according to their own preferences, thus meeting the needs for personalized video production.

[0091] Based on the above embodiments, this disclosure provides several methods for the video production page 40 to obtain input text in response to user editing operations, as follows:

[0092] In one embodiment of this disclosure, obtaining input text in response to a user's editing operation includes: displaying a text input page in response to a triggering operation on the text editing area; and obtaining the input text corresponding to the input operation in response to an input operation on the text input page.

[0093] In the embodiments disclosed herein, such as Figure 3 As shown, in response to a trigger operation on the text editing area, a text input page is displayed, such as... Figure 6 As shown, the text input page 60 includes a title editing area 601, a content editing area 602, and an editing completion control 603.

[0094] Both the title editing area 601 and the content editing area 602 can respond to user operations on the virtual keyboard, physical keyboard, etc., on the terminal to obtain the text input by the user. This disclosure does not limit the above-mentioned input methods. Other methods of obtaining input text, such as recognizing text in an image via OTC or recognizing the user's voice, are all within the scope of this disclosure.

[0095] Furthermore, in response to the triggering operation of the editing completion control 603, the input text in the title editing area 601 and the content editing area 602 is obtained as the input text in the text editing area, and the user is redirected to the video production page 30.

[0096] In one embodiment of this disclosure, the text editing area includes a network address copy control, which receives input text in response to a user's editing operation, including: displaying a network address input area in response to a trigger operation on the network address copy control; receiving the network address corresponding to the input operation in response to an operation on the network address input area; and obtaining the input text corresponding to the network address.

[0097] In the embodiments disclosed herein, such as Figure 3 As shown, the text editing area 303 includes a network address copy control 304. In response to a trigger operation on the network address copy control, the following is displayed: Figure 7 The overlay area 701 shown includes a network address input area 702. Within this overlay area 701, users can enter addresses in the network address input area 702 via keyboard input or by copying and pasting.

[0098] Furthermore, in response to a trigger operation on the text acquisition control 703 in the overlay area 701, the network address in the network address input area 702 is received and the web page content corresponding to the URL is used as the input text in the text editing area 303.

[0099] In one embodiment of this disclosure, obtaining the input text corresponding to the network address includes: determining whether there is original input text in the text editing area; if there is original input text in the text editing area, deleting the original input text and obtaining the input text corresponding to the network address.

[0100] In this embodiment, the original input text refers to the input text entered in the text editing area before the webpage content corresponding to the URL is retrieved. It is determined whether original input text exists in the text editing area; if so, a prompt pop-up is displayed to prompt the user whether to delete the original input text in the text editing area. In response to a trigger operation of the delete input text control, the original input text is deleted, and the input text corresponding to the network address is retrieved. In response to a trigger operation of the cancel control, no processing is performed on the original input text; that is, the original input text remains in the text editing area.

[0101] In this embodiment of the disclosure, the original input text refers to the input text entered in the text editing area before the webpage content corresponding to the URL is retrieved. It is determined whether original input text exists in the text editing area; if original input text exists in the text editing area, the user is prompted to select the insertion position of the input text corresponding to the network address. Based on the user's selection, the input text corresponding to the network address is inserted into the corresponding position of the original input text.

[0102] In one embodiment of this disclosure, after responding to the triggering operation of the video production control, the method further includes: obtaining a network address carried on the clipboard; obtaining input text corresponding to the network address; and displaying a video production page, wherein the video production page includes a text editing area for displaying the input text corresponding to the network address.

[0103] In one embodiment of this disclosure, in response to a triggering operation on the video production control, a network address carried on the clipboard is detected and acquired. For example... Figure 8 As shown, if a network address is included, a prompt box is displayed. This prompt box displays the included network address and prompts the user to confirm whether the webpage content corresponding to the network address is recognized. In response to the confirmation control 801 in the prompt box, the network address is received, and the webpage content corresponding to the address is used as input text in the text editing area 103. In response to the cancellation control 802 in the prompt box, the network address is ignored, and the user is redirected to the text acquisition interface 10. At this time, there is no input text in the text editing area 303 of the text acquisition interface 30.

[0104] In this embodiment of the disclosure, multiple text input methods are provided according to different situations to facilitate user selection.

[0105] Figure 9This is a schematic diagram of a video generation device according to an embodiment of the present disclosure. This embodiment is applicable to the situation of generating video based on input text. The video generation device can be implemented in software and / or hardware.

[0106] like Figure 9 As shown, the video generation device 90 provided in this embodiment mainly includes: a first video editing data determination module 91, a first video editing data import module 92, a second video editing data determination module 93, and a first target video generation module 94.

[0107] The first video editing data determination module 91 is used to generate first video editing data based on the input text in response to a first instruction triggered by the input text. The first video editing data includes at least one first video segment and at least one audio segment, each corresponding to at least one text segment divided from the input text. A first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment correspond to a target text segment in the at least one text segment. The target audio segment is used to fill in the reading voice matching the target text segment. The first target video segment is an empty segment of input text. The first video editing data import module 92... The second video editing data determination module 93 is used to import the first video editing data into the video editor so that at least one first video segment and at least one audio segment are displayed on the video editing track of the video editor, wherein the timeline interval of the first target video segment and the target audio segment are the same; the second video editing data determination module 93 is used to fill the first target video segment with a first target video based on the first video editing data in response to triggering a second instruction for the first target video segment on the video editor, thereby obtaining the second video editing data; the first target video is a video obtained based on the first target image material indicated by the second instruction; the first target video generation module 94 is used to generate the first target video based on the second edited video data.

[0108] In one embodiment of this disclosure, the first video editing data includes at least one subtitle segment, wherein a target subtitle segment in the at least one subtitle segment corresponds to a target text segment in the at least one text segment, and the target subtitle segment is used to fill in the text subtitle that matches the target text segment.

[0109] In one embodiment of this disclosure, the apparatus further includes: a third video editing data generation module, configured to generate third video editing data based on the input text in response to a third instruction triggered for the input text; wherein the third video editing data includes at least one second video segment and the at least one audio segment, the at least one second video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a second target video segment in the at least one second video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, the second target video segment being a video obtained based on second target image material, the second target image material matching the target text segment; a third video editing data import module, configured to import the third video editing data into a video editor, such that the at least one second video segment and the at least one audio segment are displayed on the video editing track of the video editor, the second target video segment and the target audio segment having the same track timeline interval; and a second target video generation module, configured to generate a second target video based on the third video editing data.

[0110] In one embodiment of this disclosure, the apparatus further includes: a video production page display module, configured to display a video production page in response to a trigger operation of a video production control, wherein the video production page includes a first control, a second control, and a text editing area, the first control being configured to trigger a first instruction in response to a user's trigger operation, the second control being configured to trigger a third instruction in response to a user's trigger operation, and the text editing area being configured to obtain input text in response to a user's editing operation.

[0111] In one embodiment of this disclosure, obtaining input text in response to a user's editing operation includes: displaying a text input page in response to a triggering operation on the text editing area; and obtaining the input text corresponding to the input operation in response to an input operation on the text input page.

[0112] In one embodiment of this disclosure, the text editing area includes a network address copy control, which receives input text in response to a user's editing operation, including: displaying a network address input area in response to a trigger operation on the network address copy control; receiving the network address corresponding to the input operation in response to an operation on the network address input area; and obtaining the input text corresponding to the network address.

[0113] In one embodiment of this disclosure, obtaining the input text corresponding to the network address includes: determining whether there is original input text in the text editing area; if there is original input text in the text editing area, deleting the original input text and obtaining the input text corresponding to the network address.

[0114] In one embodiment of this disclosure, after responding to the triggering operation of the video production control, the method further includes: obtaining a network address carried on the clipboard; obtaining input text corresponding to the network address; and displaying a video production page, wherein the video production page includes a text editing area for displaying the input text corresponding to the network address.

[0115] The video generation apparatus provided in this disclosure embodiment can execute the steps performed in the video generation method provided in this disclosure method embodiment, and has the execution steps and beneficial effects, which will not be repeated here.

[0116] Figure 10 This is a schematic diagram of the structure of an electronic device according to an embodiment of this disclosure. See below for details. Figure 10 The diagram illustrates a structural schematic suitable for implementing the electronic device 1000 in the embodiments of this disclosure. The electronic device 1000 in the embodiments of this disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), wearable terminal devices, etc., as well as fixed terminals such as digital TVs, desktop computers, smart home devices, etc. Figure 10 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0117] like Figure 10 As shown, the electronic device 1000 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003 to implement the image rendering method as described in the embodiments of this disclosure. The RAM 1003 also stores various programs and data required for the operation of the terminal device 1000. The processing device 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0118] Typically, the following devices can be connected to the I / O interface 1005: input devices 1006 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1007 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1008 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows terminal device 1000 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 10 A terminal device 1000 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0119] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts, thereby implementing the video generation method as described above. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1009, or installed from storage device 1008, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0120] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0121] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0122] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0123] The aforementioned computer-readable medium carries one or more programs that, when executed by the terminal device, cause the terminal device to: generate first video editing data based on the input text in response to a first instruction triggered in response to the input text; wherein the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, and the target audio segment being used to fill the target text segment. The accompanying audio is provided, and the first target video segment is an empty segment; the first video editing data is imported into the video editor so that at least one first video segment and at least one audio segment are displayed on the video editing track of the video editor, and the timeline interval of the first target video segment and the target audio segment is the same; in response to triggering a second instruction for the first target video segment on the video editor, a first target video is filled into the first target video segment based on the first video editing data to obtain second video editing data; the first target video is a video obtained based on the first target image material indicated by the second instruction; the first target video is generated based on the second edited video data.

[0124] Optionally, when one or more of the above-mentioned programs are executed by the terminal device, the terminal device may also execute other steps described in the above embodiments.

[0125] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0126] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0127] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0128] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0129] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0130] According to one or more embodiments of this disclosure, a video generation method is provided, comprising: generating first video editing data based on the input text in response to a first instruction triggered for input text; wherein the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, the target audio segment being used to fill in the reading speech matched by the target text segment, and the first target video segment being an empty segment; importing the first video editing data into a video editor such that the at least one first video segment and the at least one audio segment are displayed on the video editing track of the video editor, the track timeline interval of the first target video segment and the target audio segment being the same; in response to a second instruction triggered for the first target video segment on the video editor, filling the first target video segment with a first target video based on the first video editing data to obtain second video editing data; the first target video is a video obtained based on a first target image material indicated by the second instruction; and generating a first target video based on the second edited video data.

[0131] According to one or more embodiments of this disclosure, this disclosure provides a video generation method, wherein the first video editing data includes at least one subtitle segment, a target subtitle segment in the at least one subtitle segment corresponds to a target text segment in the at least one text segment, and the target subtitle segment is used to fill in a text subtitle that matches the target text segment.

[0132] According to one or more embodiments of this disclosure, this disclosure provides a video generation method, wherein the method further includes: generating third video editing data based on the input text in response to a third instruction triggered for input text; wherein the third video editing data includes at least one second video segment and the at least one audio segment, the at least one second video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a second target video segment in the at least one second video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, the second target video segment being a video obtained based on second target image material, the second target image material matching the target text segment; importing the third video editing data into a video editor such that the at least one second video segment and the at least one audio segment are displayed on the video editing track of the video editor, the second target video segment and the target audio segment having the same track timeline interval; and generating a second target video based on the third edited video data.

[0133] According to one or more embodiments of this disclosure, this disclosure provides a video generation method, wherein the method further includes: displaying a video production page in response to a trigger operation of a video production control, wherein the video production page includes a first control, a second control, and a text editing area, the first control is used to trigger a first instruction in response to a user's trigger operation, the second control is used to trigger a third instruction in response to a user's trigger operation, and the text editing area is used to obtain input text in response to a user's editing operation.

[0134] According to one or more embodiments of this disclosure, this disclosure provides a video generation method, wherein obtaining input text in response to a user's editing operation includes: displaying a text input page in response to a triggering operation on the text editing area; and obtaining the input text corresponding to the input operation in response to an input operation on the text input page.

[0135] According to one or more embodiments of this disclosure, this disclosure provides a video generation method, wherein the text editing area includes a network address copy control, and the method acquires input text in response to a user's editing operation, including: displaying a network address input area in response to a trigger operation on the network address copy control; receiving a network address corresponding to the input operation in response to an operation on the network address input area; and acquiring the input text corresponding to the network address.

[0136] According to one or more embodiments of this disclosure, this disclosure provides a video generation method, wherein obtaining the input text corresponding to the network address includes: determining whether there is original input text in the text editing area; if there is original input text in the text editing area, deleting the original input text and obtaining the input text corresponding to the network address.

[0137] According to one or more embodiments of this disclosure, this disclosure provides a video generation method, wherein, after responding to a trigger operation on a video production control, the method further includes: obtaining a network address carried on the clipboard; obtaining input text corresponding to the network address; and displaying a video production page, wherein the video production page includes a text editing area for displaying the input text corresponding to the network address.

[0138] According to one or more embodiments of this disclosure, a video generation apparatus is provided, the apparatus comprising: a first video editing data determining module, configured to generate first video editing data based on the input text in response to a first instruction triggered for input text; wherein the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, the target audio segment being used to fill in the reading speech matched by the target text segment, and the first target video segment being an empty segment input. The system comprises: a first video editing data import module, configured to import the first video editing data into the video editor, so that at least one first video segment and at least one audio segment are displayed on the video editing track of the video editor, wherein the timeline interval of the first target video segment and the target audio segment are the same; a second video editing data determination module, configured to, in response to triggering a second instruction for the first target video segment on the video editor, fill the first target video segment with a first target video based on the first video editing data to obtain the second video editing data; the first target video is a video obtained based on the first target image material indicated by the second instruction; and a first target video generation module, configured to generate the first target video based on the second edited video data.

[0139] According to one or more embodiments of this disclosure, this disclosure provides a video generation apparatus, wherein the first video editing data includes at least one subtitle segment, a target subtitle segment in the at least one subtitle segment corresponds to a target text segment in the at least one text segment, and the target subtitle segment is used to fill in a text subtitle that matches the target text segment.

[0140] According to one or more embodiments of this disclosure, a video generation apparatus is provided, wherein the apparatus further includes: a third video editing data generation module, configured to generate third video editing data based on the input text in response to a third instruction triggered for input text; wherein the third video editing data includes at least one second video segment and the at least one audio segment, the at least one second video segment and the at least one audio segment respectively corresponding to at least one text segment divided from the input text, a second target video segment in the at least one second video segment and a target audio segment in the at least one audio segment corresponding to a target text segment in the at least one text segment, the second target video segment being a video obtained based on second target image material, the second target image material matching the target text segment; a third video editing data import module, configured to import the third video editing data into a video editor such that the at least one second video segment and the at least one audio segment are displayed on the video editing track of the video editor, the second target video segment and the target audio segment having the same timeline interval; and a second target video generation module, configured to generate a second target video based on the third video editing data.

[0141] According to one or more embodiments of this disclosure, this disclosure provides a video generation apparatus, wherein the apparatus further includes: a video production page display module, configured to display a video production page in response to a trigger operation of a video production control, wherein the video production page includes a first control, a second control, and a text editing area, the first control being configured to trigger a first instruction in response to a user's trigger operation, the second control being configured to trigger a third instruction in response to a user's trigger operation, and the text editing area being configured to acquire input text in response to a user's editing operation.

[0142] According to one or more embodiments of this disclosure, this disclosure provides a video generation apparatus, wherein acquiring input text in response to a user's editing operation includes: displaying a text input page in response to a triggering operation on the text editing area; and acquiring the input text corresponding to the input operation in response to an input operation on the text input page.

[0143] According to one or more embodiments of this disclosure, this disclosure provides a video generation apparatus, wherein the text editing area includes a network address copy control, and the apparatus acquires input text in response to a user's editing operation, including: displaying a network address input area in response to a trigger operation on the network address copy control; receiving a network address corresponding to the input operation in response to an operation on the network address input area; and acquiring the input text corresponding to the network address.

[0144] According to one or more embodiments of this disclosure, this disclosure provides a video generation apparatus, wherein obtaining the input text corresponding to the network address includes: determining whether there is original input text in the text editing area; if there is original input text in the text editing area, deleting the original input text and obtaining the input text corresponding to the network address.

[0145] According to one or more embodiments of this disclosure, this disclosure provides a video generation apparatus, wherein, after responding to a trigger operation on a video production control, the apparatus further includes: obtaining a network address carried on a clipboard; obtaining input text corresponding to the network address; and displaying a video production page, wherein the video production page includes a text editing area for displaying the input text corresponding to the network address.

[0146] According to one or more embodiments of this disclosure, this disclosure provides an electronic device, including:

[0147] One or more processors;

[0148] Memory, used to store one or more programs;

[0149] When the one or more programs are executed by the one or more processors, the one or more processors implement any of the video generation methods provided in this disclosure.

[0150] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements a video generation method as described in any of the present disclosure.

[0151] This disclosure also provides a computer program product, which includes a computer program or instructions that, when executed by a processor, implement the video generation method described above.

[0152] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0153] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0154] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A video generation method, characterized in that, include: In response to a trigger operation on the video production control, a video production page is displayed, wherein the video production page includes a first control and a second control. The first control is used to trigger a first instruction in response to a user's trigger operation, and the second control is used to trigger a third instruction in response to a user's trigger operation. The third instruction is used to intelligently match image materials for the input text to generate corresponding video editing data. In response to a first instruction triggered by input text, first video editing data is generated based on the input text; wherein, the first instruction is used to instruct that the first video editing data be generated only based on the input text, the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively correspond to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment correspond to a target text segment in the at least one text segment, the target audio segment is used to fill in the reading voice matched by the target text segment, and the first target video segment is an empty segment used to fill in the video generated by the image material selected by the user; Import the first video editing data into the video editor so that the at least one first video segment and the at least one audio segment are displayed on the video editing track of the video editor, wherein the first target video segment and the target audio segment have the same track timeline interval; In response to triggering a second instruction for the first target video segment on the video editor, based on the first video editing data, a first target video is filled into the first target video segment to obtain second video editing data; the first target video is a video obtained based on the first target image material indicated by the second instruction; Based on the second edited video data, generate the first target video; The step of generating first video editing data based on the input text in response to a first instruction triggered by the input text includes: Divide the input text into at least one text segment; Generate at least one first video segment corresponding to each of the at least one text segment; wherein the first video segment is synthesized from the first target video segment and the target audio segment; The at least one first video segment is synthesized according to the sequential order of the at least one text segment in the input text to generate first video editing data.

2. The method according to claim 1, characterized in that, The first video editing data includes at least one subtitle segment, wherein a target subtitle segment in the at least one subtitle segment corresponds to a target text segment in the at least one text segment, and the target subtitle segment is used to fill the text subtitle that matches the target text segment.

3. The method according to claim 1, characterized in that, The method further includes: In response to a third instruction triggered by input text, third video editing data is generated based on the input text; wherein, the third video editing data includes at least one second video segment and at least one audio segment, the at least one second video segment and the at least one audio segment respectively correspond to at least one text segment divided from the input text, a second target video segment in the at least one second video segment and a target audio segment in the at least one audio segment correspond to a target text segment in the at least one text segment, the second target video segment is a video obtained based on a second target image material, and the second target image material matches the target text segment; Import the third video editing data into the video editor so that at least one second video clip and at least one audio clip are displayed on the video editing track of the video editor, wherein the second target video clip and the target audio clip have the same timeline interval. A second target video is generated based on the third edited video data.

4. The method according to claim 3, characterized in that, The video production page also includes a text editing area, which is used to obtain input text in response to user editing operations.

5. The method according to claim 4, characterized in that, Respond to user editing actions to obtain input text, including: In response to a trigger operation on the text editing area, a text input page is displayed; In response to an input operation on the text input page, the input text corresponding to the input operation is obtained.

6. The method according to claim 4, characterized in that, The text editing area includes a network address copy control, which responds to user editing operations to obtain input text, including: In response to a trigger operation on the network address copy control, the network address input area is displayed; In response to an operation on the network address input area, receive the network address corresponding to the input operation; Obtain the input text corresponding to the network address.

7. The method according to claim 6, characterized in that, The step of obtaining the input text corresponding to the network address includes: Determine whether the original input text exists within the text editing area; If the original input text exists within the text editing area, the original input text is deleted, and the input text corresponding to the network address is obtained.

8. The method according to claim 6, characterized in that, The response to the triggering operation of the video production control further includes: Get the network address carried on the clipboard; Obtain the input text corresponding to the network address; The video production page is displayed, which includes a text editing area for displaying the input text corresponding to the network address.

9. A video generation apparatus, characterized in that, include: A video production page display module is used to display a video production page in response to a trigger operation of a video production control. The video production page includes a first control and a second control. The first control is used to trigger a first instruction in response to a user's trigger operation. The second control is used to trigger a third instruction in response to a user's trigger operation. The third instruction is used to intelligently match image materials for input text to generate corresponding video editing data. A first video editing data determination module is configured to generate first video editing data based on the input text in response to a first instruction triggered by the input text; wherein the first instruction is configured to instruct that the first video editing data be generated only based on the input text, the first video editing data includes at least one first video segment and at least one audio segment, the at least one first video segment and the at least one audio segment respectively correspond to at least one text segment divided from the input text, a first target video segment in the at least one first video segment and a target audio segment in the at least one audio segment correspond to a target text segment in the at least one text segment, the target audio segment is used to fill in the reading voice matched by the target text segment, and the first target video segment is an empty segment used to fill in the video generated by the image material selected by the user; The first video editing data import module is used to import the first video editing data into the video editor so that at least one first video segment and at least one audio segment are displayed on the video editing track of the video editor, wherein the first target video segment and the target audio segment have the same track timeline interval. The second video editing data determination module is configured to respond to a second instruction triggered on the video editor for the first target video segment, and based on the first video editing data, fill the first target video segment with a first target video to obtain the second video editing data; the first target video is a video obtained based on the first target image material indicated by the second instruction; The first target video generation module is used to generate the first target video based on the second edited video data; The first video editing data determination module is specifically used for: Divide the input text into at least one text segment; Generate at least one first video segment corresponding to each of the at least one text segment; wherein the first video segment is synthesized from the first target video segment and the target audio segment; The at least one first video segment is synthesized according to the sequential order of the at least one text segment in the input text to generate first video editing data.

10. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-8.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-8.

12. A computer program product comprising a computer program or instructions that, when executed by a processor, implement the method as described in any one of claims 1-8.

Images