Video processing method and device, computer equipment, storage medium and program product

Abstract

The invention provides a video processing method and device, computer equipment, a storage medium and a program product. The method comprises the following steps: displaying a video processing page; wherein the video processing page comprises a script editing area, and the script editing area comprises a pause insertion control; in response to a trigger instruction for the pause insertion control, inserting a pause character in a script; generating a target video based on the script with the pause character, wherein the target video comprises an audio; wherein the audio comprises a pause of a preset duration corresponding to the pause character, and a target object in the target video pauses for the preset duration when the target video is played to a position corresponding to the pause character. According to the video processing method and device, the computer equipment, the storage medium and the program product provided by the invention, pauses can be conveniently added.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a video processing method and apparatus, computer equipment, storage medium, and program product. Background Art

[0002] With the development of computer technology, many tasks can be completed intelligently. For example, generative technology can be used to generate videos based on text and images, thus reducing people's work.

[0003] However, the inventors of the present disclosure have discovered that, in the related art, it is difficult to set pauses when generating a video based on text and images. Summary of the Invention

[0004] The present disclosure proposes a video processing method and apparatus, computer equipment, storage medium, and program product to solve or partially solve the above-mentioned problems.

[0005] In a first aspect, the present disclosure provides a video processing method, comprising:

[0006] Displaying a video processing page; wherein the video processing page includes a script editing area, and the script editing area includes a pause insertion control;

[0007] In response to a trigger instruction for the pause insertion control, inserting a pause character into the script;

[0008] generating a target video based on the script with the pause character, wherein the target video includes audio;

[0009] The audio includes a pause of a preset duration corresponding to the pause character, and the target object in the target video pauses for the preset duration when the target video is played to the position corresponding to the pause character.

[0010] In a second aspect of the present disclosure, a video processing device is provided, comprising:

[0011] A display module is configured to: display a video processing page; wherein the video processing page includes a script editing area, and the script editing area includes a pause insertion control;

[0012] An inserting module is configured to: insert a pause character into the script in response to a trigger instruction for the pause insertion control;

[0013] A generating module is configured to: generate a target video based on the script with the pause character, wherein the target video includes audio;

[0014] The audio includes a pause of a preset duration corresponding to the pause character, and the target object in the target video pauses for the preset duration when the target video is played to the position corresponding to the pause character.

[0015] In a third aspect of the present disclosure, a computer device is provided, comprising one or more processors, a memory; and one or more programs, wherein the one or more programs are stored in the memory and executed by the one or more processors, and the one or more programs include instructions for executing the method described in the first aspect.

[0016] According to a fourth aspect of the present disclosure, a non-volatile computer-readable storage medium containing a computer program is provided. When the computer program is executed by one or more processors, the one or more processors execute the method described in the first aspect.

[0017] In a fifth aspect of the present disclosure, a computer program product is provided, comprising one or more computer programs, which, when executed by one or more processors, implement the method described in the first aspect.

[0018] The video processing method and apparatus, computer equipment, storage medium, and program product provided by the embodiments of the present disclosure utilize a pause insertion control to insert a pause character into a script, and then generate a target video based on the script with the pause character, so that the audio can include a pause of a preset length corresponding to the pause character and the target object in the target video pauses for the preset length when the target video is played to the position corresponding to the pause character, thereby achieving an effect of synchronized pause of audio and video and improving the video effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the present disclosure or related technologies, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are only embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 A schematic diagram showing an exemplary system provided by an embodiment of the present disclosure is shown.

[0021] Figure 2A A schematic diagram of an exemplary page according to an embodiment of the present disclosure is shown.

[0022] Figure 2B Another schematic diagram of an exemplary page according to an embodiment of the present disclosure is shown.

[0023] Figure 2CAnother schematic diagram of an exemplary page according to an embodiment of the present disclosure is shown.

[0024] Figure 2D Another schematic diagram of an exemplary page according to an embodiment of the present disclosure is shown.

[0025] Figure 2E Another schematic diagram of an exemplary page according to an embodiment of the present disclosure is shown.

[0026] Figure 3 A flowchart of an exemplary method provided by an embodiment of the present disclosure is shown.

[0027] Figure 4 A schematic diagram showing an exemplary device provided by an embodiment of the present disclosure is shown.

[0028] Figure 5 A schematic diagram of the hardware structure of an exemplary computer device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0029] In order to make the objectives, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0030] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present disclosure should have the usual meanings understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the embodiments of the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative position relationships. When the absolute position of the described object changes, the relative position relationship may also change accordingly.

[0031] It is understandable that before using the technical solutions of each embodiment of the present disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the user's authorization will be obtained.

[0032] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operation of the disclosed technical solution based on the prompt message.

[0033] As an optional but non-limiting implementation, in response to a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0034] It is understandable that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0035] Figure 1 FIG. 1 is a schematic diagram of an exemplary system 100 provided by an embodiment of the present disclosure.

[0036] like Figure 1 As shown, the system 100 may include terminal devices 102A and 102B, a server 106, and a database server 108. A medium (e.g., a network) providing a communication link may be included between the terminal devices 102A and 102B and the server 106 and the database server 108. The network may include various connection types, such as wired or wireless communication links or fiber optic cables.

[0037] Various applications (APPs) or software can be installed on the terminal devices 102A and 102B, such as video generation applications or software, image generation applications or software, collaborative office applications or software, image processing applications or software, video conferencing applications or software, reading applications or software, video applications or software, social applications or software, payment applications or software, web browsers and instant messaging tools, etc.

[0038] The terminal devices 102A and 102B herein can be either hardware or software. When the terminal devices 102A and 102B are hardware, they can be various electronic devices or computer devices with display screens, including but not limited to smartphones, tablet computers, e-book readers, MP3 players, laptop computers, and desktop computers (PCs). When the terminal devices 102A and 102B are software, they can be installed in the electronic devices listed above. They can be implemented as multiple software programs or software modules (for example, to provide distributed services), or as a single software program or software module. This is not specifically limited here.

[0039] Server 106 may be a server that provides various services, such as a backend server that supports various applications or software displayed on terminal devices 102A and 102B. Database server 108 may also be a database server that provides various services. It is understood that if server 106 can perform the functions related to database server 108, database server 108 may not be provided in system 100.

[0040] The server 106 and database server 108 herein can also be hardware or software. When they are hardware, they can be implemented as a distributed server cluster consisting of multiple servers, or as a single server. When they are software, they can be implemented as multiple software programs or software modules (for example, to provide distributed services), or as a single software program or software module. No specific limitations are imposed herein.

[0041] It should be noted that the video processing method provided in the embodiment of the present disclosure can be executed by the terminal devices 102A and 102B or interactively executed by the devices in the system 100. It should be understood that Figure 1 The numbers of terminal devices, users, servers and database servers in the embodiment are merely illustrative. Any number of terminal devices, users, servers and database servers may be provided as required.

[0042] In some exemplary scenarios, user 104A may generate a video using video generation software installed in terminal device 102A, and user 104B may watch the video generated by user 104A using a video application installed in terminal device 102B.

[0043] Figure 2A A schematic diagram of an exemplary page 200 according to an embodiment of the present disclosure is shown.

[0044] like Figure 2AAs shown, exemplarily, user 104A can open the video generation software installed in terminal device 102A and enter page 200 for generating video. Optionally, page 200 may include tab 112 and tab 114. When tab 112 is triggered (for example, clicked), a virtual image tab page may be displayed in page 200, and the tab page may include various operation controls for editing the virtual image (or digital human (English: avatar)), so that the generated video may include the virtual image. Since the virtual image can also be called a digital human (avatar), the generated video can also be a digital human video. When tab 114 is triggered (for example, clicked), a script tab page may be displayed in page 200, and the tab page may include a script editing area 110A, such as Figure 2A As shown, the user 104A can edit a script in the area 110A, and the script is used to generate the voice of the virtual image (or digital human).

[0045] Reference Figure 2A For example, user 104A can first set up a virtual image for generating a video in the virtual image tab. Optionally, user 104A can upload a picture containing the target object or a video clip containing the target object. Accordingly, the video generation algorithm can generate a video containing the target object based on the uploaded picture or video. Optionally, the video generation software can also have some built-in virtual images for users to choose as target objects, and user 104A can select one or more from them to generate a video. Then, user 104A can trigger tag 114 to enter the script tab, such as Figure 2A As shown, the script can be edited in the script editing area 110A. Figure 2A As shown, for example, the script editing area 110A may already include a script 202 edited by the user 104A. Optionally, the user 104A may continue to edit the script 202 in the area 110A, and the edited script 202 may be used to generate the audio (or voice) corresponding to the target video. Figure 2A As shown, the page 200 may further include a preview area 110B, which may be used to display a selected image or video, which may include a target object 1102. Optionally, the preview video may also include preview subtitles 1104, so that the user can see the approximate effect of the subtitles in the final generated video based on the effect of the preview subtitles 1104. Figure 2AAs shown, page 200 may also include various controls for selecting subtitle styles. By triggering the corresponding control, the subtitle style can be changed, and the preview subtitles 1104 in preview area 110B can be changed synchronously. These controls may also include font information for the corresponding style effects, so that the user can intuitively see the subtitle style effects that each control can produce.

[0046] After completing all editing tasks, user 104A can click the export button 116 to generate the final video. Alternatively, if terminal device 102A has the ability to generate videos (e.g., video generation software includes a video generation algorithm), the target video can be generated based on the script and the image or video on terminal device 102A. Alternatively, if terminal device 102A does not have the ability to generate videos, the script and the image or video can be uploaded to server 106, so that server 106 can call the corresponding video generation algorithm to generate the target video.

[0047] Optionally, the process of generating a video can be to generate audio and subtitles corresponding to the target video based on the script, and then use the audio as a driving signal to drive the movements and mouth shapes of the target object in the uploaded picture or video to generate the target video and add subtitles generated based on the script to the target video.

[0048] In some cases, users may wish to add pauses to a generated video to make it appear more natural, or to leave some blank space in the video and add some effects. However, the inventors of the present disclosure have found that simply editing the script is difficult to achieve the desired pause effect.

[0049] Therefore, in some embodiments, Figure 2A As shown, the script editing area 110A may also include a pause insertion control 204, which is used to insert a pause character in the script 202 so that the generated audio can include a pause of a preset length corresponding to the pause character. It can be understood that the setting position of the pause insertion control 204 can be arbitrary. In this embodiment, the pause insertion control 204 is set in the script editing area 110A so that the user 104A can easily add a pause character when editing the script, which is convenient for operation and provides a better experience. In some embodiments, as Figure 2BAs shown, when the mouse is hovered over the pause insertion control 204, the associated position of the pause insertion control 204 (for example, the upper right) can display prompt information 2022, and the prompt information 2022 is used to prompt the user of the role or function of the control 204 (for example, "add a pause"), so that when the user 104A hovers the mouse over the control 204, the prompt information 2022 can immediately understand the role or function of the control 204, thereby facilitating the user to use the control 204.

[0050] Furthermore, the user 104A can insert a pause character into the script 202 by triggering (e.g., clicking) the pause insertion control 204. Therefore, the terminal device 102A can insert a pause character into the script 202 in response to the trigger instruction for the pause insertion control 204, thereby achieving fast insertion of the pause character and easy operation.

[0051] In some embodiments, in response to a trigger instruction for the pause insertion control, inserting a pause character in the script may further include: in response to a trigger instruction for the pause insertion control 204, first determining a target insertion position in the script 202, and then inserting a pause character in the script based on the target insertion position, so that the pause position can be set by setting the target insertion position, and the operation is flexible. Wherein, the target insertion position can be the insertion position of the pause character in the script 202, and there can be multiple ways to determine the target insertion position, and there can also be multiple ways to set the target insertion position. For example, a certain pause can be set at the end of each sentence, and the pause insertion control 204 can be a key that inserts a pause symbol at the end of each sentence, so that each period in the script 202 can be followed by the target insertion position. For another example, the pause insertion control 204 can be a control that uses an artificial intelligence (AI) model to intelligently insert pause characters, so that the target insertion position can be position information automatically generated by the AI model based on the script 202.

[0052] Back to Figure 2A In some embodiments, the current position of the cursor 206 in the script 202 of the script editing area 110A can be determined as the target insertion position. In this way, the user 104A can place the cursor 206 at the position where the pause is desired, and then trigger the pause insertion control 204 to add a pause character at this position, thereby increasing the flexibility of the pause setting position and making the user operation simpler. In some embodiments, the pause character includes duration information of a preset duration corresponding to the pause. The preset duration can be a default duration (e.g., 3s), so that the corresponding position of the generated audio can pause according to the default duration.

[0053] In some embodiments, as Figure 2C As shown, in response to the insertion of the pause character in the script 202, a preset pause character 208 may be displayed at the target insertion position of the script 202 in the script editing area 110A. In this way, the user 104A can intuitively see where the pause character is inserted in the script 202, which facilitates the user 104A to further edit the script 202. Figure 2C As shown, the pause character 208 displayed in the script editing area 110A may also include information about the preset duration of the pause (e.g., 3 seconds), so that the user 104A can intuitively see the duration of the pause currently corresponding to the pause character and can adjust and continue editing accordingly. In some embodiments, the pause character may have a special format (e.g., / / xs / / ) that is different from conventional symbols such as spaces and punctuation marks. This allows the pause character to remain in the script 202 when the script 202 is saved and not automatically cleared. When the audio is generated, the pause character can be converted into a pause in the audio.

[0054] In some embodiments, the user 104A can also set the duration of the pause character to be inserted. Specifically, in response to the operation of the pause character, the pause duration can be determined first; then, based on the setting of the pause duration, the duration information of the pause duration can be added and displayed in the pause character. Figure 2C For example, the pause duration can be set by directly modifying the duration information in the pause character 208. For example, double-clicking the pause character 208 displays a cursor at the location of the duration information (e.g., 3s) of the pause character 208 or highlights the duration information. Then, by clicking the delete key, the duration information can be deleted and the desired duration information (e.g., 4s) can be entered, thereby completing the modification of the pause duration information. The duration information can then be added to the pause character, and the modified duration information can also be updated and displayed on the page 200. In this way, the pause duration can be modified by editing the text of the pause character 208, which is simple and convenient.

[0055] In some embodiments, determining the pause duration in response to an operation on the pause character may further include: displaying a duration setting control at an associated position of the pause character based on triggering the pause character; and determining the pause duration based on duration information set by the duration setting control.

[0056] Specifically, if Figure 2DAs shown, in response to the pause character 208 displayed in the script editing area 110A being triggered (for example, the user 104A hovers the mouse over the pause character 208), a duration setting control 210 can be displayed at the associated position of the pause character 208 (for example, the upper right), so that the user 104A knows that the pause duration can be adjusted through the duration setting control 210. Then, the user 104A can set the duration information through the duration setting control 210, and then the terminal device 102A can determine the pause duration based on the duration information set by the duration setting control 210. In this way, the user 104A can flexibly adjust the pause duration by setting the duration information, further improving the user experience.

[0057] In some embodiments, as Figure 2D As shown, the duration setting control 210 may display a default duration (e.g., 3s) in the initial state, so that the user can intuitively see the basis for duration adjustment. Optionally, the duration setting control 210 may include an increase button 2102 for increasing the duration and a decrease button 2104 for decreasing the duration, so that the user can adjust the duration by triggering the buttons. Figure 2D As shown, optionally, the increase button 2102 and the decrease button 2104 may be displayed in a first style (e.g., grayed out) in the initial state, indicating that the duration setting control 210 is not currently used to set the duration. In response to the duration setting control 210 being triggered (e.g., clicked), the increase button 2102 and the decrease button 2104 may be displayed in a second style (e.g., lit up), as shown in FIG. Figure 2E As shown, user 104A knows that the pause duration can be adjusted using the increase button 2102 and the decrease button 2104. In response to the increase button 2102 and / or the decrease button 2104 being triggered, the duration information can be determined based on the triggering instructions of the increase button 2102 and / or the decrease button 2104 in combination with the default duration.

[0058] For example, user 104A can Figure 2D On the basis of the time setting control 210, the increase button 2102 and the decrease button 2104 are displayed in a lighted state, such as Figure 2EAs shown. Then, user 104A can utilize described increase button 2102 and described decrease button 2104 to carry out duration adjustment, for example, by clicking described increase button 2102 once to increase unit duration (for example, 0.5s) for duration information. Like this, according to the number of times that user 104A clicks described increase button 2102 and / or described decrease button 2104, it is possible to determine the multiple relationship between the duration of adjustment and unit duration, and then the duration of adjustment is superimposed on the default duration (for example, 3s), and the duration information after adjustment is obtained. Assuming that the user has only clicked once increase button 2102, unit duration is 0.5s, and default duration is 3s, then the duration information after adjustment is 3.5s. Optionally, the pause duration can have an upper limit and a lower limit, thereby avoiding the user from performing unreasonable pause settings.

[0059] In some embodiments, the duration information (e.g., 3s, 3.5s) displayed in the duration setting control 210 can be directly modified. The user 104A can modify the duration information by clicking or double-clicking the duration information and then entering new duration information. Therefore, when determining the duration information set based on the duration setting control, the duration information corresponding to the pause duration can also be determined based on the modified information of the default duration (i.e., the duration information re-entered by the user in the duration setting control 210).

[0060] It is understood that user 104A can adjust the pause duration by combining direct modification with button control. For example, after the user adjusts the pause duration by inputting the duration information in duration setting control 210, the user further adjusts the pause duration by triggering the increase button 2102 and / or the decrease button 2104. Thus, the duration information can be finalized by combining the two adjustments.

[0061] It can be seen that the above embodiment provides multiple ways to adjust the pause duration, and the adjustment operation of user 104A is more flexible, further improving the user experience.

[0062] In some embodiments, after the pause character is displayed at the target insertion position of the script in the script editing area, in response to a deletion instruction for the pause character 208 in the script editing area 110A (e.g., selecting the pause character 208 and pressing the delete key), the pause character 208 may stop being displayed in the script editing area 110A and may also be deleted from the script 202. Subsequently, the pause character may no longer be used to generate audio. In this way, by adding the deletion function, the editing flexibility of the user 104A is further improved.

[0063] by Figure 2CFor example, assuming that the user 104A has finished editing the script 202 and wants to generate a target video, the user can click the export button 116 to trigger the process of generating the target video.

[0064] In some embodiments, generating a target video based on the script with the pause character may further include: generating the audio based on the script with the pause character; acquiring an image or video containing the target object; and generating the target video based on the audio and the image or video containing the target object.

[0065] In this embodiment, the script with the pause character can be used to generate the audio, and then the audio can be used to drive the image or video containing the target object to perform corresponding actions to generate the target video, thereby achieving synchronization of audio and video.

[0066] Specifically, the audio (or voice) corresponding to the target video can be generated based on the script 202 with the pause character 208, so that the audio can include a pause of a preset duration corresponding to the pause character. In this way, when the target video with the audio is played to the position corresponding to the pause character, the audio can have a pause of the preset duration, thereby forming a pause effect. Optionally, the pause can be achieved by a blank audio segment, that is, the audio of the preset duration corresponding to the pause does not contain any sound information, thereby achieving a pause effect.

[0067] It is understood that the pause character can be inserted in the middle of a sentence or at the end of a sentence. When generating audio, the pause character is handled differently depending on whether it is in the middle of a sentence or at the end of a sentence.

[0068] In some embodiments, when a pause character is located within a sentence, when generating audio, the script containing the pause character can first be segmented to obtain multiple sentences; wherein a target sentence among the multiple sentences includes the pause character. In this case, since the pause character is located within the target sentence, it can be naturally assigned to the target sentence during the segmentation process and become a component of the target sentence. Then, based on the multiple sentences, multiple audio segments can be generated; wherein a target audio segment among the multiple audio segments includes a pause of a preset duration corresponding to the pause character. Here, since the target sentence contains the pause character, the pause character can be converted into a pause of a preset duration when converting the target sentence into a target audio segment. Finally, the multiple audio segments can be spliced into the audio corresponding to the target video. In this way, based on the multiple audio clips, a continuous audio segment can be spliced together, and the target audio segment in the audio includes a pause of a preset length corresponding to the pause character, so that when the target video with the audio is played to the position corresponding to the pause character, the audio can have a pause of a preset length, thereby forming a pause effect.

[0069] In some embodiments, if a pause character is located at the end of a sentence, the script containing the pause character can still be first segmented to obtain multiple sentences; wherein the pause character is located between two target sentences in the multiple sentences (for example, at the end of the first target sentence and at the beginning of the second target sentence). In this case, since the pause character is located between two target sentences in the multiple sentences, it cannot be segmented into any of the sentences during segmentation. Therefore, the position of the pause character can be recorded (for example, between which two sentences it is located). Then, based on the multiple sentences, multiple audio segments corresponding to the multiple sentences are generated. Finally, based on the position of the pause character, the multiple audio segments are spliced into the audio corresponding to the target video. During the splicing process, a pause of a preset duration corresponding to the pause character can be added between the target audio segments corresponding to the two target sentences (i.e., at the position corresponding to the pause character), so that the audio contains a pause of the preset duration corresponding to the pause character and the pause is located between the two target sentences. In this way, based on the multiple audio clips, a continuous audio can be spliced together, and a pause of a preset length corresponding to the pause character is included between two target audio clips in the audio, so that when the target video with the audio is played to the position corresponding to the pause character, the audio can have a pause of a preset length, thereby forming a pause effect.

[0070] In some embodiments, the generated target video may include time marks of the multiple audio segments of the audio and marks corresponding to the pauses, so that user 104A can edit the pause position again when further editing the target video, for example, dragging the position of the pause in the audio to adjust the pause position.

[0071] After generating the audio, the target video can be further generated based on the audio so that the target object (e.g., target object 1102) in the target video pauses for a preset duration when the target video reaches the position corresponding to the pause character. It is understood that the pause of the target object can be a pause in the shape of the mouth or a pause in the movement, thereby making the digital human video more natural and realistic.

[0072] In some embodiments, the target video can be generated based on the audio and an image or video containing the target object (e.g., target object 1102), thereby obtaining a video containing the target object with a pause effect, which is more natural and realistic.

[0073] Optionally, generating the target video based on the audio and an image or video containing the target object may further include: using the audio as a driving signal to drive the target object (e.g., target object 1102) in the image or video to perform an action that matches the audio; wherein the action includes a pause of a preset duration corresponding to the pause character. In this way, by using the audio as a driving signal to drive the target object, the target object also pauses at the location where the audio pauses, thereby pausing the audio and video together, creating a more natural and realistic effect.

[0074] In some embodiments, the target object may include a virtual image, for example, a digital human image; the pause in the action includes: when the target video is played to the position corresponding to the pause character, the mouth of the virtual image remains closed for the preset duration, so that when the audio pauses, the mouth of the virtual image remains closed, achieving synchronized pauses of audio and video, and the effect is more natural and realistic.

[0075] In some embodiments, the method may further generate subtitles corresponding to the target video based on the script containing the pause character. The generated subtitles do not display the pause character and / or the preset duration. Thus, the pause character and / or the preset duration corresponding to the pause character are not presented as subtitle information, thereby improving the video quality.

[0076] It can be seen from the above embodiments that the video processing method provided by the embodiments of the present disclosure uses a pause insertion control to insert a pause character into the script, and then generates a target video based on the script with the pause character, so that the audio can include a pause of a preset length corresponding to the pause character and the target object in the target video pauses for the preset length when the target video is played to the position corresponding to the pause character, thereby achieving the effect of synchronized pause of audio and video and improving the video effect.

[0077] It should be noted that the method of the embodiments of the present disclosure can be performed by a single device, such as a computer or server. The method of the embodiments of the present disclosure can also be applied in a distributed scenario, where multiple devices cooperate to perform the method. In such a distributed scenario, one of the multiple devices may only perform one or more steps of the method of the embodiments of the present disclosure, and the multiple devices will interact with each other to complete the method.

[0078] It should be noted that the above description is limited to some embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in an order different from that described in the above embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order or sequential order shown to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0079] Figure 3 FIG2 shows a flow chart of an exemplary video processing method 300 provided by an embodiment of the present disclosure. The method 300 can be used to configure a template. Optionally, the method 300 can be used by Figure 1 The terminal device 102A can be implemented separately or by Figure 1 The various devices in the system 100 are interactively implemented.

[0080] like Figure 3 As shown, the method 300 may further include the following steps.

[0081] In step 302, a video processing page (eg, Figures 2A to 2E Page 200); wherein the video processing page includes a script editing area (for example, Figures 2A to 2E 110A), the script editing area includes a pause insertion control (e.g., Figures 2A to 2E Pause insertion control 204);

[0082] At step 304, in response to a trigger instruction for the pause insertion control, a pause character is inserted into the script;

[0083] At step 306, a target video is generated based on the script with the pause character, wherein the target video includes audio;

[0084] The audio includes a pause of a preset duration corresponding to the pause character, and the target object in the target video pauses for the preset duration when the target video is played to the position corresponding to the pause character.

[0085] The video processing method provided by the embodiment of the present disclosure utilizes a pause insertion control to insert a pause character into a script, and then generates a target video based on the script with the pause character, so that the audio can include a pause of a preset length corresponding to the pause character and the target object in the target video pauses for the preset length when the target video is played to the position corresponding to the pause character, thereby achieving an effect of synchronized pause of audio and video and improving the effect of the video.

[0086] In some embodiments, in response to a trigger instruction for the pause insertion control, inserting a pause character in the script includes: in response to the trigger instruction for the pause insertion control, determining a target insertion position in the script; wherein the target insertion position includes a cursor (e.g., Figure 2A The cursor 206 is positioned at the current position in the script in the script editing area; and a pause character is inserted into the script based on the target insertion position. In this way, the user can place the cursor at the position where the pause is desired and then trigger the pause insertion control to add the pause character at the position, thereby increasing the flexibility of the pause setting position and simplifying the user operation.

[0087] In some embodiments, inserting a pause character into the script based on the target insertion position includes: displaying a preset pause character (e.g., Figure 2C to Figure 2E The method further comprises the steps of: inserting a pause character 208 into the script, determining a pause duration in response to an operation on the pause character, and adding and displaying the duration information of the pause duration in the pause character based on the setting of the pause duration. In this way, the user can intuitively see the position of the script where the pause character is inserted and the duration information of the pause duration, and can edit the pause duration for the pause character to facilitate operation. In some embodiments, the pause character can have a special format (for example, / / xs / / ) that is different from conventional symbols such as spaces and punctuation marks, so that it can remain in the script when the script is saved and will not be automatically cleared, and can be converted into a pause in the audio when the audio is generated.

[0088] In some embodiments, the setting of the pause duration can be to directly modify the duration information in the pause character. For example, double-clicking the pause character displays a cursor at the position of the duration information of the pause character (e.g., 3s) or highlights the duration information. Then, by clicking the delete key, the duration information is deleted and the duration information you want to set (e.g., 4s) can be entered, thereby completing the modification of the duration information of the pause duration. Then, the duration information can be added to the pause character, and the modified duration information can also be updated and displayed in the video processing page. In this way, the pause duration is modified by the text editing operation of the pause character, which is easy to operate.

[0089] In some embodiments, determining the pause duration in response to the operation on the pause character includes: setting a control (e.g., Figure 2D and Figure 2E The duration setting control 210 is used to set the pause duration. The user can conveniently and flexibly adjust the pause duration by using the duration setting control to further enhance the user experience.

[0090] In some embodiments, the duration setting control includes an increase button (e.g., Figure 2D and Figure 2E 2102) and a decrease button (e.g., Figure 2D and Figure 2E The duration setting control displays a default duration in an initial state, and the increase button and the decrease button are displayed in a first style (for example, a grayed-out state) in the initial state; based on the duration information set by the duration setting control, the pause duration is determined, including: in response to the duration setting control being triggered, the increase button and the decrease button are displayed in a second style (for example, a lit state); in response to the increase button and / or the decrease button being triggered, the duration information is determined according to the triggering instruction of the increase button and / or the decrease button in combination with the default duration; and / or the duration information is determined according to the modification information of the default duration.

[0091] For example, the user can Figure 2D Click the duration setting control based on the time, so that the increase button and the decrease button are displayed in a lit state, such as Figure 2EAs shown. Then, the user can use the increase button and the decrease button to adjust the duration, for example, by clicking the increase button once to increase the unit duration (for example, 0.5s) for the duration information. In this way, according to the number of times the user clicks the increase button and / or the decrease button, the multiple relationship between the adjusted duration and the unit duration can be determined, and then the adjusted duration is superimposed on the default duration (for example, 3s) to obtain the adjusted duration information. Assuming that the user only clicks the increase button 2102 once, the unit duration is 0.5s, and the default duration is 3s, the adjusted duration information is 3.5s. Optionally, the pause duration can have an upper limit and a lower limit, so as to avoid the user from making unreasonable pause settings.

[0092] In some embodiments, the duration information displayed in the duration setting control (e.g., 3s, 3.5s) can be directly modified. The user can modify the duration information by clicking or double-clicking the duration information and then entering new duration information. Therefore, when determining the duration information set based on the duration setting control, the duration information corresponding to the pause duration can also be determined based on the modified information of the default duration (i.e., the duration information re-entered by the user in the duration setting control 210).

[0093] It is understood that the user can adjust the pause duration by combining direct modification with button control. For example, after the user adjusts the duration by entering the duration information in the duration setting control, the user further adjusts the duration by triggering the increase button and / or the decrease button. Thus, the duration information can be finalized by combining the two adjustments.

[0094] It can be seen that the above embodiments provide multiple ways to adjust the pause duration, which makes the user's adjustment operation more flexible and further improves the user experience.

[0095] In some embodiments, after the pause character is displayed at the target insertion position of the script in the script editing area, the method further includes: in response to a delete instruction for the pause character in the script editing area (e.g., selecting the pause character 208 and pressing a delete key), stopping displaying the pause character and deleting the pause character from the script. In this way, by adding the deletion function, the user's editing flexibility is further improved.

[0096] In some embodiments, the method further includes generating subtitles corresponding to the target video based on the script containing the pause character, wherein the subtitles do not display the pause character and / or the preset duration. Thus, the pause character and / or the preset duration corresponding to the pause character are not presented as subtitle information, thereby improving the video quality.

[0097] In some embodiments, generating a target video based on the script with the pause character includes:

[0098] generating the audio based on the script with the pause characters;

[0099] Acquire an image or video containing the target object;

[0100] The target video is generated based on the audio and the image or video containing the target object.

[0101] In this embodiment, the script with the pause character can be used to generate the audio, and then the audio can be used to drive the image or video containing the target object to perform corresponding actions to generate the target video, thereby achieving synchronization of audio and video.

[0102] In some embodiments, generating audio corresponding to the target video based on the script with the pause character includes:

[0103] Sentence processing is performed based on the script with the pause character to obtain a plurality of sentences; wherein a target sentence among the plurality of sentences includes the pause character; in this case, since the pause character is located in the target sentence, it can be naturally assigned to the target sentence during sentence segmentation and become a component of the target sentence;

[0104] Based on the multiple sentences, multiple audio segments are generated; wherein a target audio segment among the multiple audio segments includes a pause of a preset duration corresponding to the pause character; here, since the target sentence includes the pause character, the pause character can be converted into a pause of the preset duration when converting the target sentence into the target audio segment;

[0105] The multiple audio clips are spliced into audio corresponding to the target video.

[0106] In this way, based on the multiple audio clips, a continuous audio segment can be spliced together, and the target audio segment in the audio includes a pause of a preset length corresponding to the pause character, so that when the target video with the audio is played to the position corresponding to the pause character, the audio can have a pause of a preset length, thereby forming a pause effect.

[0107] In some embodiments, generating audio corresponding to the target video based on the script with the pause character includes:

[0108] Sentence processing is performed based on the script with the pause character to obtain a plurality of sentences; wherein the pause character is located between two target sentences in the plurality of sentences; in this case, since the pause character is located between the two target sentences in the plurality of sentences and cannot be divided into any of the sentences during sentence division, the position of the pause character can be recorded first;

[0109] generating a plurality of audio segments based on the plurality of sentences;

[0110] Based on the position of the pause character, the multiple audio segments are spliced into audio corresponding to the target video so that the audio includes a pause of a preset duration corresponding to the pause character and the pause is located between the two target sentences.

[0111] In this way, based on the multiple audio clips, a continuous audio can be spliced together, and a pause of a preset length corresponding to the pause character is included between two target audio clips in the audio, so that when the target video with the audio is played to the position corresponding to the pause character, the audio can have a pause of a preset length, thereby forming a pause effect.

[0112] In some embodiments, generating the target video based on the audio and an image or video containing the target object includes: using the audio as a driving signal to drive the target object in the image or video to perform an action that matches the audio; wherein the action includes a pause of a preset duration corresponding to the pause character. In this way, by using audio as a driving signal to drive the target object, the target object also pauses at the location where the audio pauses, thereby pausing the audio and video together, creating a more natural and realistic effect. The target object includes a virtual image; the pause in the action includes: when the target video plays to the location corresponding to the pause character, the virtual image's mouth remains closed for the preset duration, thereby achieving synchronized pauses of the audio and video, creating a more natural and realistic effect.

[0113] It should be noted that the method of the embodiments of the present disclosure can be performed by a single device, such as a computer or server. The method of the embodiments of the present disclosure can also be applied in a distributed scenario, where multiple devices cooperate to perform the method. In such a distributed scenario, one of the multiple devices may only perform one or more steps of the method of the embodiments of the present disclosure, and the multiple devices will interact with each other to complete the method.

[0114] It should be noted that the above description is limited to some embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in an order different from that described in the above embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order or sequential order shown to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0115] The embodiment of the present disclosure also provides a video processing device. Figure 4 FIG. 4 is a schematic diagram of an exemplary device 400 provided by an embodiment of the present disclosure. Figure 4 As shown, the apparatus 400 may be used to implement a video processing method, and may further include the following modules.

[0116] The display module 402 is configured to: display a video processing page; wherein the video processing page includes a script editing area, and the script editing area includes a pause insertion control;

[0117] The inserting module 404 is configured to: insert a pause character into the script in response to a trigger instruction for the pause insertion control;

[0118] The generating module 406 is configured to: generate a target video based on the script with the pause character, wherein the target video includes audio;

[0119] The audio includes a pause of a preset duration corresponding to the pause character, and the target object in the target video pauses for the preset duration when the target video is played to the position corresponding to the pause character.

[0120] In some embodiments, the insertion module 404 is configured to:

[0121] In response to a trigger instruction for the pause insertion control, determining a target insertion position in the script; wherein the target insertion position includes a current position of a cursor in the script in the script editing area;

[0122] A pause character is inserted into the script based on the target insertion position.

[0123] In some embodiments, the insertion module 404 is configured to:

[0124] Based on the target insertion position, displaying a preset pause character;

[0125] In response to an operation on the pause character, determining a pause duration;

[0126] Based on the setting of the pause duration, duration information of the pause duration is added and displayed in the pause character.

[0127] In some embodiments, the insertion module 404 is configured to:

[0128] Based on the triggering of the pause character, a duration setting control is displayed at a position associated with the pause character;

[0129] The pause duration is determined based on the duration information set by the duration setting control.

[0130] In some embodiments, the duration setting control includes an increase button and a decrease button, the duration setting control displays a default duration in an initial state, and the increase button and the decrease button are displayed in a first style in the initial state;

[0131] Insert module 404 is configured to:

[0132] In response to the duration setting control being triggered, displaying the increase button and the decrease button in a second style; in response to the increase button and / or the decrease button being triggered, determining the duration information according to the triggering instruction of the increase button and / or the decrease button in combination with the default duration; and / or

[0133] The duration information is determined according to the modification information of the default duration.

[0134] In some embodiments, the inserting module 404 is configured to: in response to a deletion instruction for the pause character in the script editing area, stop displaying the pause character and delete the pause character from the script.

[0135] In some embodiments, the generating module 406 is configured to: generate subtitles corresponding to the target video based on the script with the pause character; wherein the pause character and / or the preset duration are not displayed in the subtitles.

[0136] In some embodiments, the generating module 406 is configured to:

[0137] generating the audio based on the script with the pause characters;

[0138] Acquire an image or video containing the target object;

[0139] The target video is generated based on the audio and the image or video containing the target object.

[0140] In some embodiments, the generating module 406 is configured to:

[0141] Performing sentence processing based on the script with the pause character to obtain a plurality of sentences; wherein a target sentence among the plurality of sentences includes the pause character;

[0142] Based on the multiple sentences, a plurality of audio segments are generated; wherein a target audio segment among the multiple audio segments includes a pause of a preset duration corresponding to the pause character;

[0143] The multiple audio clips are spliced into audio corresponding to the target video.

[0144] In some embodiments, the generating module 406 is configured to:

[0145] Performing sentence processing based on the script with the pause character to obtain a plurality of sentences; wherein the pause character is located between two target sentences in the plurality of sentences;

[0146] generating a plurality of audio segments based on the plurality of sentences;

[0147] Based on the position of the pause character, the multiple audio segments are spliced into audio corresponding to the target video so that the audio includes a pause of a preset duration corresponding to the pause character and the pause is located between the two target sentences.

[0148] In some embodiments, the generation module 406 is configured to: use the audio as a driving signal to drive the target object in the image or the video to perform an action matching the audio; wherein the action includes a pause of a preset duration corresponding to the pause character; the target object includes a virtual image; the pause in the action includes: when the target video is played to the position corresponding to the pause character, the mouth of the virtual image remains closed for the preset duration.

[0149] For the convenience of description, the above devices are described as being functionally divided into various modules. Of course, when implementing the present disclosure, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0150] The apparatus of the above embodiment is used to implement the corresponding video processing method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.

[0151] The embodiment of the present disclosure also provides a computer device for implementing the above-mentioned video processing method. Figure 5 The hardware structure diagram of the exemplary computer device 500 provided in the embodiment of the present disclosure is shown in FIG. The computer device 500 can be used to implement Figure 1 The server 106 can also be used to implement Figure 1In some scenarios, the computer device 500 can also be used to implement Figure 1 The database server 108.

[0152] like Figure 5 As shown, computer device 500 may include: processor 502, memory 504, network interface 506, peripheral interface 508 and bus 510. Processor 502, memory 504, network interface 506 and peripheral interface 508 are communicatively connected to each other within computer device 500 via bus 510.

[0153] The processor 502 may be a central processing unit (CPU), an image processor, a neural network processor (NPU), a microcontroller (MCU), a programmable logic device, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or one or more integrated circuits. The processor 502 may be used to perform functions related to the technology described in this disclosure. In some embodiments, the processor 502 may also include multiple processors integrated into a single logical component. For example, Figure 5 As shown, processor 502 may include multiple processors 502a, 502b, and 502c.

[0154] The memory 504 may be configured to store data (eg, instructions, computer code, etc.). Figure 5 As shown, the data stored in the memory 504 may include program instructions (for example, one or more programs for implementing the video processing method of the embodiment of the present disclosure) and data to be processed (for example, the memory may store configuration files of other modules, etc.). The processor 502 may also access the program instructions and data stored in the memory 504 and execute the program instructions to operate on the data to be processed. The memory 504 may include a volatile storage device or a non-volatile storage device. In some embodiments, the memory 504 may include a random access memory (RAM), a read-only memory (ROM), an optical disk, a magnetic disk, a hard disk, a solid-state drive (SSD), a flash memory, a memory stick, etc.

[0155] The network interface 506 can be configured to provide the computer device 500 with communication with other external devices via a network. The network can be any wired or wireless network capable of transmitting and receiving data. For example, the network can be a wired network, a local wireless network (e.g., Bluetooth, WiFi, near field communication (NFC)), a cellular network, the Internet, or a combination thereof. It will be understood that the type of network is not limited to the specific examples above.

[0156] The peripheral interface 508 can be configured to connect the computer device 500 to one or more peripheral devices to enable information input and output. For example, the peripheral devices can include input devices such as a keyboard, a mouse, a touchpad, a touch screen, a microphone, and various sensors, as well as output devices such as a display, a speaker, a vibrator, and an indicator light.

[0157] The bus 510 may be configured to transmit information between various components of the computer device 500 (e.g., the processor 502, the memory 504, the network interface 506, and the peripheral interface 508), such as an internal bus (e.g., a processor-memory bus), an external bus (USB port, PCI-E bus), etc.

[0158] It should be noted that although the architecture of the computer device 500 shown above only shows the processor 502, memory 504, network interface 506, peripheral interface 508, and bus 510, in a specific implementation, the architecture of the computer device 500 may also include other components necessary for normal operation. In addition, those skilled in the art will understand that the architecture of the computer device 500 may also include only the components necessary to implement the embodiments of the present disclosure, and does not necessarily include all the components shown in the figure.

[0159] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present disclosure also provides a non-volatile computer-readable storage medium containing a computer program, which, when executed by one or more processors, enables the one or more processors to execute the video processing method.

[0160] The computer-readable media of this embodiment include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0161] The computer program stored in the storage medium of the above embodiment is used to enable the one or more processors to execute the video processing method described in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0162] Based on the same inventive concept, corresponding to any of the above-described video processing methods, the present disclosure further provides a computer program product comprising one or more computer programs. In some embodiments, the one or more computer programs are executable by one or more processors to cause the one or more processors to perform the video processing method. For the execution entities corresponding to the steps in each embodiment of the video processing method, the processors that execute the corresponding steps may belong to the corresponding execution entities.

[0163] The computer program product of the above embodiment is used to enable a processor to execute the video processing method described in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.

[0164] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. Within the scope of the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present disclosure as described above, which are not provided in detail for the sake of simplicity.

[0165] In addition, to simplify the description and discussion, and so as not to obscure the embodiments of the present disclosure, known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, devices may be shown in the form of block diagrams to avoid obscuring the embodiments of the present disclosure, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present disclosure are to be implemented (i.e., these details should be fully within the purview of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present disclosure, it will be apparent to those skilled in the art that the embodiments of the present disclosure may be implemented without these specific details or with variations in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0166] Although the present disclosure has been described in conjunction with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those skilled in the art based on the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0167] The embodiments of the present disclosure are intended to cover all such substitutions, modifications, and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A video processing method, comprising: Displaying a video processing page; wherein the video processing page includes a script editing area, and the script editing area includes a pause insertion control; In response to a trigger instruction for the pause insertion control, inserting a pause character into the script; generating a target video based on the script with the pause character, wherein the target video includes audio; The audio includes a pause of a preset duration corresponding to the pause character, and the target object in the target video pauses for the preset duration when the target video is played to the position corresponding to the pause character.

2. The method according to claim 1, wherein In response to a trigger instruction for the pause insertion control, inserting a pause character into the script comprises: In response to a trigger instruction for the pause insertion control, determining a target insertion position in the script; wherein the target insertion position includes a current position of a cursor in the script in the script editing area; A pause character is inserted into the script based on the target insertion position.

3. The method according to claim 2, wherein: Inserting a pause character into the script based on the target insertion position includes: Based on the target insertion position, displaying a preset pause character; In response to an operation on the pause character, determining a pause duration; Based on the setting of the pause duration, duration information of the pause duration is added and displayed in the pause character.

4. The method according to claim 3, wherein: The step of determining the pause duration in response to the operation on the pause character comprises: Based on the triggering of the pause character, a duration setting control is displayed at a position associated with the pause character; The pause duration is determined based on the duration information set by the duration setting control.

5. The method according to claim 4, wherein: The duration setting control includes an increase button and a decrease button, the duration setting control displays a default duration in an initial state, and the increase button and the decrease button are displayed in a first style in the initial state; Determining the pause duration based on the duration information set by the duration setting control includes: In response to the duration setting control being triggered, displaying the increase button and the decrease button in a second style; in response to the increase button and / or the decrease button being triggered, determining the duration information according to the triggering instruction of the increase button and / or the decrease button in combination with the default duration; and / or The duration information is determined according to the modification information of the default duration.

6. The method of claim 3, wherein: After displaying the pause character at the target insertion position of the script in the script editing area, the method further includes: In response to a deletion instruction for the pause character in the script editing area, the pause character is stopped from being displayed and is deleted from the script.

7. The method of claim 1 , further comprising: Generating subtitles corresponding to the target video based on the script with the pause characters; The pause character and / or the preset duration are not displayed in the subtitles.

8. The method of claim 1, wherein: Generating a target video based on the script with the pause character, comprising: generating the audio based on the script with the pause characters; Acquire an image or video containing the target object; The target video is generated based on the audio and the image or video containing the target object.

9. The method of claim 8, wherein: Generating the audio based on the script with the pause character comprises: Performing sentence processing based on the script with the pause character to obtain a plurality of sentences; wherein a target sentence among the plurality of sentences includes the pause character; Based on the multiple sentences, a plurality of audio segments are generated; wherein a target audio segment among the multiple audio segments includes a pause of a preset duration corresponding to the pause character; The multiple audio clips are spliced into audio corresponding to the target video.

10. The method of claim 8, wherein: Generating the audio based on the script with the pause character comprises: Performing sentence processing based on the script with the pause character to obtain a plurality of sentences; wherein the pause character is located between two target sentences in the plurality of sentences; generating a plurality of audio segments based on the plurality of sentences; Based on the position of the pause character, the multiple audio segments are spliced into audio corresponding to the target video so that the audio includes a pause of a preset duration corresponding to the pause character and the pause is located between the two target sentences.

11. The method of claim 8, wherein: Generating the target video based on the audio and the image or video containing the target object includes: The audio is used as a driving signal to drive the target object in the image or video to perform an action matching the audio; wherein the action includes a pause of a preset duration corresponding to the pause character; the target object includes a virtual image; the pause in the action includes: when the target video is played to the position corresponding to the pause character, the mouth of the virtual image remains closed for the preset duration.

12. A video processing device, comprising: A display module is configured to: display a video processing page; wherein the video processing page includes a script editing area, and the script editing area includes a pause insertion control; An inserting module is configured to: insert a pause character into the script in response to a trigger instruction for the pause insertion control; A generating module is configured to: generate a target video based on the script with the pause character, wherein the target video includes audio; The audio includes a pause of a preset duration corresponding to the pause character, and the target object in the target video pauses for the preset duration when the target video is played to the position corresponding to the pause character.

13. A computer device comprising one or more processors, a memory; and one or more programs, wherein the one or more programs are stored in the memory and executed by the one or more processors, and the one or more programs include instructions for executing the method according to any one of claims 1 to 11.

14. A non-transitory computer-readable storage medium containing a computer program, which, when executed by one or more processors, causes the one or more processors to perform the method according to any one of claims 1 to 11.

Images