Video processing method and device, equipment, storage medium and product

Abstract

The invention discloses a video processing method and device, equipment, a storage medium and a product, relates to the technical field of artificial intelligence, and discloses a method for acquiring a video generated by an intelligent agent, the video comprising a plurality of video clips; in response to an editing instruction for the video, displaying a video editing interface, the video editing interface comprising a plurality of video clips arranged according to a time sequence; and updating the target video clip based on the editing operation on the target video clip. According to the method, the video generated by the agent can better match user requirements, and the practicability of the video generated by the agent is effectively improved.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, and in particular to a video processing method, apparatus, device, storage medium and product. Background Technology

[0002] With the development of artificial intelligence technology, intelligent agents have become an important tool for video creation, widely used in short videos, advertising, education, and other scenarios. Relying on deep learning and massive amounts of data, they can quickly convert text and images into dynamic videos, significantly reducing the barrier to entry and time costs for video production.

[0003] However, due to the agent's lack of understanding of users' personalized needs and limited control over scene details and content logic, the generated videos often do not meet users' expectations, which seriously reduces the practicality of the generated videos and makes it difficult to meet high-quality and customized needs.

[0004] Therefore, how to improve the practicality of agent-generated videos and make them more in line with user needs has become an urgent technical problem to be solved.

[0005] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention

[0006] The main objective of this application is to provide a video processing method, apparatus, device, storage medium, and product that enables intelligent agents to generate videos that better match user needs and effectively improves the practicality of intelligent agent-generated videos.

[0007] To achieve the above objectives, this application proposes a video processing method, the method comprising: Acquire a video generated by the intelligent agent, the video containing multiple video segments; In response to an editing instruction on the video, a video editing interface is displayed, the video editing interface including the plurality of video clips arranged in chronological order; The target video segment is updated based on the editing operations performed on it.

[0008] Optionally, updating the target video segment based on editing operations on the target video segment includes: In response to a video regeneration instruction, the agent generates a new video segment and replaces the target video segment with the new video segment; or, In response to a video upload command, obtain the upload video and replace the target video segment with the upload video; or... In response to a video search command, a video is retrieved from the internet and the target video segment is replaced with the video retrieved from the internet.

[0009] Optionally, in response to the video regeneration instruction, the agent generates a new video segment, including at least one of the following: In response to the segment regeneration instruction, the intelligent agent re-converts the video based on the original reference image to obtain a new video segment, wherein the original reference image is the basis for generating the target video segment; In response to the lip-sync video generation command, the intelligent agent converts the lip movements of the characters in the target video clip from those adapted to the original dialogue to those adapted to the new dialogue, thereby obtaining a new video clip; In response to the sound effect generation command, the intelligent agent converts the original sound effect in the target video segment into a new sound effect to obtain a new video segment; In response to the multi-image video generation command, the intelligent agent performs video conversion based on the original reference image and the new image to obtain a new video clip; In response to a video frame to video instruction, the intelligent agent performs video conversion based on at least one frame of the target video segment to obtain a new video segment. In response to a screen element update command, the intelligent agent adjusts the target screen elements in the target video segment to obtain a new video segment. The adjustment of the target screen elements includes: adjusting at least one of the number, layout and dynamic effects of the target screen elements, or replacing the target screen elements with new screen elements. In response to a video style conversion command, the intelligent agent adjusts the visual style of the target video segment to obtain a new video segment.

[0010] Optionally, the step of generating a new video segment through the intelligent agent in response to a video regeneration instruction includes: In response to a video regeneration command, the agent generates a new reference image different from the original reference image, and generates a new video clip based on the new reference image; wherein the original reference image is the basis for generating the target video clip, and the method for generating the new reference image includes at least one of the following: In response to the image regeneration instruction, the agent generates a new reference image based on the original reference text, wherein the original reference text is the basis for generating the original reference image. In response to the text-to-image command, the intelligent agent generates a new reference image based on the new reference text. In response to the image-generating command, the intelligent agent generates a new reference image based on the uploaded image; In response to the image modification command, the intelligent agent modifies the original reference image based on the input image modification prompt to obtain a new reference image; In response to the region redrawing command, the intelligent agent redraws the target region of the original reference image to obtain a new reference image; In response to an image element update instruction, the agent adjusts the target image elements in the original reference image to obtain a new reference image. The adjustment of the target image elements includes: adjusting at least one of the quantity and layout of the target image elements, or replacing the target image elements with new image elements.

[0011] Optionally, the step of generating a new video segment through the intelligent agent in response to a video regeneration instruction includes: In response to a video regeneration command, modification instruction information is obtained for the target video segment, the modification instruction information indicating the content to be modified; The intelligent agent adjusts the content to be modified in the target video segment based on the modification instruction information to obtain the new video segment.

[0012] Optionally, the modification instruction information further includes the modification target of the content to be modified, and the step of adjusting the content to be modified in the target video segment based on the modification instruction information by the intelligent agent to obtain the new video segment includes: The intelligent agent adjusts the content to be modified in the target video segment to conform to the modification target based on the modification instruction information, thereby obtaining the new video segment.

[0013] Optionally, the video editing interface includes multimedia elements of the plurality of video clips arranged in chronological order; The step of updating the target video segment based on editing operations on the target video segment includes: Based on the editing operations on the target multimedia constituent elements of the target video segment, the target multimedia constituent elements of the target video segment are updated.

[0014] Optionally, the multimedia constituent elements include at least one of the following: Video footage, special effects, subtitles, sound effects, background music, and voice-over.

[0015] Optionally, updating the target multimedia constituent elements of the target video segment based on editing operations on the target multimedia constituent elements of the target video segment includes: In response to a multimedia element generation instruction, the intelligent agent regenerates the target multimedia elements of the target video segment and replaces the original target multimedia elements of the target video segment with the new target multimedia elements; or... In response to a multimedia element upload command, the target multimedia element uploaded locally is obtained, and the original target multimedia element of the target video segment is replaced with the locally uploaded target multimedia element; or... In response to a multimedia element search command, the target multimedia constituent element is searched for on the network, and the original target multimedia constituent element of the target video segment is replaced with the searched target multimedia constituent element.

[0016] Optionally, updating the target video segment based on editing operations on the target video segment includes: In response to global application commands, the multiple video segments are updated based on the editing operation on the target video segment.

[0017] Optionally, the video clip is a storyboard video clip or a music-synced video clip.

[0018] Optionally, the method further includes: In response to the video editing and optimization command, an editing and optimization interface is displayed. The editing and optimization interface is used to perform editing and optimization operations on the video. The editing and optimization operations include at least one of the following: Add video clips, video transitions, stickers, watermarks, QR codes, and filters; Delete video clips, video transitions, stickers, watermarks, QR codes, and filters; Adjust the playback speed of video clips, the color tone of the video, the aspect ratio, subtitles, and the matching degree between video visuals and sound effects.

[0019] Optionally, the video editing interface includes a video playback area and a video editing area; The video editing area includes the plurality of video clips arranged in chronological order; The video playback area is used to play the video segment that is currently being edited in the video editing area.

[0020] Optionally, the video editing interface may also include a material display area; The material display area includes materials associated with the video, and the materials include at least one of video materials, image materials, and audio materials.

[0021] Optionally, acquiring the video generated by the intelligent agent includes: Display a video generation interface, which includes a text input control; The intelligent agent generates the video based on the text information entered in the text input control.

[0022] Optionally, the video generation interface may further include at least one of the following types of controls: A aspect ratio indicator control is used to indicate the aspect ratio of the video generated by the intelligent agent; A visual style indicator control is used to indicate the visual style of the video generated by the intelligent agent; A subtitle style indicator control is used to indicate the subtitle style of the video generated by the intelligent agent; A reference image selection control is used to indicate the reference image on which the intelligent agent generates the video; An agent selection control is used to instruct the agent used to generate the video.

[0023] Furthermore, to achieve the above objectives, this application also proposes a video processing apparatus, the apparatus comprising: The video acquisition module is used to acquire videos generated by the intelligent agent, wherein the videos contain multiple video segments; A video display module is used to display a video editing interface in response to an editing command for the video, the video editing interface including the plurality of video segments arranged in chronological order; The video update module is used to update the target video segment based on the editing operation performed on the target video segment.

[0024] Optionally, the video update module includes: A video generation unit, configured to, in response to a video regeneration instruction, generate a new video segment through the intelligent agent, and replace the target video segment with the new video segment; or, The video upload unit is configured to, in response to a video upload command, acquire an upload video and replace the target video segment with the upload video; or, A video search unit is used to respond to a video search command, obtain a video searched online, and replace the target video segment with the video searched online.

[0025] Optionally, the video generation unit is configured to perform at least one of the following: In response to the segment regeneration instruction, the intelligent agent re-converts the video based on the original reference image to obtain a new video segment, wherein the original reference image is the basis for generating the target video segment; In response to the lip-sync video generation command, the intelligent agent converts the lip movements of the characters in the target video clip from those adapted to the original dialogue to those adapted to the new dialogue, thereby obtaining a new video clip; In response to the sound effect generation command, the intelligent agent converts the original sound effect in the target video segment into a new sound effect to obtain a new video segment; In response to the multi-image video generation command, the intelligent agent performs video conversion based on the original reference image and the new image to obtain a new video clip; In response to a video frame to video instruction, the intelligent agent performs video conversion based on at least one frame of the target video segment to obtain a new video segment. In response to a screen element update command, the intelligent agent adjusts the target screen elements in the target video segment to obtain a new video segment. The adjustment of the target screen elements includes: adjusting at least one of the number, layout and dynamic effects of the target screen elements, or replacing the target screen elements with new screen elements. In response to a video style conversion command, the intelligent agent adjusts the visual style of the target video segment to obtain a new video segment.

[0026] Optionally, the video generation unit is configured to, in response to a video regeneration instruction, generate a new reference image different from the original reference image through the intelligent agent, and generate a new video segment based on the new reference image; wherein, the original reference image is the basis for generating the target video segment, and the video generation unit is configured to perform at least one of the following to generate the new reference image: In response to the image regeneration instruction, the agent generates a new reference image based on the original reference text, wherein the original reference text is the basis for generating the original reference image. In response to the text-to-image command, the intelligent agent generates a new reference image based on the new reference text. In response to the image-generating command, the intelligent agent generates a new reference image based on the uploaded image; In response to the image modification command, the intelligent agent modifies the original reference image based on the input image modification prompt to obtain a new reference image; In response to the region redrawing command, the intelligent agent redraws the target region of the original reference image to obtain a new reference image; In response to an image element update instruction, the agent adjusts the target image elements in the original reference image to obtain a new reference image. The adjustment of the target image elements includes: adjusting at least one of the quantity and layout of the target image elements, or replacing the target image elements with new image elements.

[0027] Optionally, the video generation unit includes: The instruction acquisition subunit is used to acquire modification instruction information input for the target video segment in response to a video regeneration instruction, wherein the modification instruction information indicates the content to be modified; The video adjustment subunit is used by the intelligent agent to adjust the content to be modified in the target video segment based on the modification instruction information, so as to obtain the new video segment.

[0028] Optionally, the modification instruction information may also include the modification target of the content to be modified. The video adjustment subunit is used by the intelligent agent to adjust the content to be modified in the target video segment to conform to the modification target based on the modification instruction information, so as to obtain the new video segment.

[0029] Optionally, the video editing interface includes multimedia elements of the plurality of video clips arranged in chronological order; The video update module is used to update the target multimedia constituent elements of the target video segment based on the editing operation of the target multimedia constituent elements of the target video segment.

[0030] Optionally, the multimedia constituent elements include at least one of the following: Video footage, special effects, subtitles, sound effects, background music, and voice-over.

[0031] Optionally, the video update module is configured to, in response to a multimedia element generation instruction, regenerate the target multimedia elements of the target video segment through the intelligent agent, and replace the original target multimedia elements of the target video segment with the new target multimedia elements; or, in response to a multimedia element upload instruction, obtain the locally uploaded target multimedia elements and replace the original target multimedia elements of the target video segment with the locally uploaded target multimedia elements; or, in response to a multimedia element search instruction, search for the target multimedia elements from the network and replace the original target multimedia elements of the target video segment with the searched target multimedia elements.

[0032] Optionally, the video update module is configured to update the plurality of video segments in response to a global application instruction, based on the editing operation on the target video segment.

[0033] Optionally, the video clip is a storyboard video clip or a music-synced video clip.

[0034] Optionally, the device further includes: An optimization editing module is used to display an editing optimization interface in response to an editing optimization command for the video. The editing optimization interface is used to perform editing optimization operations on the video, and the editing optimization operations include at least one of the following: Add video clips, video transitions, stickers, watermarks, QR codes, and filters; Delete video clips, video transitions, stickers, watermarks, QR codes, and filters; Adjust the playback speed of video clips, the color tone of the video, the aspect ratio, subtitles, and the matching degree between video visuals and sound effects.

[0035] Optionally, the video editing interface includes a video playback area and a video editing area; The video editing area includes the plurality of video clips arranged in chronological order; The video playback area is used to play the video segment that is currently being edited in the video editing area.

[0036] Optionally, the video editing interface may also include a material display area; The material display area includes materials associated with the video, and the materials include at least one of video materials, image materials, and audio materials.

[0037] Optionally, the video acquisition module is used to display a video generation interface, which includes a text input control; and the video is generated by the intelligent agent based on the text information entered in the text input control.

[0038] Optionally, the video generation interface may further include at least one of the following types of controls: A aspect ratio indicator control is used to indicate the aspect ratio of the video generated by the intelligent agent; A visual style indicator control is used to indicate the visual style of the video generated by the intelligent agent; A subtitle style indicator control is used to indicate the subtitle style of the video generated by the intelligent agent; A reference image selection control is used to indicate the reference image on which the intelligent agent generates the video; An agent selection control is used to instruct the agent used to generate the video.

[0039] In addition, to achieve the above objectives, this application also proposes a video processing apparatus, the apparatus comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the video processing method described above.

[0040] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and which, when executed by a processor, implements the steps of the video processing method described above.

[0041] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the video processing method described above.

[0042] One or more technical solutions proposed in this application have at least the following technical effects: The video processing solution provided in this application effectively addresses the problems of current agent-generated videos failing to meet user expectations and lacking practicality. First, by acquiring a video containing multiple video clips generated by the agent, and responding to editing commands, the solution displays these clips chronologically in the video editing interface. This allows users to intuitively and clearly grasp the overall structure of the video and the details of each clip, breaking down the barrier of users' difficulty in accurately locating the parts that need adjustment after the agent-generated video. Second, it supports updating target video clips based on editing operations, granting users precise modification permissions for unsatisfactory segments, rather than regenerating the entire video. This significantly reduces the time and effort required for video modification and allows users to adjust the video according to their personalized needs, scene details, and content logic, making the final video more tailored to user customization and high-quality requirements, significantly improving the practicality and user satisfaction of agent-generated videos. Attached Figure Description

[0043] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0044] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0045] Figure 1 A schematic diagram of an implementation environment for a video processing method; Figure 2 A flowchart illustrating the first embodiment of the video processing method; Figure 3 This is a schematic diagram of a video generation interface; Figure 4 This is a schematic diagram of a video display interface; Figure 5 This is a schematic diagram of a video editing interface; Figure 6 This is a schematic diagram of an optimized editing interface; Figure 7 This is a detailed step diagram of step S3 in the second embodiment of the video processing method; Figure 8 This is a detailed step diagram of step S31 in the third embodiment of the video processing method; Figure 9 This is a schematic diagram of a video editing interface; Figure 10 This is a schematic diagram of a canvas interface; Figure 11 This is a schematic diagram illustrating the display effect of a video clip in a canvas interface. Figure 12 This is a schematic diagram illustrating the display effect of a video clip in a canvas interface. Figure 13 This is a schematic diagram illustrating the display effect of a video clip in a canvas interface. Figure 14 This is a schematic diagram illustrating the display effect of a video clip in a canvas interface. Figure 15 This is a schematic diagram of an image upload area in a canvas interface. Figure 16 This is a schematic diagram illustrating the display effect of a video frame selection area in a canvas interface. Figure 17 This is a detailed step diagram of step S31 in the fourth embodiment of the video processing method; Figure 18 This is a schematic diagram of a canvas interface; Figure 19 This is a schematic diagram of a text input area in a canvas interface. Figure 20 This is a schematic diagram illustrating the display effect of a video clip in a canvas interface. Figure 21 This is a schematic diagram illustrating the display effect of an image upload area in a canvas interface. Figure 22 This is a schematic diagram illustrating the display effect of an image upload area in a canvas interface. Figure 23 This is a schematic diagram illustrating the display effect of an image upload area in a canvas interface. Figure 24 This is a schematic diagram illustrating the display effect of an image editing area in a canvas interface. Figure 25 This is a schematic diagram illustrating the display effect of a reference image in the canvas interface; Figure 26 This is a schematic diagram illustrating the display effect of an image editing area in a canvas interface. Figure 27 This is a schematic diagram illustrating the display effect of a reference image in the canvas interface; Figure 28 This is a schematic diagram illustrating the display effect of an image editing area in a canvas interface. Figure 29 This is a detailed step diagram of step S31 in the fifth embodiment of the video processing method; Figure 30 A flowchart illustrating the sixth embodiment of the video processing method; Figure 31 This is a schematic diagram of a video editing interface; Figure 32 This is a schematic diagram of a video editing interface; Figure 33 This is a schematic diagram of the module structure of the video processing device according to an embodiment of this application; Figure 34 This is a schematic diagram of the device structure of the hardware operating environment involved in the video processing method in the embodiments of this application.

[0046] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0047] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0048] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0049] Figure 1 This is a schematic diagram illustrating an implementation environment provided by an embodiment of this disclosure. See also... Figure 1 The implementation environment includes a terminal 101 and a server 102. The terminal 101 and the server 102 are connected via a wireless or wired network. For example, the terminal 101 is installed with a target application provided by the server 102, and the terminal 101 can perform functions such as data transmission and message interaction through the target application.

[0050] For example, terminal 101 is a computer, mobile phone, tablet computer, or other terminal. For example, the target application is a target application in the operating system of terminal 101, or a target application provided by a third party. For example, the target application is a search application, a short video application, a camera application, etc. For example, server 102 is the backend server corresponding to the target application. Accordingly, server 102 is a search application server, a short video application server, a camera application server, etc.

[0051] In this application, terminal 101 is used to acquire a video generated by an intelligent agent, the video containing multiple video segments; in response to an editing instruction on the video, it displays a video editing interface, the video editing interface including multiple video segments arranged in chronological order; based on the editing operation on the target video segment, it sends an update request for the target video segment to server 102. Server 102 is used to receive the update request, acquire a new video segment, and return the new video segment to terminal 101. Terminal 101 is used to replace the target video segment in the video with the new video segment to update the target video segment. Alternatively, the above video processing process can also be completed by terminal 101 alone. For example, based on the editing operation on the target video segment, the terminal generates a new video segment locally and replaces the target video segment in the video with the new video segment to update the target video segment.

[0052] Figure 2 This is a schematic flowchart of the first embodiment of the video processing method of this application. (Refer to...) Figure 2 Taking the terminal as the executing entity as an example, this video processing method includes the following steps S1~S3: Step S1: Obtain the video generated by the agent. The video contains multiple video clips.

[0053] An intelligent agent is a model capable of video generation. Examples include Runway Machine Learning's first or second generation models, Pika Labs' Pika 1.0, and Sora.

[0054] Optionally, acquiring the video generated by the intelligent agent includes: displaying a video generation interface, which includes a text input control; and generating a video containing multiple video clips based on the text information entered in the text input control using the intelligent agent. The text information may include scene, character, and plot information.

[0055] For example, a video clip can be a storyboard video clip or a music-synced video clip. A storyboard video clip is a video clip corresponding to a single scene, referring to an independent video unit that presents single content from a specific angle and shot. A music-synced video clip is a video clip corresponding to a single musical beat, referring to an independent video unit where the visual content, such as actions, transitions, and special effects, is precisely synchronized with a specific beat, drumbeat, or accent in the music.

[0056] Optionally, the video generation interface may also include at least one of the following types of controls: aspect ratio indicator control, used to indicate the aspect ratio of the video generated by the agent; image style indicator control, used to indicate the image style of the video generated by the agent; subtitle style indicator control, used to indicate the subtitle style of the video generated by the agent; reference image selection control, used to indicate the reference image used by the agent to generate the video; and agent selection control, used to indicate the agent used to generate the video.

[0057] refer to Figure 3 On the left side of the video generation interface, from top to bottom, are controls for aspect ratio and style, subtitle style, and reference image selection. Clicking the reference image selection control will display multiple candidate images on the right side of the video generation interface, from which the user can select a reference image as the basis for the intelligent agent to generate the video.

[0058] This application embodiment further reduces the user's operational threshold and enhances the accuracy of video customization by setting multiple types of functional controls on the video generation interface, making the process of intelligent agent video generation more controllable and the results more in line with user expectations. Specifically, the aspect ratio, image style, and subtitle style indicator controls allow users to intuitively understand the core presentation effect during the video generation stage, avoiding repeated modifications due to the basic style not meeting expectations after generation; the reference image selection control and the intelligent agent selection control respectively give users the right to choose from two key dimensions: content basis and generation subject. The former ensures that the video image is consistent with the user's expected reference style and elements, while the latter allows users to select tools that are more suitable for their needs based on the generation characteristics of different intelligent agents. Ultimately, while improving operational convenience, it reduces the deviation between the video and user needs from the source, further improving the practicality and user satisfaction of intelligent agent-generated videos.

[0059] Step S2: In response to the video editing command, a video editing interface is displayed, which includes multiple video clips arranged in chronological order.

[0060] For example, in Figure 3 After completing the settings and successfully generating the video on the video generation interface shown, Figure 3The video generation interface shown will redirect to the video display interface as shown in Figure 4. The video playback area on the right side of the video display interface will show the complete video generated by the agent. Clicking the "Go to Edit" button in the upper right corner of the video will redirect the terminal to the video editing interface.

[0061] For example, the video editing interface includes a timeline, on which multiple video clips are arranged in a visual manner. Each video clip corresponds to an independent time block on the timeline. Users can intuitively view the time order and duration of each video clip, and can directly select, drag and drop video clips to adjust their order on the timeline.

[0062] Step S3: Update the target video segment based on the editing operations performed on the target video segment.

[0063] The target video segment is a specific video segment selected from the target video that the user wishes to edit. Optionally, the target video segment is updated based on the editing operations performed on it, including updating multiple video segments in response to a global application command. The core of this solution is to support one-time editing and global application. When the user completes editing operations on the target video segment, such as adjusting the picture style, unifying the subtitle style, or modifying the picture ratio, if a global application command is triggered, the terminal will automatically apply this editing operation synchronously to all other video segments in the video, without requiring the user to repeat the operation on each segment.

[0064] For example, when a user changes the visual style of a target video clip from "fresh" to "retro" during video editing, and then clicks the "Apply Style Globally" button after completing the editing, the terminal will automatically update the visual style of all other video clips in the video to "retro" in sync, without requiring the user to open each clip individually and repeat the settings.

[0065] This solution significantly improves video editing efficiency while ensuring consistency in video style. On one hand, it avoids the tedious process of users repeatedly performing the same editing operations on multiple segments, saving time and operational costs. On the other hand, through global synchronization, it effectively avoids style inconsistencies that may result from manual, piecemeal modifications, making the final video presentation more coherent and organized, further meeting users' needs for video quality and editing convenience.

[0066] Optionally, refer to Figure 5The video editing interface includes a video playback area and a video editing area. The video playback area is located in the upper right corner of the video editing interface, while the video editing area is located in the lower right corner. The video editing area contains multiple video clips arranged in chronological order; the video playback area is used to play the video clip currently being edited in the video editing area. This partitioned design ensures that editing operations and preview effects do not interfere with each other, resulting in a clearer interface logic. Moreover, playing only the clip currently being edited allows users to quickly focus on the details of a single clip without repeatedly dragging the entire video progress bar to find it, significantly reducing preview costs and improving overall editing efficiency.

[0067] Optionally, continue to refer to Figure 5 The video editing interface also includes a material display area, located on the left side of the interface. This area displays materials associated with the video, including at least one of video, image, and audio materials. This solution provides an additional material display area within the video editing interface, specifically showcasing various materials related to the currently edited video. These materials cover at least one of video, image, and audio formats. Users can directly select materials from this area to replace, supplement, or modify the currently edited video clip, such as replacing a scene in a video clip with a new image or replacing the background music with a new audio.

[0068] This solution makes video editing more flexible and efficient. On the one hand, users can access related materials directly within the editing interface without having to navigate to a different screen, reducing the operational steps and simplifying material retrieval. On the other hand, the rich variety of materials provides users with more editing options, allowing them to quickly replace unsatisfactory segments or flexibly add new elements, such as adding suitable background music or inserting relevant images, making the final video more tailored to the user's personalized creative needs and further enhancing the editing experience and video quality.

[0069] Optionally, in response to video editing and optimization instructions, an editing and optimization interface is displayed. For example, clicking... Figure 4 The "De-fine Editing" control in the upper right corner of the video editing interface will redirect the terminal to a different screen. Figure 6 The editing optimization interface shown is used to perform editing and optimization operations on videos. These operations include at least one of the following: adding video clips, video transitions, stickers, watermarks, QR codes, and filters; deleting video clips, video transitions, stickers, watermarks, QR codes, and filters; and adjusting the playback speed of video clips, the color tone of the video, the aspect ratio, subtitles, and the matching degree between video visuals and sound effects. This solution supports displaying a dedicated editing optimization interface after the user triggers an editing optimization command, allowing the user to perform diverse editing optimization operations and achieve comprehensive video optimization. This effectively improves the convenience of video editing and the professionalism of the final video.

[0070] The video processing solution provided in this application effectively addresses the problems of current agent-generated videos failing to meet user expectations and lacking practicality. First, by acquiring a video containing multiple video clips generated by the agent, and responding to editing commands, the solution displays these clips chronologically in the video editing interface. This allows users to intuitively and clearly grasp the overall structure of the video and the details of each clip, breaking down the barrier of users' difficulty in accurately locating the parts that need adjustment after the agent-generated video. Second, it supports updating target video clips based on editing operations, granting users precise modification permissions for unsatisfactory segments, rather than regenerating the entire video. This significantly reduces the time and effort required for video modification and allows users to adjust the video according to their personalized needs, scene details, and content logic, making the final video more tailored to user customization and high-quality requirements, significantly improving the practicality and user satisfaction of agent-generated videos.

[0071] Based on the first embodiment of this application described above, a second embodiment of this application is proposed. Contents that are the same as or similar to the first embodiment can be referred to the above description, and will not be repeated hereafter. (Refer to...) Figure 7 In the second embodiment, step S3 includes at least one of steps S31 to S33.

[0072] Step S31: In response to the video regeneration instruction, a new video segment is generated by the agent, and the target video segment is replaced with the new video segment.

[0073] For example, the video editing interface includes a video regeneration control. The terminal generates a video regeneration instruction based on the triggering operation of this control. For example, selecting a video clip in the video editing interface will cause the corresponding video regeneration control to pop up. (See reference) Figure 5 When any video clip is selected in the video editing area of ​​the video editing interface, a corresponding toolbar will pop up near the video clip, which displays the video regeneration control.

[0074] Step S32: In response to the video upload command, obtain the upload video and replace the target video segment with the upload video.

[0075] For example, the video editing interface includes a video upload control. The terminal generates a video upload command based on the trigger operation of this control. For example, selecting a video clip in the video editing interface will cause the corresponding video upload control to pop up. (Continue to refer to...) Figure 5When any video clip is selected in the video editing area of ​​the video editing interface, a corresponding toolbar will pop up near the video clip, which can display the video upload control.

[0076] Step S33: In response to the video search command, obtain the network search video and replace the target video segment with the network search video.

[0077] For example, the video editing interface includes a video search control. The terminal generates a video search command based on the trigger operation of this video search control. For example, when a video clip is selected in the video editing interface, the corresponding video search control will pop up. (Continue to refer to...) Figure 5 When any video clip is selected in the video editing area of ​​the video editing interface, a corresponding toolbar will pop up near the video clip, which can display video search controls.

[0078] This application provides users with diversified and flexible paths for replacing target video segments, completely breaking the limitations of a single modification method and making video adjustments more tailored to user needs, more efficient and convenient. From the perspective of replacement sources, the intelligent agent regenerating video segments can meet users' precise iteration needs for segment content logic and style; uploading local video segments adapts to reuse scenarios where users already have high-quality materials; and searching for video segments online solves the user's need for supplementary materials when no readily available materials are available. Support for multiple paths avoids users repeatedly operating due to limitations of a single replacement method, significantly improving editing efficiency and the adaptability of the final video, further enhancing the practicality of intelligent agent-generated videos and user autonomy.

[0079] Based on the second embodiment of this application described above, a third embodiment of this application is proposed. Contents that are the same as or similar to the second embodiment can be referred to the above description and will not be repeated hereafter. (Refer to...) Figure 8 In the third embodiment, step S31 includes at least one of steps S3101 to S3107.

[0080] In step S3101, in response to the segment regeneration instruction, the intelligent agent re-converts the video based on the original reference image to obtain a new video segment. The original reference image is the basis for generating the target video segment.

[0081] For example, the video editing interface displays a clip regeneration control. Based on the triggering operation of this control, the terminal generates a clip regeneration instruction. (See reference) Figure 9 In the video editing area, the control with the word "Regenerate" displayed in the toolbar corresponding to the third currently selected video clip indicates that the clip can be regenerated.

[0082] For example, the terminal, through an intelligent agent, re-converts the video based on the original reference image to obtain a new video clip. Then, it navigates to the canvas interface and displays the new video clip. In response to an application command for the new video clip, the target video clip in the agent-generated video is replaced with this new video clip. The canvas interface is an interactive interface used to display and process relevant materials during video editing. The displayed materials can be called process materials, that is, various materials generated during video generation or editing, including video clips, images, etc., used to assist in completing the editing work. (Reference) Figure 10 The canvas interface contains the target video clip and the original reference image. After a new video clip is generated, the new video clip will be displayed as follows: Figure 11 The effect shown is now displayed on the canvas interface.

[0083] In step S3102, in response to the lip-sync video generation instruction, the agent converts the lip movements of the characters in the target video clip from those adapted to the original dialogue to those adapted to the new dialogue, thereby obtaining a new video clip.

[0084] For example, the terminal obtains new dialogue based on the trigger operation of the lip-sync video generation control, and generates a lip-sync video generation instruction based on the new dialogue. (See reference) Figure 9 The control labeled "Lip Sync" in the toolbar corresponding to the third video clip represents the lip-sync video generation control. Triggering this control redirects the terminal to a canvas interface, displaying the original lip-sync result of the target video clip, such as... Figure 12 As shown. The user clicks the lip-sync control in the lower right corner, enters new lines in the dialogue input box displayed on the canvas interface, and the terminal generates a lip-sync video generation instruction based on the new lines. The generated new video clip is then displayed... Figure 13 The effect shown is then displayed on the canvas interface. If the user clicks the "Apply Video" control, the terminal will replace the target video segment in the video generated by the agent with this new video segment.

[0085] It should be noted that, in addition to the video editing interface, the lip-sync video generation control can also be displayed in the canvas interface. For example... Figure 10 As shown, the "Lip-Sync" control in the toolbar to the right of the target video clip represents a lip-sync video generation control. This allows users to issue lip-sync video generation commands not only in the video editing interface but also in the canvas interface, thus increasing the flexibility and convenience of editing operations.

[0086] In step S3103, in response to the sound effect generation instruction, the original sound effect in the target video segment is converted into a new sound effect through the intelligent agent to obtain a new video segment.

[0087] For example, the video editing interface displays a sound effect generation control. The terminal generates sound effect generation instructions based on the trigger operation of the sound effect generation control. (See reference) Figure 9 The control labeled "Generate Sound Effects" in the toolbar corresponding to the third video clip represents a sound effect generation control. When this control is triggered, the terminal generates a sound effect generation command, converting the original sound effect in the target video clip into a new sound effect. After obtaining the new video clip, it redirects to the canvas interface, where the generated new video clip is displayed... Figure 14 The effect shown is now displayed on the canvas interface. This new video clip includes four different sound effects; clicking on the different sound effect icons allows you to learn about the different sound effects. If the user clicks the "Apply Video" control, the target video clip generated by the agent will be replaced with this new video clip.

[0088] It should be noted that, in addition to the video editing interface, the sound effect generation control can also be displayed in the canvas interface. For example... Figure 10 As shown, the "Generate Sound Effects" control in the toolbar to the right of the target video clip represents the sound effect generation control. This allows users to issue sound effect generation commands not only in the video editing interface but also in the canvas interface, thereby increasing the flexibility and convenience of the editing operation.

[0089] In step S3104, in response to the multi-image video generation instruction, the agent performs video conversion based on the original reference image and the new image to obtain a new video segment.

[0090] For example, the video editing interface displays a multi-image video generation control. Based on the triggering operation of this control, the terminal obtains the uploaded new image and generates a multi-image video generation instruction based on the original reference image and the new image. (Continue to refer to...) Figure 9 The toolbar corresponding to the third video clip displays a "Multi-Image Video Generation" control, which represents the control for generating multi-image videos. Clicking this control will redirect the terminal to a canvas interface, and the canvas interface will display... Figure 15 The image upload area shown contains the original reference image. After uploading a new image in this area and clicking the "Generate Video" control in the lower right corner, the terminal generates a multi-image video generation command. Once the video is successfully generated, the image upload area will switch to displaying the newly generated video clip.

[0091] It should be noted that, in addition to the video editing interface, the multi-image video generation control can also be displayed in the canvas interface. For example... Figure 10As shown, the control labeled "Generate Video from Multiple Images" in the toolbar to the right of the target video clip represents a multi-image video generation control. This allows users to issue multi-image video generation commands not only in the video editing interface but also in the canvas interface, thereby increasing the flexibility and convenience of editing operations.

[0092] In step S3105, in response to the video frame to video conversion instruction, the agent performs video conversion based on at least one frame of the target video segment to obtain a new video segment.

[0093] For example, the video editing interface displays a video frame to video control. Based on the trigger operation of the video frame to video control, the terminal obtains at least one frame image selected from the target video segment, and generates a video frame to video instruction based on the at least one frame image.

[0094] For example, the at least one frame may be the first frame or the last frame of the target video segment. Alternatively, the at least one frame may contain the first frame of the target video segment and any frame selected from the target video segment; this application does not impose any limitations on this embodiment.

[0095] Continue to refer to Figure 9 The toolbar corresponding to the third video clip displays a video frame to video control (not shown in the image). Clicking this control will redirect the terminal to a canvas interface, which will then display... Figure 16 The video frame selection area is shown. This area includes the first frame of the target video clip. Users can select any frame from the target video clip as the last frame using the end frame selection control. After selection, clicking the "Generate Video" control in the lower right corner will generate a video frame to video conversion command. Once the video is successfully generated, the video frame selection area will switch to display the newly generated video clip.

[0096] It should be noted that, in addition to the video frame-to-video control being displayed in the video editing interface, it can also be displayed in the canvas interface. For example... Figure 10 As shown, a video frame to video control (not shown in the figure) can be displayed in the toolbar to the right of the target video clip. This allows users to issue video frame to video commands not only in the video editing interface but also in the canvas interface, thereby increasing the flexibility and convenience of editing operations.

[0097] Step S3106: In response to the screen element update instruction, the target screen elements in the target video segment are adjusted by the intelligent agent to obtain a new video segment. The adjustment of the target screen elements includes: adjusting at least one of the number, layout and dynamic effects of the target screen elements, or replacing the target screen elements with new screen elements.

[0098] For example, the video editing interface displays a screen element update control. Based on the trigger operation of the screen element update control, the terminal obtains the screen element modification conditions. The screen element modification conditions indicate the target screen element to be modified and the modification target of the target screen element. Based on the screen element modification conditions, a screen element update instruction is generated.

[0099] The conditions for modifying visual elements are the information input by the user to adjust visual elements in a target video clip. They clearly specify what needs to be changed and how it should be changed, and are the core basis for generating visual element update instructions. The target visual element to be modified is the specific visual element specified in the modification conditions that needs to be adjusted in the target video clip, such as a person, background prop, or text title. The goal of modifying the target visual element is the effect that the target visual element is explicitly stated in the modification conditions to achieve, such as increasing its quantity, shifting its position to the right, or replacing it with a new appearance.

[0100] Optionally, the terminal generates a screen element update instruction based on the selection operation of target screen elements in the target video segment. The selection operation of target screen elements includes various methods such as box selection, point selection, and circle selection.

[0101] For example, continue to refer to Figure 9 The toolbar corresponding to the third video clip displays a screen element update control (not shown in the figure). Clicking this control redirects the terminal to a canvas interface, where a screen element selection area appears. Users can use selection tools such as the box tool and the brush tool to select target screen elements within this area. They can then input their modification requests in the prompt input box within the selection area. The terminal uses an intelligent agent to perform semantic recognition on the target screen element selected by the user and the input modification requests, obtaining the screen element modification conditions. Based on these conditions, a screen element update instruction is generated. After generating a new video clip that meets the modification conditions, this new video clip is displayed on the canvas interface.

[0102] It should be noted that, in addition to the video editing interface, the screen element update control can also be displayed in the canvas interface. For example... Figure 10 As shown, the toolbar on the right side of the target video clip displays a screen element update control (not shown in the figure). This allows users to issue screen element update commands not only in the video editing interface but also in the canvas interface, thereby increasing the flexibility and convenience of editing operations.

[0103] In step S3107, in response to the video style conversion instruction, the intelligent agent adjusts the visual style of the target video segment to obtain a new video segment.

[0104] For example, the video editing interface displays a video style conversion control, and the terminal generates a video style conversion instruction based on the trigger operation of the video style conversion control.

[0105] For example, the video style conversion control is presented as a "style list dropdown" or a "style card group," which may include preset options such as "cartoon style," "retro film style," "cyberpunk style," and "ink wash style." After the user selects a style, the terminal directly generates a video style conversion instruction based on that selection. Then, the terminal uses an intelligent agent to convert the visual style of the target video clip to the style selected by the user, resulting in a new video clip.

[0106] For example, based on the triggering operation of the video style conversion control, the terminal displays a style conversion area on the canvas interface. This area may include a style description input box, where the user enters a custom style description, such as "warm and healing Japanese anime style, with orange-pink tones and soft lines." The terminal uses an agent to recognize this custom style description, determine the target style, and then generate a video style conversion instruction matching that target style. Alternatively, the style conversion area may include a style reference image upload button. The user uploads an image with the target style, such as a Van Gogh-style painting or a retro movie screenshot. The terminal uses an agent to analyze the target style of the image and generates a video style conversion instruction matching that style. After generating a new video clip matching the target style, this new video clip is displayed on the canvas interface.

[0107] This application provides multi-dimensional intelligent command functions, including video clip regeneration, lip-syncing to new dialogue, sound effect replacement, multi-image video generation, video frame to video conversion, screen element adjustment, and style conversion, covering core needs in video creation from content reconstruction and detail optimization to style adjustment. It can flexibly meet diverse creative goals and significantly improve video processing efficiency and convenience.

[0108] This application embodiment sets up various types of controls such as video regeneration, lip-syncing, and sound effect generation, and clarifies the command generation logic after each control is triggered, such as inputting new lines, uploading new pictures, selecting video frames, and selecting target elements. This allows users to generate the required commands without complicated operations, simply by triggering the corresponding controls and supplementing simple information. This significantly reduces the operational threshold of video editing, making video modification and innovation more intuitive and convenient, and comprehensively improving the efficiency and experience of video creation.

[0109] Based on the second embodiment of this application described above, a fourth embodiment of this application is proposed. Contents that are the same as or similar to the second embodiment can be referred to the above description, and will not be repeated hereafter. See also... Figure 17In the fourth embodiment, step S31 can be refined as follows: In response to the video regeneration instruction, a new reference image different from the original reference image is generated by the intelligent agent, and a new video segment is generated based on the new reference image. The original reference image is the basis for generating the target video segment. Since there are multiple ways to generate a new reference image, step S31 may include at least one of the following steps S3108 to S3113, and step S3114: In step S3108, in response to the image regeneration instruction, a new reference image is generated by the intelligent agent based on the original reference text, where the original reference text is the basis for generating the original reference image.

[0110] For example, the canvas interface displays an image regeneration control, and the terminal generates an image regeneration instruction based on the trigger operation of the image regeneration control. (See reference) Figure 9 The toolbar corresponding to the third video clip displays a "Modify Video Reference Image" control. Triggering this control redirects the terminal to... Figure 18 The canvas interface shown contains the target video clip and the original reference image upon which the target video clip is generated. Below the original reference image is the original reference text. To the right of the original reference image is its corresponding toolbar, which displays a "Regenerate" control to regenerate the image. Clicking this control generates an image regeneration command in the terminal. After a new reference image is generated based on the original reference text, the canvas interface will display the new reference image.

[0111] Step S3109: In response to the text-to-image instruction, a new reference image is generated based on the new reference text through the intelligent agent.

[0112] For example, the canvas interface displays a text-to-image control. The terminal, based on a trigger operation on the text-to-image control, obtains new input reference text and generates text-to-image instructions based on the new reference text. (Continue to the next section...) Figure 18 Clicking the text image control in the toolbar will display the canvas interface. Figure 19 The text input area shown allows you to enter new reference text, such as "Ultraman, clad in armor standing under the blue sky and white clouds, his chest reactor glowing," and then click the image generator control in the lower right corner. The terminal will then generate a text-to-image command. After a new reference image is generated based on the new reference text, the text input area will switch to displaying the newly generated reference image, such as... Figure 20 The effect shown.

[0113] In step S3110, in response to the image-generating instruction, a new reference image is generated based on the uploaded image through the intelligent agent.

[0114] For example, the canvas interface displays an image generation control. The terminal, based on a trigger operation on the image generation control, retrieves the uploaded image and generates an image generation command based on the uploaded image. The uploaded image can be at least one. The uploaded image can be of any type, such as a face image.

[0115] For example, the terminal obtains the uploaded image and image modification prompts based on the trigger operation of the image-generating control, and generates an image-generating instruction based on the uploaded image and image modification prompts. Then, the terminal, through an intelligent agent, modifies the uploaded image according to the image modification prompts to obtain a new reference image.

[0116] Continue to refer to Figure 18 Clicking the graphic control in the toolbar will bring up the canvas interface. Figure 21 The image upload area is shown below. Upload an image in this area, enter a prompt for image modification in the prompt input box, and click the generate control in the lower right corner. The terminal will then generate a new reference image. After a new reference image is generated based on the uploaded image, the image upload area will switch to displaying the newly generated reference image.

[0117] Continue to refer to Figure 18 Clicking the multi-image generator control in the toolbar will display a canvas interface. Figure 22 The image upload area is shown below. This area can upload multiple images. After uploading multiple images, enter your desired image modification suggestions in the prompt input box, and click the "Generate Image" control in the lower right corner. The terminal will then generate the new image. Once a new reference image is generated based on the uploaded images, the image upload area will switch to displaying this new reference image.

[0118] Continue to refer to Figure 18 Clicking the face image control in the toolbar will display a canvas interface. Figure 23 The image upload area is shown below. Upload a face image in the image upload area, enter your desired image modification suggestion in the prompt input box, and click the "Generate Image" control in the lower right corner. The terminal will then generate the new reference image. After a new reference image is generated based on the uploaded face image, the image upload area will switch to displaying the newly generated reference image.

[0119] In step S3111, in response to the image modification instruction, the agent modifies the original reference image based on the input image modification prompt to obtain a new reference image.

[0120] For example, the canvas interface displays an image editing control. The terminal obtains the input image modification prompt based on the trigger operation of the image editing control, and generates an image editing command based on the image modification prompt.

[0121] Continue to refer to Figure 18The toolbar displays a control labeled "Edit Image with One Sentence," which represents the image editing control. Clicking it will open the canvas interface. Figure 24 The image editing area is shown. A reference image is displayed in this area. Enter the image editing prompt "Little Rabbit Transforms into Ultraman" in the prompt input box below the reference image, and click the "Generate Image" control in the lower right corner. The terminal will then generate the image editing command. Based on the image editing prompt, the original reference image is modified to obtain a new reference image. Afterward, the image editing area will switch to display the newly generated reference image, as shown below. Figure 25 The effect shown.

[0122] In step S3112, in response to the region redrawing instruction, the target region of the original reference image is redrawn by the intelligent agent to obtain a new reference image.

[0123] For example, the canvas interface displays a region redraw control. Based on the trigger operation of the region redraw control, the terminal determines the target region selected in the original reference image, and generates a region redraw instruction based on the target region. The target region in the original reference image can be selected in various ways. For example, the target region can be drawn with a brush, outlined with lines, or enclosed with a rectangle, etc. This application embodiment does not limit this method.

[0124] For example, based on the trigger operation of the region redraw control, the terminal determines the target region selected in the original reference image and the redraw prompt information for the target region, and generates a region redraw instruction based on the target region and the redraw prompt information. Then, the terminal, through an intelligent agent, redraws the target region of the original reference image according to the redraw prompt information to obtain a new reference image.

[0125] Continue to refer to Figure 18 Clicking the area redraw control in the toolbar will display the canvas interface. Figure 26 The image modification area is shown. The original reference image is displayed in the image modification area. The user selects the target area (the area where the rabbit on the right is located) within the original reference image, then enters the redrawing prompt "Remove the rabbit on the right" in the prompt input box below, and clicks the redrawing control in the lower right corner. The terminal generates a region redrawing instruction. The terminal, through its intelligent agent, redraws the target area of ​​the original reference image according to the redrawing prompt. After obtaining the new reference image, the image modification area will switch to display the newly generated reference image, as shown below. Figure 27 The effect shown.

[0126] Step S3113: In response to the image element update instruction, the target image element in the original reference image is adjusted by the intelligent agent to obtain a new reference image. The adjustment of the target image element includes: adjusting at least one of the quantity and layout of the target image element, or replacing the target image element with a new image element.

[0127] For example, the canvas interface displays an image element update control. Based on the trigger operation of the image element update control, the terminal obtains the image element modification conditions. These conditions indicate the target image element to be modified and the modification target of the target image element. Based on the image element modification conditions, an image element update instruction is generated. Then, the terminal, through an intelligent agent, adjusts the target image element in the original reference image to conform to the modification target according to the image element modification conditions, thus obtaining a new reference image.

[0128] Continue to refer to Figure 18 The control displayed in the toolbar with "Edit Element" indicates an image element update control. Clicking this control will open the canvas interface. Figure 28 The image modification area is shown. A reference image is displayed in this area. Enter the modification conditions for the image element in the prompt input box below the reference image, such as "remove the rabbit on the right". Clicking the image generator control in the lower right corner generates an image element update command. The terminal, through its intelligent agent, adjusts the original reference image according to the modification conditions. After obtaining the new reference image, the image modification area will switch to display the newly generated reference image, such as... Figure 27 The effect shown.

[0129] For example, the terminal generates an image element update instruction based on the selection operation of target image elements in the original reference image. The selection operation of target image elements includes various methods such as box selection, point selection, and circle selection.

[0130] For example, a user selects target image elements, such as characters or props, from the original reference image in the canvas interface. After selection, a quick operation menu automatically pops up. This menu can include options such as adjusting the quantity, modifying the layout, and replacing elements. The user selects the corresponding option and sets specific modification parameters, such as changing the quantity from 2 to 4. The terminal generates an image element update instruction based on the selected target image elements, the selected modification items, and the specific modification parameters. Then, the agent adjusts the target image elements in the reference image according to the selected modification items and specific modification parameters to obtain a new reference image.

[0131] For example, after a user selects a target image element in the original reference image, they click the voice input button on the interface and speak their desired modification, such as "replace the selected red balloon with a yellow star." The terminal uses an intelligent agent to perform semantic analysis on the selected target image element and the spoken words to determine the target image element to be modified and its modification target, thus generating a corresponding image element update instruction. Alternatively, after selecting the target image element, the user can directly enter the text description "replace the selected red balloon with a yellow star" through the modification prompt input box on the canvas interface. In this case, the terminal uses an intelligent agent to perform semantic analysis on the selected target image element and the text description to determine the target image element to be modified and its modification target, thereby generating a corresponding image element update instruction. Then, the terminal uses the intelligent agent to adjust the target image element in the original reference image to conform to the modification target, resulting in a new reference image.

[0132] Step S3114: Generate a new video clip based on the new reference image.

[0133] For example, a new reference image in the canvas interface displays a corresponding video conversion control. Clicking this control causes the terminal to convert the new reference image into a new video clip via an intelligent agent. All reference images and video clips generated by the terminal are recorded in the canvas interface for the user to select and use.

[0134] This application's embodiments support obtaining new reference images through various methods, including image regeneration, text-to-image generation, image-to-image generation, image modification based on prompts, region redrawing, and image element updates. This provides full-scene flexibility for image creation, enabling everything from completely new generation to partial modifications. Furthermore, it can generate new video clips based on the new reference images, forming a complete chain from image material innovation to video material derivation. This enriches the diversity and relevance of process materials in the canvas interface, ultimately lowering the barrier to cross-type material creation and improving the overall efficiency and innovation of content generation.

[0135] This application's embodiments feature diverse controls on the canvas interface, including image regeneration, text-to-image, image-to-image, image modification, region redrawing, and image element updating. The logic for generating instructions after each control is clearly defined, such as uploading images, inputting modification prompts, selecting target areas, and selecting target elements. This allows users to quickly generate the necessary image creation instructions simply by triggering the corresponding controls and providing basic information, flexibly meeting the needs of all scenarios, from complete image generation to detailed optimization. This significantly lowers the technical barrier to image design and comprehensively improves the convenience and efficiency of image creation.

[0136] Based on the second embodiment of this application described above, a fifth embodiment of this application is proposed. Contents that are the same as or similar to the second embodiment can be referred to the above description and will not be repeated hereafter. See also... Figure 29 In the fifth embodiment, step S31 includes steps S3115 to S3116.

[0137] Step S3115: In response to the video regeneration command, obtain the modification instruction information input for the target video segment, and the modification instruction information indicates the content to be modified.

[0138] The content to be modified in the target video clip may include the lip-syncing of the characters in the target video clip, the content of the lines, the composition elements of the video frame, the style, quantity, layout, dynamic effects of specific frame elements, the sound effects of the target video clip, the video style, camera movement effects, etc.

[0139] For example, the modification instruction information can be input in various forms such as text and voice, and this application embodiment does not limit this.

[0140] Step S3116: The intelligent agent adjusts the content to be modified in the target video segment based on the modification instruction information to obtain a new video segment.

[0141] The modification instruction is expressed in natural language. The terminal uses an intelligent agent to perform semantic recognition on the modification instruction, determine the content to be modified, and then adjust the content to be modified in the target video segment to obtain a new video segment.

[0142] Optionally, the modification instruction information also includes the modification target of the content to be modified. Based on the modification instruction information, the intelligent agent adjusts the content to be modified in the target video segment to obtain a new video segment, including: adjusting the content to be modified in the target video segment to conform to the modification target based on the modification instruction information to obtain a new video segment.

[0143] The modification target of the content to be modified refers to the final expected state or effect set for the content to be modified when adjusting the video segment. It clarifies what the content to be modified should look like and is the core basis for the intelligent agent to accurately adjust the video, ensuring that the modification result meets the user's needs. For example, if the content to be modified is a character's dialogue in the target video segment, the modification target can be set to replace the original dialogue "Welcome" with "It's nice to meet you", and the character's lip movements should match the new dialogue.

[0144] For example, in a target video clip, the scene where the character is located features slowly falling raindrops. The user inputs a modification instruction for this target video clip: "Change the falling raindrops in the scene to cherry blossom petals fluttering in the air." The terminal then uses an intelligent agent to perform semantic recognition on this modification instruction, determining that the content to be modified is the background dynamic element of raindrops, and the modification target is to change the raindrops to cherry blossom petals fluttering in the air. Subsequently, the intelligent agent processes the target video clip to adjust the background dynamic element of raindrops to cherry blossom petals fluttering in the air, resulting in a new video clip.

[0145] For example, the terminal displays the newly generated video clip on the canvas interface, and the new video clip has a corresponding application control. The user can trigger the application control to replace the target video clip in the video generated by the agent with the new video clip corresponding to the triggered application control.

[0146] This application embodiment obtains modification instructions from the user for a target video segment, and the intelligent agent precisely adjusts the target video segment based on this information, achieving direct connection between user needs and intelligent execution. This avoids the blind modification by the intelligent agent, ensuring that the new video segment accurately matches the user's expectations, and simplifies the operation process. Users only need to specify the direction of modification to generate a new video segment, significantly improving the accuracy and efficiency of video generation and lowering the threshold for personalized creation.

[0147] This application's embodiments, by clearly specifying the content to be modified and the modification target in the modification instruction information, allow the intelligent agent to directly and accurately adjust the target video segment, avoiding modification deviations caused by ambiguous requirements. This further improves the accuracy and success rate of video modification, and can efficiently meet users' customized needs for materials.

[0148] Based on the first embodiment of this application described above, a sixth embodiment of this application is proposed. Contents that are the same as or similar to the first embodiment can be referred to the above description, and will not be repeated hereafter. See also... Figure 30 In the sixth embodiment, step S2 is refined into step S21, and step S3 is refined into step 34.

[0149] S21, in response to an editing command for the video, displays a video editing interface, which includes multimedia elements of multiple video clips arranged in chronological order.

[0150] Multimedia elements refer to the various basic components that make up a video clip; they are independently editable media units. Optionally, multimedia elements include at least one of the following: video footage, special effects, subtitles, sound effects, background music, and voice-over.

[0151] For example, the video editing interface includes a timeline, on which the multimedia elements of multiple video clips are arranged sequentially in a visual format. Each multimedia element of a video clip corresponds to an independent time block on the timeline. Users can intuitively view the time order and duration percentage of the multimedia elements of each video clip, and can directly select, drag and drop to adjust the order of the multimedia elements of each video clip on the timeline.

[0152] For example, different types of multimedia elements are located on different tracks. Video footage is on the basic video track, special effects are on a dedicated special effects track, subtitles are on a separate subtitle track, and sound effects, background music, and voice-over are on separate audio tracks. This track division clearly separates various multimedia elements on the timeline, allowing users to precisely locate a specific type of multimedia element, such as adjusting the subtitle position on the subtitle track. Users can also independently edit multimedia elements on a single track, such as modifying the volume of the background music track without affecting the video or subtitles. This avoids interference between different multimedia elements, further improving the accuracy and convenience of editing operations.

[0153] S34, based on the editing operation of the target multimedia constituent elements of the target video segment, update the target multimedia constituent elements of the target video segment.

[0154] The target multimedia element refers to one or more specific multimedia elements within the target video clip that the user selects and wishes to modify, such as the timbre of the audio or the style of the subtitles. (Reference) Figure 31 After selecting the subtitle for the first video clip in the subtitle track of the video editing interface, a subtitle editing window will pop up on the terminal. In this window, you can adjust the subtitle content, style, and font size. The subtitle editing window also displays a global application control, "Apply to All." Selecting this control and clicking "OK" will generate a global application command. Subtitles for all video clips in the subtitle track will then be adjusted according to the settings in the subtitle editing window.

[0155] refer to Figure 32 After selecting the sound effect for the first video clip in the sound effects track of the video editing interface, a sound effects editing window pops up on the terminal. In this window, you can adjust the volume of the sound effects. The sound effects editing window also displays a global application control, "Apply to All." Selecting this global application control and clicking "OK" generates a global application command. The volume of the sound effects for all video clips in the sound effects track will then be adjusted according to the settings in the sound effects editing window.

[0156] Optionally, based on the editing operation of the target multimedia constituent elements of the target video segment, the target multimedia constituent elements of the target video segment are updated, including: in response to the multimedia element generation instruction, the target multimedia constituent elements of the target video segment are regenerated by an intelligent agent, and the original target multimedia constituent elements of the target video segment are replaced with the new target multimedia constituent elements; or, in response to the multimedia element upload instruction, the target multimedia constituent elements uploaded locally are obtained, and the original target multimedia constituent elements of the target video segment are replaced with the locally uploaded target multimedia constituent elements; or, in response to the multimedia element search instruction, the target multimedia constituent elements are searched from the network, and the original target multimedia constituent elements of the target video segment are replaced with the searched target multimedia constituent elements.

[0157] This solution offers three precise replacement methods for specific multimedia elements within video clips. Taking sound effects as an example, the intelligent agent can regenerate the sound effects for the target video clip and replace the original sound effects with the newly generated ones; sound effects can be uploaded locally, such as user-recorded sound effects, to replace the original ones; or suitable sound effects can be searched online to replace the original ones. This enables precise and multi-faceted replacement of multimedia elements, significantly improving the flexibility and efficiency of video editing.

[0158] In this embodiment, the focus is on modifying and replacing multimedia components, rather than modifying and replacing the entire video segment. This avoids redundant operations that would require modifying the entire video segment due to dissatisfaction with a local multimedia component, allowing for more precise editing. Furthermore, the three replacement methods cover all scenarios: intelligent generation, local reuse, and network supplementation. This lowers the barrier to adjusting multimedia components, enabling users to efficiently optimize video details and ensure the final video better meets expectations in terms of the coordination and adaptability of various multimedia components, further enhancing the editing experience and video quality.

[0159] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the video processing method of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0160] This application also provides a video processing apparatus, please refer to... Figure 33 The video processing device includes: Video acquisition module 10 is used to acquire videos generated by the intelligent agent, the videos containing multiple video segments; The video display module 20 is used to display a video editing interface in response to video editing instructions. The video editing interface includes multiple video clips arranged in chronological order. The video update module 30 is used to update the target video segment based on the editing operation performed on the target video segment.

[0161] Optionally, the video update module 30 includes: A video generation unit, in response to a video regeneration instruction, generates a new video segment through an intelligent agent and replaces the target video segment with the new video segment; or, The video upload unit is used to respond to a video upload command, obtain the video to be uploaded, and replace the target video segment with the uploaded video; or, The video search unit is used to respond to video search commands, retrieve web search videos, and replace the target video segment with the web search videos.

[0162] Optionally, the video generation unit is configured to perform at least one of the following: In response to the instruction to regenerate the video clip, the intelligent agent re-converts the video based on the original reference image to obtain a new video clip. The original reference image is the basis for generating the target video clip. In response to the lip-sync video generation command, the intelligent agent converts the lip movements of the characters in the target video clip from those adapted to the original lines to those adapted to the new lines, thus obtaining a new video clip; In response to the sound effect generation command, the agent converts the original sound effect in the target video clip into a new sound effect to obtain a new video clip; In response to the multi-image video generation command, the intelligent agent performs video conversion based on the original reference image and the new image to obtain a new video clip; In response to a video frame to video conversion instruction, an intelligent agent performs video conversion based on at least one frame in the target video segment to obtain a new video segment. In response to a screen element update command, the target screen element in the target video segment is adjusted by an intelligent agent to obtain a new video segment. The adjustment of the target screen element includes: adjusting at least one of the number, layout and dynamic effects of the target screen element, or replacing the target screen element with a new screen element. In response to a video style conversion command, the intelligent agent adjusts the visual style of the target video segment to obtain a new video segment.

[0163] Optionally, the video generation unit is configured to, in response to a video regeneration instruction, generate a new reference image different from the original reference image through an intelligent agent, and generate a new video segment based on the new reference image; wherein, the original reference image is the basis for generating the target video segment, and the video generation unit is configured to perform at least one of the following to generate the new reference image: In response to the image regeneration instruction, a new reference image is generated based on the original reference text through an intelligent agent. The original reference text is the basis for the generation of the original reference image. In response to the text-to-image command, a new reference image is generated based on the new reference text through an intelligent agent; In response to the image-to-image command, a new reference image is generated based on the uploaded image through an intelligent agent; In response to the image modification command, the intelligent agent modifies the original reference image based on the input image modification prompts to obtain a new reference image; In response to the region redraw command, the target region of the original reference image is redrawn by an intelligent agent to obtain a new reference image; In response to an image element update instruction, the target image element in the original reference image is adjusted by an intelligent agent to obtain a new reference image. The adjustment of the target image element includes: adjusting at least one of the quantity and layout of the target image element, or replacing the target image element with a new image element.

[0164] Optionally, the video generation unit includes: The instruction acquisition subunit is used to acquire modification instruction information for the target video segment in response to the video regeneration instruction. The modification instruction information indicates the content to be modified. The video adjustment subunit is used by an intelligent agent to adjust the content to be modified in a target video segment based on modification instructions, so as to obtain a new video segment.

[0165] Optionally, the modification instruction information may also include the target of the modification to be made. The video adjustment subunit is used by an intelligent agent to adjust the content to be modified in the target video segment to meet the modification target based on the modification instruction information, so as to obtain a new video segment.

[0166] Optionally, the video editing interface includes multimedia elements comprising multiple video clips arranged in chronological order; The video update module 30 is used to update the target multimedia components of the target video segment based on the editing operations on the target multimedia components of the target video segment.

[0167] Optionally, the multimedia components include at least one of the following: Video footage, special effects, subtitles, sound effects, background music, and voice-over.

[0168] Optionally, the video update module 30 is configured to, in response to a multimedia element generation instruction, regenerate the target multimedia elements of the target video segment through an intelligent agent, and replace the original target multimedia elements of the target video segment with the new target multimedia elements; or, in response to a multimedia element upload instruction, obtain the locally uploaded target multimedia elements and replace the original target multimedia elements of the target video segment with the locally uploaded target multimedia elements; or, in response to a multimedia element search instruction, search for target multimedia elements from the network and replace the original target multimedia elements of the target video segment with the searched target multimedia elements.

[0169] Optionally, the video update module 30 is used to update multiple video segments based on editing operations on the target video segment in response to global application commands.

[0170] Optionally, the video clip can be a storyboard video clip or a music-matched video clip.

[0171] Optionally, the device further includes: The video editing module is used to respond to video editing and optimization commands, displaying an editing and optimization interface. This interface is used to perform video editing and optimization operations, including at least one of the following: Add video clips, video transitions, stickers, watermarks, QR codes, and filters; Delete video clips, video transitions, stickers, watermarks, QR codes, and filters; Adjust the playback speed of video clips, the color tone of the video, the aspect ratio, subtitles, and the matching degree between video visuals and sound effects.

[0172] Optionally, the video editing interface includes a video playback area and a video editing area; The video editing area includes multiple video clips arranged in chronological order; The video playback area is used to play the video segment that is currently being edited in the video editing area.

[0173] Optionally, the video editing interface may also include a material display area; The material display area includes materials associated with the video, which include at least one of video materials, image materials, and audio materials.

[0174] Optionally, the video acquisition module 10 is used to display a video generation interface, which includes a text input control; and to generate a video based on the text information entered in the text input control by an intelligent agent.

[0175] Optionally, the video generation interface may also include at least one of the following types of controls: A aspect ratio indicator control is used to indicate the aspect ratio of the video generated by the agent. The visual style indicator control is used to indicate the visual style of the videos generated by the agent; The subtitle style indicator control is used to indicate the subtitle style of the video generated by the agent; The reference image selection control is used to indicate the reference images that the agent uses to generate the video; An agent selection control is used to instruct the agent used to generate the video.

[0176] The video processing apparatus provided in this application, employing the video processing method described in the above embodiments, can solve the technical problem of low practicality caused by the inconsistency between the video generated by the intelligent agent and the user's expectations. Compared with the prior art, the beneficial effects of the video processing apparatus provided in this application are the same as those of the video processing method described in the above embodiments, and other technical features in the video processing apparatus are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0177] This application provides a video processing apparatus, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the video processing method described above.

[0178] The following is for reference. Figure 34 The diagram illustrates a structural schematic of a video processing device suitable for implementing embodiments of this application. The video processing device in the embodiments of this application may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 34 The video processing device shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.

[0179] like Figure 34As shown, the video processing device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the video processing device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1003 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows the video processing equipment to communicate wirelessly or wiredly with other devices to exchange data. Although the figure shows video processing equipment with various systems, it should be understood that it is not required to implement or possess all of the systems shown. More or fewer systems may be implemented alternatively.

[0180] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0181] The video processing device provided in this application, employing the video processing method described in the above embodiments, can solve the technical problem of low practicality caused by the inconsistency between the video generated by the intelligent agent and the user's expectations. Compared with the prior art, the beneficial effects of the video processing device provided in this application are the same as those of the video processing method provided in the above embodiments, and other technical features of the video processing device are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0182] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0183] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0184] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to perform the video processing method described in the above embodiments.

[0185] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0186] The aforementioned computer-readable storage medium may be included in the video processing device; or it may exist independently and not assembled into the video processing device.

[0187] The aforementioned computer-readable storage medium carries one or more programs that, when executed by a video processing device, cause the video processing device to: acquire a video generated by an intelligent agent, the video containing multiple video segments; display a video editing interface in response to an editing instruction on the video, the video editing interface including multiple video segments arranged in chronological order; and update the target video segment based on the editing operation on the target video segment.

[0188] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0189] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0190] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0191] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described video processing method. This solves the technical problem in related technologies where the video generated by the intelligent agent does not match user expectations and has low practicality. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the video processing method provided in the above embodiments, and will not be repeated here.

[0192] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the video processing method described above.

[0193] The computer program product provided in this application can solve the technical problem that the videos generated by intelligent agents in related technologies do not meet user expectations and have low practicality. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as the beneficial effects of the video processing method provided in the above embodiments, and will not be repeated here.

[0194] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A video processing method, characterized in that, The method includes: Acquire a video generated by the intelligent agent, the video containing multiple video segments; In response to an editing instruction on the video, a video editing interface is displayed, the video editing interface including the plurality of video clips arranged in chronological order; The target video segment is updated based on the editing operations performed on it.

2. The method as described in claim 1, characterized in that, The step of updating the target video segment based on editing operations on the target video segment includes: In response to a video regeneration instruction, the agent generates a new video segment and replaces the target video segment with the new video segment; or, In response to a video upload command, obtain the upload video and replace the target video segment with the upload video; or... In response to a video search command, a video is retrieved from the internet and the target video segment is replaced with the video retrieved from the internet.

3. The method as described in claim 2, characterized in that, In response to the video regeneration instruction, the agent generates a new video segment, including at least one of the following: In response to the segment regeneration instruction, the intelligent agent re-converts the video based on the original reference image to obtain a new video segment, wherein the original reference image is the basis for generating the target video segment; In response to the lip-sync video generation command, the intelligent agent converts the lip movements of the characters in the target video clip from those adapted to the original dialogue to those adapted to the new dialogue, thereby obtaining a new video clip; In response to the sound effect generation command, the intelligent agent converts the original sound effect in the target video segment into a new sound effect to obtain a new video segment; In response to the multi-image video generation command, the intelligent agent performs video conversion based on the original reference image and the new image to obtain a new video clip; In response to a video frame to video instruction, the intelligent agent performs video conversion based on at least one frame of the target video segment to obtain a new video segment. In response to a screen element update command, the intelligent agent adjusts the target screen elements in the target video segment to obtain a new video segment. The adjustment of the target screen elements includes: adjusting at least one of the number, layout and dynamic effects of the target screen elements, or replacing the target screen elements with new screen elements. In response to a video style conversion command, the intelligent agent adjusts the visual style of the target video segment to obtain a new video segment.

4. The method as described in claim 2, characterized in that, The process of generating a new video segment in response to a video regeneration instruction, through the intelligent agent, includes: In response to a video regeneration command, the agent generates a new reference image different from the original reference image, and generates a new video clip based on the new reference image; wherein the original reference image is the basis for generating the target video clip, and the method for generating the new reference image includes at least one of the following: In response to the image regeneration instruction, the agent generates a new reference image based on the original reference text, wherein the original reference text is the basis for generating the original reference image. In response to the text-to-image command, the intelligent agent generates a new reference image based on the new reference text. In response to the image-generating command, the intelligent agent generates a new reference image based on the uploaded image; In response to the image modification command, the intelligent agent modifies the original reference image based on the input image modification prompt to obtain a new reference image; In response to the region redrawing command, the intelligent agent redraws the target region of the original reference image to obtain a new reference image; In response to an image element update instruction, the agent adjusts the target image elements in the original reference image to obtain a new reference image. The adjustment of the target image elements includes: adjusting at least one of the quantity and layout of the target image elements, or replacing the target image elements with new image elements.

5. The method as described in claim 2, characterized in that, The process of generating a new video segment in response to a video regeneration instruction, through the intelligent agent, includes: In response to a video regeneration command, modification instruction information is obtained for the target video segment, the modification instruction information indicating the content to be modified; The intelligent agent adjusts the content to be modified in the target video segment based on the modification instruction information to obtain the new video segment.

6. The method as described in claim 5, characterized in that, The modification instruction information also includes the modification target of the content to be modified. The step of adjusting the content to be modified in the target video segment based on the modification instruction information, using the intelligent agent, to obtain the new video segment includes: The intelligent agent adjusts the content to be modified in the target video segment to conform to the modification target based on the modification instruction information, thereby obtaining the new video segment.

7. A video processing apparatus, characterized in that, The device includes: The video acquisition module is used to acquire videos generated by the intelligent agent, wherein the videos contain multiple video segments; A video display module is used to display a video editing interface in response to an editing command for the video, the video editing interface including the plurality of video segments arranged in chronological order; The video update module is used to update the target video segment based on the editing operation performed on the target video segment.

8. A video processing device, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the video processing method as described in any one of claims 1 to 6.

9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the video processing method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the video processing method as described in any one of claims 1 to 6.

Images