A video extension processing method and system

Abstract

The present invention discloses a video extension processing method and system, which relates to the field of video processing technology, including: obtaining a first video segment through a video creation initiating user; the video creation initiating user initiating an extended video creation request for the first video segment; the first participating user obtaining the creation content of the first video segment according to the extended video creation request of the first video segment, and obtaining a second video segment spliced ​​with the first video segment; the first participating user initiating a splicing request of the first video segment and the second video segment; obtaining the first spliced ​​video segment after splicing. The present invention realizes inviting other users to participate in the same video creation through the splicing of video segments, extending the duration and content of the video, lowering the threshold and cost of video creation for users, reducing the creation time, enhancing the collaboration and interaction between users, improving the social experience, and enhancing the dissemination speed and amount of video content.

Description

Technical Field

[0001] The present invention relates to the technical field of video processing, and more particularly to a video expansion processing method and system. Background Art

[0002] Video generation technology has made significant progress in recent years, using AI video generation models and advanced algorithms to create video content. Current technology mainly describes the scene to be generated through text or image input. For example, users can enter a prompt word to describe the video screen, and the system will generate a video that matches the scene described by the prompt word. Existing AI video generation technology is usually limited to the output of a single video. Usually, an AI video is 5-10 seconds long, and some AI video generation models can generate 20 seconds at a time. Shorter videos often fail to fully display complex storylines or emotional expressions. This limitation is worth paying attention to because users' demand for video content often exceeds the scope of what current technology can provide. Under the same keyword or image description, different generated video results often show diversity. This is due to the randomness and diversity settings of the generation model, which is beneficial when people want to explore different creative expressions. This requires users to generate multiple videos and select available videos with better generation effects. They also need to enter different text prompt words to generate more videos, and then use professional video editing software to edit and splice these videos into a video with satisfactory length and content, which will increase the cost investment and bring higher barriers to the use of professional video editing software.

[0003] Therefore, how to propose a video extension processing method and system to solve the problems existing in the current video generation technology so that multiple users can jointly participate in creating a video with longer duration, richer content, better user participation and interactivity is an issue that technical personnel in this field urgently need to solve. Summary of the invention

[0004] In view of this, the present invention provides a video extension processing method and system to solve the problems existing in the current video generation technology, so that multiple users can jointly participate in creating a video with longer duration, richer content, better user participation and interactivity. In order to achieve the above purpose, the present invention adopts the following technical solutions:

[0005] A video expansion processing method, comprising:

[0006] At least two users, the video creator and the first participating user, complete the following steps together:

[0007] The user initiates the video creation to obtain a first video segment, and pre-processes the first video segment;

[0008] The video creation initiating user initiates an extended video creation request for the first video segment;

[0009] The first participating user obtains the creation content of the first video segment according to the extended video creation request of the first video segment, obtains the second video segment to be spliced ​​with the first video segment, and pre-processes the second video segment;

[0010] The first participating user initiates a request to splice the first video segment with the second video segment;

[0011] In response to the splicing request, the first video segment and the second video segment are spliced ​​to obtain a spliced ​​first spliced ​​video segment.

[0012] Optionally, obtaining the first video segment through the user initiating video creation includes: generating the first video segment through an AI video generation model, or uploading the first video segment through the user initiating video creation, and obtaining the second video segment spliced ​​with the first video segment includes: generating the second video segment through the AI ​​video generation model, or uploading the second video segment through the first participating user.

[0013] Optionally, also include:

[0014] Adding header information before the first video segment;

[0015] If more than two users complete the steps together, add an ending message to the end video segment;

[0016] If the second video segment obtained by splicing with the first video segment is an ending video segment, then ending information is added after the second video segment.

[0017] Optionally, the preprocessing of the first video segment includes: labeling the first video segment and mapping it with the identity ID of the user who initiated the video creation, and the preprocessing of the second video segment includes: labeling the second video segment and mapping it with the identity ID of the first participating user.

[0018] Optionally, the first participating user obtaining the creation content of the first video segment according to the extended video creation request of the first video segment includes:

[0019] In response to the extended video creation request of the first video segment, the first video segment is displayed as extended video creation content on the display interface for browsing by the first participating user;

[0020] or sent by the video creation initiator to the first participating user;

[0021] Or after the extended video creation content is displayed on the display interface, it is sent by the video creation initiator to the first participating user.

[0022] Optionally, the second video segment obtained to be spliced ​​with the first video segment includes: the creative content of the first video segment includes the last frame image of the first video segment, and the first participating user inputs the last frame image in the creative content of the first video segment as the first frame image of the second video segment to the AI ​​video generation model to generate the second video segment to be spliced ​​with the first video segment.

[0023] Optionally, the initiating user to obtain the first video segment through video creation includes:

[0024] The user who initiates the video creation enters the prompt word and selects the first and last frame images, which are then sent to the AI ​​video generation model.

[0025] In response to the sending, a first video segment without any subtitles and audio is obtained according to the prompt words and the first and last frame images;

[0026] The video creation initiating user initiates an extended video creation request and chooses to send the first video segment to the first participating user, or share it in the display interface.

[0027] Optionally, it also includes that, in response to the sending, after obtaining a first video segment without any subtitles and audio according to the prompt words and the first and last frame pictures, the video creation initiator user edits subtitles and adds audio to the first video segment.

[0028] Optionally, the first participating user obtains the creation content of the first video segment according to the extended video creation request of the first video segment, and obtains the second video segment to be spliced ​​with the first video segment, including:

[0029] After receiving the first video segment, the first participating user decides whether to perform splicing creation;

[0030] If the first participating user decides to perform splicing creation, the last frame of the first video segment is selected as the first frame of the second video segment, or, according to the creation content of the first video segment, a new picture is selected as the first frame picture, and a new image is selected as the last frame of the second video segment, or the last frame image is not selected and only the first frame image is used as a reference image; or, only a prompt word is input according to the creation content of the first video segment without selecting any picture as a reference image or as the first and last frames;

[0031] The first participating user enters a prompt word and selects the duration of the generated video;

[0032] Sending to the AI ​​video generation model, and in response to the sending, generating a second video segment without any subtitles and audio;

[0033] Save the video segment to the server.

[0034] Optionally, it also includes sending it to the AI ​​video generation model, generating a second video segment without any subtitles and audio in response to the sending, and the first participating user editing subtitles and adding audio to the second video segment.

[0035] Optionally, the splicing processing of the first video segment and the second video segment includes:

[0036] A first participating user initiates a request to splice the first video segment and the second video segment;

[0037] Users select multiple video segments to stitch together, adjust the order of the segments, and add transition effects;

[0038] During the splicing process, users edit the subtitles and audio of each video segment to ensure that the spliced ​​video has complete subtitles and audio according to the creative content;

[0039] Multiple users communicate and discuss whether the spliced ​​video needs further modification;

[0040] Based on the discussion results, the user edits the subtitles and audio of the video segment again, or re-splices it;

[0041] Users preview the spliced ​​video and save or upload it only after ensuring they are satisfied.

[0042] Optionally, a video extension processing system includes: a client, a server and a database; the client is communicatively connected to the server for editing input video creation content, uploading and downloading videos, sending task requests, receiving results, and using a real-time protocol to support instant messaging and status synchronization; the server is used to receive and process task requests and receive and send generated video segments, and manage task queues to ensure that tasks are executed in sequence or priority and to allocate computing resources; the database is communicatively connected to the server for storing information.

[0043] Optionally, the client includes: an AI video generation editor, a video upload module, a video editor, a splicing editor, and a message and notification center;

[0044] The AI ​​video generation editor is used to generate video segments through an AI video generation model;

[0045] The video upload module is used for users to upload videos;

[0046] The video editor is used to edit subtitles and add audio to the generated video segments;

[0047] The splicing editor is used to splice multiple video segments;

[0048] The message and notification center is used to display requests or messages from other users.

[0049] Optionally, the client further includes a user interaction module and a video stitching user message bar:

[0050] The user interaction module is used to support sharing of video segments between users, initiating extended video creation requests, and browsing the creations of other users;

[0051] The video splicing user message bar is used to support multiple users to communicate during the splicing process.

[0052] Optionally, the server includes a user management module, a video storage module, a task scheduling module, an API interface module, a message notification service module and a video splicing engine module;

[0053] The user management module is used to store basic information of users and perform authority management;

[0054] The video storage module is used for storing video data and metadata management;

[0055] The task scheduling module is used for task queue management and resource allocation;

[0056] The API interface module is used to upload / download videos, transmit AI service requests, receive splicing requests, and return results;

[0057] The message notification service module is used to push messages or notifications and provide notification reminders;

[0058] The video splicing engine module is used for frame alignment, color correction, audio synchronization, transition effects, subtitle merging, audio merging and encoding optimization.

[0059] Optionally, it also includes an AI video generation model, which is communicatively connected to the server. The AI ​​video generation model includes an API interface, which is used to receive task request information from the server and return the generated video segment to the server after completing the video generation.

[0060] Optionally, the database includes a user table, a video segment table and a splicing table, the user table is used to store user information, the video segment table is used to store video information, and the splicing table is used to store splicing information.

[0061] It can be seen from the above technical solutions that, compared with the prior art, the present invention discloses a video expansion processing method and system, which has the following beneficial effects:

[0062] The present invention proposes a video extension processing method, comprising: at least two users, a video creation initiating user and a first participating user, jointly complete the following steps: the video creation initiating user obtains a first video segment and pre-processes the first video segment; the video creation initiating user initiates an extended video creation request for the first video segment; the first participating user obtains the creation content of the first video segment according to the extended video creation request of the first video segment, and obtains a second video segment to be spliced ​​with the first video segment, and pre-processes the second video segment; the first participating user initiates a splicing request for the first video segment and the second video segment; in response to the splicing request, the first video segment and the second video segment are spliced ​​to obtain a first spliced ​​video segment after splicing. The present invention realizes user-initiated AI video creation based on the AI ​​video generation model, and invites other users to participate in the same video creation by splicing video segments, thereby extending the duration and content of the video, lowering the video creation threshold and creation cost of each user, reducing the creation time, enhancing collaboration and interaction between users, improving the social experience, and enhancing the dissemination speed and amount of video content; simplifying the video creation process: users do not need to have professional video editing skills, but only need simple operations to complete high-quality video creation, which lowers the entry threshold; improving efficiency: AI-assisted generation of video segments greatly shortens the time of traditional video production and improves creation efficiency; personalized customization: users can input different prompt words, different first frame, last frame images and other creation content according to their needs, and select different AI generation parameters to create unique video works. The present invention can quickly generate and share videos, reducing tedious editing steps; it can stimulate the creativity of multiple users, allowing each user to express his or her ideas and stories more easily; the process of multi-person collaboration is full of fun, which can enhance the relationship between users, and multi-person collaboration stimulates individual creativity. The entire video completed by multiple users can make the video higher in quality, more ornamental and interesting; it allows users to see the works they and others have created together, which will bring great satisfaction and a sense of accomplishment. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0064] Figure 1 A schematic flow chart of a video expansion processing method provided by the present invention.

[0065] Figure 2 The present invention provides a specific flow chart of a video expansion processing method.

[0066] Figure 3 A structural framework diagram of a video extension processing system provided by the present invention.

[0067] Figure 4 This is a structural diagram of the AI ​​video generation model provided by the present invention.

[0068] Figure 5 This is a main structure diagram of a video extension processing system client provided by the present invention.

[0069] Figure 6 A video extension processing system client extension structure diagram provided by the present invention.

[0070] Figure 7 A specific structural diagram of a video extension processing system provided by the present invention. DETAILED DESCRIPTION

[0071] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0072] The embodiment of the present invention discloses a video expansion processing method, such as Figure 1 As shown, including:

[0073] At least two users, the video creator and the first participating user, complete the following steps together:

[0074] The user initiates the video creation to obtain a first video segment, and pre-processes the first video segment;

[0075] The video creation initiating user initiates an extended video creation request for the first video segment;

[0076] The first participating user obtains the creation content of the first video segment according to the extended video creation request of the first video segment, obtains the second video segment to be spliced ​​with the first video segment, and pre-processes the second video segment;

[0077] The first participating user initiates a request to splice the first video segment with the second video segment;

[0078] In response to the splicing request, the first video segment and the second video segment are spliced ​​to obtain a spliced ​​first spliced ​​video segment.

[0079] Furthermore, obtaining the first video segment through the user initiating video creation includes: generating the first video segment through an AI video generation model, or uploading the first video segment through the user initiating video creation, and obtaining the second video segment spliced ​​with the first video segment includes: generating the second video segment through the AI ​​video generation model, or uploading the second video segment through the first participating user.

[0080] Furthermore, it also includes:

[0081] Adding header information before the first video segment;

[0082] If more than two users complete the steps together, add an ending message to the end video segment;

[0083] If the second video segment obtained by splicing with the first video segment is an ending video segment, then ending information is added after the second video segment.

[0084] Furthermore, the preprocessing of the first video segment includes: labeling the first video segment and mapping it with the identity ID of the user who initiated the video creation, and the preprocessing of the second video segment includes: labeling the second video segment and mapping it with the identity ID of the first participating user.

[0085] Furthermore, the first participating user obtaining the creation content of the first video segment according to the extended video creation request of the first video segment includes:

[0086] In response to the extended video creation request of the first video segment, the first video segment is displayed as extended video creation content on the display interface for browsing by the first participating user;

[0087] or sent by the video creation initiator to the first participating user;

[0088] Or after the extended video creation content is displayed on the display interface, it is sent by the video creation initiator to the first participating user.

[0089] Furthermore, the second video segment obtained to be spliced ​​with the first video segment includes: the creative content of the first video segment includes the last frame image of the first video segment, and the first participating user inputs the last frame image in the creative content of the first video segment as the first frame image of the second video segment to the AI ​​video generation model to generate the second video segment to be spliced ​​with the first video segment.

[0090] Furthermore, the step of initiating the user to obtain the first video segment through video creation includes:

[0091] The user who initiates the video creation enters the prompt word and selects the first and last frame images, which are then sent to the AI ​​video generation model.

[0092] In response to the sending, a first video segment without any subtitles and audio is obtained according to the prompt words and the first and last frame images;

[0093] The video creation initiating user initiates an extended video creation request and chooses to send the first video segment to the first participating user, or share it in the display interface.

[0094] Furthermore, it also includes that, in response to the sending, after obtaining a first video segment without any subtitles and audio according to the prompt words and the first and last frame pictures, the video creation initiator user edits subtitles and adds audio to the first video segment.

[0095] Furthermore, the first participating user obtains the creation content of the first video segment according to the extended video creation request of the first video segment, and obtains the second video segment to be spliced ​​with the first video segment, including:

[0096] After receiving the first video segment, the first participating user decides whether to perform splicing creation;

[0097] If the first participating user decides to perform splicing creation, the last frame of the first video segment is selected as the first frame of the second video segment, or, according to the creation content of the first video segment, a new picture is selected as the first frame picture, and a new image is selected as the last frame of the second video segment, or the last frame image is not selected and only the first frame image is used as a reference image; or, only a prompt word is input according to the creation content of the first video segment without selecting any picture as a reference image or as the first and last frames;

[0098] The first participating user enters a prompt word and selects the duration of the generated video;

[0099] Sending to the AI ​​video generation model, and in response to the sending, generating a second video segment without any subtitles and audio;

[0100] Save the video segment to the server.

[0101] Furthermore, it also includes sending it to the AI ​​video generation model, generating a second video segment without any subtitles and audio in response to the sending, and the first participating user editing subtitles and adding audio to the second video segment.

[0102] Furthermore, the splicing processing of the first video segment and the second video segment includes:

[0103] A first participating user initiates a request to splice the first video segment and the second video segment;

[0104] Users select multiple video segments to stitch together, adjust the order of the segments, and add transition effects;

[0105] During the splicing process, users edit the subtitles and audio of each video segment to ensure that the spliced ​​video has complete subtitles and audio according to the creative content;

[0106] Multiple users communicate and discuss whether the spliced ​​video needs further modification;

[0107] Based on the discussion results, the user edits the subtitles and audio of the video segment again, or re-splices it;

[0108] Users preview the spliced ​​video and save or upload it only after ensuring they are satisfied.

[0109] In a specific implementation, a video expansion processing system, such as Figure 3 As shown, it includes: a client, a server and a database; the client is connected to the server for communication and is used to edit input video creation content, upload and download videos, send task requests, receive results, and use real-time protocols to support instant messaging and status synchronization; the server is used to receive and process task requests and receive and send generated video segments, and manage task queues to ensure that tasks are executed in sequence or priority and allocate computing resources. The database is connected to the server for communication and is used to store information.

[0110] Further, such as Figure 5 As shown, the client includes: an AI video generation editor, a video upload module, a video editor, a splicing editor, and a message and notification center;

[0111] The AI ​​video generation editor is used to generate video segments through an AI video generation model;

[0112] The video upload module is used for users to upload videos;

[0113] The video editor is used to edit subtitles and add audio to the generated video segments;

[0114] The splicing editor is used to splice multiple video segments;

[0115] The message and notification center is used to display requests or messages from other users.

[0116] In a specific implementation, the client further includes a user interaction module and a video splicing user message bar, such as Figure 6 As shown:

[0117] The user interaction module is used to support sharing of video segments between users, initiating extended video creation requests, and browsing the creations of other users;

[0118] The video splicing user message bar is used to support multiple users to communicate during the splicing process.

[0119] In a specific implementation, the specific functions of the client are as follows:

[0120] (1) AI video generation editor

[0121] 1) Function: Specially used to generate video segments through AI video generation models, including inputting prompt words and selecting the first and last frame images.

[0122] 2) Operation:

[0123] The user enters the prompt word and selects the first frame and the last frame image.

[0124] The user clicks the "Generate Video" button, and the client calls the API interface to send the task request to the server.

[0125] The generated video segments are returned to the client and stored locally or uploaded to the server.

[0126] (2) Video Editor

[0127] 1) Function: Supports subtitle editing, audio adding, etc. of generated video segments.

[0128] 2) Operation:

[0129] Users can select generated video segments for editing.

[0130] Users can add subtitle text in the video editor, set the display time, font, color, etc.

[0131] Users can choose to upload an audio file, or record their own audio and sync it with the video.

[0132] Users can preview the edited video and make sure they are satisfied before saving or uploading.

[0133] (3) User Interaction Module

[0134] 1) Function: Supports sharing of video segments between users, initiating extended video creation requests, browsing other users' creations, etc.

[0135] 2) Operation:

[0136] Users can choose to send the generated video segment to other users or share it in the display interface.

[0137] Users can initiate an extended video creation request and invite other users to continue creating.

[0138] Users can browse other users' creations and decide whether to participate in further creation.

[0139] (4) Splicing Editor

[0140] 1) Function: Supports the splicing of multiple video segments, including the merging of subtitles and audio.

[0141] 2) Operation:

[0142] Users can select multiple video segments to stitch.

[0143] Users can adjust the order of video segments, add transition effects, etc. in the stitching editor.

[0144] Users can edit the subtitles and audio of each video segment during the stitching process to ensure that the stitched video has complete subtitles and audio.

[0145] Users can preview the spliced ​​video and make sure they are satisfied before saving or uploading it.

[0146] (5) Message and Notification Center

[0147] 1) Function: Display requests or messages from other users.

[0148] 2) Operation: Users can view and manage requests or messages from other users through the Notification Center.

[0149] (6) Video stitching user message bar

[0150] 1) Function: Allow multiple users to communicate during the stitching process and discuss whether the stitched video needs further modification.

[0151] 2) Operation: Users can express their opinions and suggestions in the message bar, and further edit or splice after reaching a consensus.

[0152] In a specific embodiment, Figure 7 As shown, the video editor also includes a speech generation model, which processes the audio files uploaded by the customer or the audio recorded by the customer, and outputs effects such as voice change and noise reduction.

[0153] In a specific implementation, the splicing editor supports splicing of multiple video segments, including merging of subtitles and audio, including:

[0154] If the audio is pure music, the multiple video segments are spliced ​​together normally;

[0155] If the audio is speech and the audio length of the single video segment is less than the video segment length, normal splicing processing is performed; if the audio is speech that spans the length of the video segment, subtitle generation is performed after the video segments are spliced.

[0156] In a specific implementation, the video editor also supports editing, applying special effects, etc. to the generated video segments.

[0157] In a specific implementation, the connection relationship between the client and the server includes:

[0158] API interface: The client communicates with the server through RESTful API or GraphQL to upload and download videos, send task requests, receive results, etc.

[0159] Real-time communication: Use WebSocket or other real-time protocols to support instant messaging and state synchronization, especially in user interaction modules and splicing editors.

[0160] Furthermore, the server includes a user management module, a video storage module, a task scheduling module, an API interface module, a message notification service module and a video splicing engine module;

[0161] The user management module is used to store basic information of users and perform authority management;

[0162] The video storage module is used for storing video data and metadata management;

[0163] The task scheduling module is used for task queue management and resource allocation;

[0164] The API interface module is used to upload / download videos, transmit AI service requests, receive splicing requests, and return results;

[0165] The message notification service module is used to push messages or notifications and provide notification reminders;

[0166] The video splicing engine module is used for frame alignment, color correction, audio synchronization, transition effects, subtitle merging, audio merging and encoding optimization.

[0167] In a specific implementation, the specific functions of the server include:

[0168] (1) User Management Module

[0169] 1) User database: stores basic user information, such as user nickname, avatar, mobile phone number, etc.

[0170] 2) Permission control: manage different users’ access rights to resources.

[0171] (2) Video storage module

[0172] 1) Distributed file system: Efficiently stores large amounts of video data and supports fast reading and writing.

[0173] 2) Metadata management: record relevant information of the video, such as user ID, generation time, tags, subtitle information, audio path, etc.

[0174] (3) Task Scheduling Module

[0175] 1) Task queue: manages task requests from clients and executes them according to priority or sequence.

[0176] 2) Resource allocation: Rationally allocate computing resources according to task requirements to ensure efficient processing.

[0177] (4) API interface module

[0178] 1) Video upload / download: Provides secure file transfer services.

[0179] 2) AI service request: forward the AI ​​generation task to the AI ​​video generation model and receive the result.

[0180] 3) Receiving a splicing request: receiving a splicing request and processing metadata of the video segment.

[0181] 4) Result return: After completing the task, the result is returned to the client.

[0182] (5) Message Notification Service Module

[0183] 1) Push messages or notifications: When there are new video segments or splicing requests, notifications or messages are sent to relevant users.

[0184] 2) Notification reminder: used for important notifications or reminders.

[0185] (6) Video stitching engine module

[0186] 1) Frame alignment: Ensure that the first and last frames of two video clips are visually seamless.

[0187] 2) Color correction: Eliminate possible color differences between different video clips.

[0188] 3) Audio Sync: Ensure the audio timeline between video clips is aligned.

[0189] 4) Transition effects: Make switching between video clips more natural by adding smooth transition effects.

[0190] 5) Subtitle merging: Merge the subtitle texts of multiple video segments to ensure that the spliced ​​video has complete subtitles.

[0191] 6) Audio merging: Merge the audio of multiple video segments to ensure that the spliced ​​video has complete audio.

[0192] 7) Coding optimization: Select the appropriate codec, adjust the bit rate, resolution, frame rate and other parameters to ensure smooth playback and high quality of the spliced ​​video.

[0193] In a specific implementation, the connection relationship between the server and the AI ​​video generation model includes:

[0194] API interface: The server communicates with the AI ​​video generation model through the API interface, sends task requests and receives generated video segments.

[0195] Task scheduling: The server is responsible for managing the task queue, ensuring that tasks are executed in order or priority, and allocating computing resources reasonably.

[0196] In a specific implementation, the specific functions of the AI ​​video generation model include:

[0197] API

[0198] (1) Task reception: Receive task requests from the server, including prompt words, first frame, last frame, motion brush, camera movement, video ratio, number of generated images, and other information.

[0199] (2) Result return: After the video generation is completed, the generated video segment is returned to the server.

[0200] In a specific implementation, the connection relationship between the AI ​​video generation model and the server includes:

[0201] (1) API interface: The AI ​​video generation model communicates with the server through the API interface, receives task requests and returns the generated video segments.

[0202] (2) Task scheduling: The server is responsible for managing the task queue, ensuring that tasks are executed in order or priority, and allocating computing resources reasonably.

[0203] In a specific implementation, the specific functions of the database include a user table, a video segment table and a splicing table as shown in Table 1, Table 2 and Table 3:

[0204] Table 1 Users Table

[0205] Field Name type describe user_id UUID User unique identifier username VARCHAR(50) Username(Nickname) phone_number VARCHAR(20) phone number created_at TIMESTAMP User registration time

[0206] Table 2 Video Segments Table

[0207] Field Name type describe segment_id UUID Unique video segment identifier user_id UUID The user ID that generated this video segment video_path VARCHAR(255) The storage path of the video file first_frame_path VARCHAR(255) The storage path or hash value of the first frame image last_frame_path VARCHAR(255) The storage path or hash value of the last frame image tags TEXT Video segment tags (JSON format) subtitle_info JSON Subtitle information (display time, font, color, etc.) audio_path VARCHAR(255) The storage path of the audio file created_at TIMESTAMP Video segment generation time updated_at TIMESTAMP The time when the video segment was last updated

[0208] Table 3 Concatenations Table

[0209]

[0210]

[0211] Further, such as Figure 4 As shown, it also includes an AI video generation model, the AI ​​video generation model is connected to the server in communication, and the AI ​​video generation model includes an API interface, the API interface is used to receive task request information from the server, and after completing video generation, the generated video segment is returned to the server. Specifically, the AI ​​video generation model includes a transit method such as an API interface, receives task request information from the server through the transit method such as the API interface, and after completing video generation, returns the generated video segment to the server; or the AI ​​video generation model is directly deployed on the server side, accepts task request information from the client, and generates video.

[0212] Furthermore, the database includes a user table, a video segment table and a splicing table, the user table is used to store user information, the video segment table is used to store video information, and the splicing table is used to store splicing information.

[0213] In a specific embodiment, a specific process of a video expansion processing method is as follows: Figure 2 As shown, including:

[0214] At least two users, the video creator and the first participating user, complete the following steps together:

[0215] The user who initiates the video creation generates a first video segment through an AI video model, labels the first video segment, and maps it with the identity ID of the user who initiates the video creation;

[0216] The video creation initiating user initiates an extended video creation request for the first video segment;

[0217] In response to the extended video creation request, the first video segment is displayed as extended video creation content on a display interface for viewing by a first participating user, or is sent to the first participating user by the video creation initiating user, or is sent to the first participating user by the video creation initiating user after the extended video creation content is displayed on the display interface;

[0218] The first participating user obtains the creative content of the first video segment, and generates a second video segment to be spliced ​​with the first video segment through an AI video model according to the creative content;

[0219] Labeling the second video segment of the first participating user and mapping it with the first participating user identity ID;

[0220] The first participating user initiates a request to splice the first video segment and the second video segment;

[0221] In response to the splicing request, the first video segment and the second video segment are spliced ​​to obtain a spliced ​​first spliced ​​video segment. Specifically, if there is a second participating user, the second participating user and the first participating user complete the above steps together to obtain a spliced ​​second spliced ​​video segment.

[0222] Furthermore, the first participating user generates a second video segment to be spliced ​​with the first video segment through an AI video model based on the creative content of the first video segment, further comprising:

[0223] The creative content of the first video segment includes the last frame image of the first video segment. The first participating user inputs the last frame image in the creative content of the first video segment as the first frame image of the second video segment to the AI ​​video model to generate the second video segment to be spliced ​​with the first video segment.

[0224] Furthermore, the first participating user generates a second video segment to be spliced ​​with the first video segment through an AI video model based on the creative content of the first video segment, further comprising:

[0225] The creative content of the first video segment includes the last frame image of the first video segment. The first participating user uses the last frame image in the creative content of the first video segment as the first frame image of the second video segment, and uploads an image as the last frame image, which is input into the AI ​​video model to generate the second video segment to be spliced ​​with the first video segment.

[0226] In another specific embodiment, a video expansion processing method includes the following specific steps:

[0227] S1: Video creation initiated by the user generating the first video segment

[0228] (1) Enter the prompt word and select the first and last frames:

[0229] The user who initiates video creation enters prompt words (such as text describing the video content) in the AI ​​video generation editor and selects the first and last frame images.

[0230] When the user clicks the "Generate Video" button, the client sends the prompt words, first frame and last frame images to the server through the API interface.

[0231] (2) AI video generation:

[0232] The server receives task requests from the client and forwards them to the AI ​​video generation model.

[0233] The AI ​​video generation model generates a first video segment without any subtitles or audio based on the prompt words and the first and last frame images.

[0234] The generated first video segment is returned to the server, which stores it in the distributed file system and generates related metadata (such as user ID, generation time, tags, etc.).

[0235] (3) Subtitle and audio editing:

[0236] The user who initiates the video creation can choose to enter the video editor immediately after generating the first video segment, or upload a video as the first video segment and edit subtitles and add audio to the first video segment.

[0237] Users can add subtitle text in the video editor, set the display time, font, color, etc.; they can also upload or record audio and synchronize it with the video.

[0238] The edited video segments can be saved or uploaded to the server, and the metadata (such as subtitle information, audio path, etc.) can be updated.

[0239] (4) Initiate an extended video creation request:

[0240] The video creation initiator initiates an extended video creation request in the user interaction module and chooses to send the first video segment to the first participating user or share it in the display interface.

[0241] The user can choose to share it with the first participating user directly in the display interface, or send it to a specific first participating user through the user interaction module.

[0242] S2: The first participating user generates the second video segment

[0243] (1) Get the first video segment:

[0244] After receiving the first video segment, the first participating user views it through the UI and decides whether to continue creating.

[0245] If the first participating user decides to continue the creation, the last frame of the first video segment is selected as the first frame of the second video segment in the AI ​​video generation editor, or a new picture is selected as the first frame picture according to the creation content of the first video segment, and a new image is selected as the last frame of the second video segment, or the last frame image is not selected and only the first frame image is used as a reference image; or, only a prompt word is input according to the creation content of the first video segment without selecting any picture as a reference image or as the first and last frames;

[0246] (2) Input the prompt word and generate the second video segment:

[0247] The first participating user enters a prompt word, describes the style and scene of the video they want to generate, and selects the length of the generated video.

[0248] When the user clicks the "Generate Video" button, the client sends the prompt words, first frame and last frame images to the server through the API interface.

[0249] The server receives the task request and forwards it to the AI ​​video generation model to generate the second video segment without any subtitles and audio.

[0250] The generated second video segment is returned to the server, which stores it in the distributed file system and generates related metadata (such as user ID, generation time, tags, etc.).

[0251] (3) Subtitle and audio editing:

[0252] The first participating user can choose to enter the video editor immediately after generating the second video segment, or upload the video as the second video segment and edit subtitles and add audio to the second video segment.

[0253] Users can add subtitle text in the video editor, set the display time, font, color, etc.; they can also upload or record audio and synchronize it with the video.

[0254] The edited video segments can be saved or uploaded to the server, and the metadata (such as subtitle information, audio path, etc.) can be updated.

[0255] S3: Video segment stitching processing

[0256] (1) Initiate a splicing request:

[0257] The first participating user initiates a request for splicing the first video segment and the second video segment in the user interaction module.

[0258] Users can select multiple video segments to stitch together and enter the stitching editor to perform the stitching process.

[0259] (2) Splicing processing:

[0260] In the stitching editor, users can select multiple video segments for stitching, adjust the order of video segments, add transition effects, etc.

[0261] Users can edit the subtitles and audio of each video segment during the stitching process to ensure that the stitched video has complete subtitles and audio.

[0262] Users can preview the spliced ​​video and make sure they are satisfied before saving or uploading it.

[0263] (3) Communication between users after splicing:

[0264] Users can communicate with each other in the multiple video stitching user message bar in the stitching editor to discuss whether the stitched video needs further modification.

[0265] Users can edit the subtitles and audio of the video segments again, or re-splice them based on the discussion results.

[0266] (4) Opening and ending information editing:

[0267] Adding header information before the first video segment;

[0268] If more than two users complete the steps together, add an ending message to the end video segment;

[0269] If the second video segment obtained by splicing with the first video segment is an ending video segment, then ending information is added after the second video segment.

[0270] (5) Notify users:

[0271] The server returns the spliced ​​video file path and new metadata to the client through the API interface.

[0272] The client notifies the user that the task is completed and provides a download link or displays the stitched video directly in the app.

[0273] The present invention realizes user-initiated AI video creation based on the AI ​​video generation model, and invites other users to participate in the same video creation by splicing video segments, thereby extending the length of the video and the content of the video, lowering the video creation threshold and creation cost for each user, reducing the creation time, enhancing collaboration and interaction between users, improving the social experience, and enhancing the dissemination speed and amount of video content.

[0274] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0275] The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A video expansion processing method, characterized in that: include: The video creation initiator and at least one participating user complete the following steps together: The user initiates the video creation to obtain a first video segment, and pre-processes the first video segment; The video creation initiating user initiates an extended video creation request for the first video segment; The first participating user obtains the creation content of the first video segment according to the extended video creation request of the first video segment, obtains the second video segment to be spliced ​​with the first video segment, and pre-processes the second video segment; The first participating user initiates a request to splice the first video segment with the second video segment; In response to the splicing request, the first video segment and the second video segment are spliced ​​to obtain a spliced ​​first spliced ​​video segment.

2. A video expansion processing method according to claim 1, characterized in that: The obtaining of the first video segment by the user initiating video creation includes: generating the first video segment by an AI video generation model, or uploading the first video segment by the user initiating video creation, and the obtaining of the second video segment spliced ​​with the first video segment includes: generating the second video segment by an AI video generation model, or uploading the second video segment by the first participating user.

3. A video expansion processing method according to claim 1 or 2, characterized in that: Also includes: Adding header information before the first video segment; If more than two users complete the steps together, add an ending message to the end video segment; If the second video segment obtained by splicing with the first video segment is an ending video segment, then ending information is added after the second video segment.

4. The video expansion processing method according to claim 1, characterized in that: The preprocessing of the first video segment includes: labeling the first video segment and mapping it with the identity ID of the user who initiated the video creation; the preprocessing of the second video segment includes: labeling the second video segment and mapping it with the identity ID of the first participating user.

5. A video expansion processing method according to claim 1, characterized in that: The first participating user obtaining the creation content of the first video segment according to the extended video creation request of the first video segment includes: In response to a request for creating an extended video of the first video segment, displaying the first video segment as extended video creation content on a display interface for viewing by at least one participating user; or sent by the video creation initiator to the first participating user; Or after the extended video creation content is displayed on the display interface, it is sent by the video creation initiator to the first participating user.

6. A video expansion processing method according to claim 2, characterized in that: The second video segment obtained to be spliced ​​with the first video segment includes: the creative content of the first video segment includes the last frame image of the first video segment, and the first participating user inputs the last frame image in the creative content of the first video segment as the first frame image of the second video segment to the AI ​​video generation model to generate the second video segment to be spliced ​​with the first video segment.

7. A video expansion processing method according to claim 1, characterized in that: The step of initiating a user to obtain a first video segment through video creation includes: The user who initiates the video creation enters the prompt word and selects the first and last frame images, which are then sent to the AI ​​video generation model. In response to the sending, a first video segment without any subtitles and audio is obtained according to the prompt words and the first and last frame images; The video creation initiating user initiates an extended video creation request and chooses to send the first video segment to the first participating user, or share it in the display interface.

8. A video expansion processing method according to claim 7, characterized in that: It also includes that, in response to the sending, after a first video segment without any subtitles and audio is obtained according to the prompt words and the first and last frame pictures, the video creation initiator user edits subtitles and adds audio to the first video segment.

9. The video expansion processing method according to claim 1, characterized in that: The first participating user obtains the creation content of the first video segment according to the extended video creation request of the first video segment, and obtains the second video segment to be spliced ​​with the first video segment, including: After receiving the first video segment, the first participating user decides whether to perform splicing creation; If the first participating user decides to perform splicing creation, the last frame of the first video segment is selected as the first frame of the second video segment, or, according to the creation content of the first video segment, a new picture is selected as the first frame picture, and a new image is selected as the last frame of the second video segment, or the last frame image is not selected and only the first frame picture is used as a reference picture; or, only a prompt word is input according to the creation content of the first video segment without selecting any picture as a reference picture or as the first and last frames; The first participating user enters a prompt word and selects the duration of the generated video; Sending to the AI ​​video generation model, and in response to the sending, generating a second video segment without any subtitles and audio; Save the video segment to the server.

10. The video expansion processing method according to claim 1, characterized in that: It also includes sending it to the AI ​​video generation model, and after generating a second video segment without any subtitles and audio in response to the sending, the first participating user edits subtitles and adds audio to the second video segment.

11. A video expansion processing method according to claim 1, characterized in that: The splicing process of the first video segment and the second video segment includes: A first participating user initiates a request to splice the first video segment and the second video segment; Users select multiple video segments to stitch together, adjust the order of the segments, and add transition effects; During the splicing process, users edit the subtitles and audio of each video segment to ensure that the spliced ​​video has complete subtitles and audio according to the creative content; Multiple users communicate and discuss whether the spliced ​​video needs further modification; Based on the discussion results, the user edits the subtitles and audio of the video segment again, or re-splices it; Users preview the spliced ​​video and save or upload it only after ensuring they are satisfied.

12. A video expansion processing system, characterized in that: include: Clients, servers, and databases; The client is connected in communication with the server to edit input video creation content, upload and download videos, send task requests, receive results, and use real-time protocols to support instant messaging and status synchronization; the server is used to receive and process task requests and receive and send generated video segments, and manage task queues to ensure that tasks are executed in order or priority and allocate computing resources. The database is connected in communication with the server to store information.

13. A video expansion processing system according to claim 12, characterized in that: The client includes: an AI video generation editor, a video upload module, a video editor, a splicing editor, and a message and notification center; The AI ​​video generation editor is used to generate video segments through an AI video generation model; The video upload module is used for users to upload videos; The video editor is used to edit subtitles and add audio to the generated video segments; The splicing editor is used to splice multiple video segments; The message and notification center is used to display requests or messages from other users.

14. A video expansion processing system according to claim 12, characterized in that: The server includes a user management module, a video storage module, a task scheduling module, an API interface module, a message notification service module and a video splicing engine module; The user management module is used to store basic information of users and perform authority management; The video storage module is used for storing video data and metadata management; The task scheduling module is used for task queue management and resource allocation; The API interface module is used to upload / download videos, transmit AI service requests, receive splicing requests, and return results; The message notification service module is used to push messages or notifications and provide notification reminders; The video splicing engine module is used for frame alignment, color correction, audio synchronization, transition effects, subtitle merging, and audio merging.

15. A video expansion processing system according to claim 12, characterized in that: It also includes an AI video generation model, which is communicatively connected to the server. The AI ​​video generation model includes an API interface, which is used to receive task request information from the server and return the generated video segment to the server after completing the video generation.

16. A video expansion processing system according to claim 12, characterized in that: The database includes a user table, a video segment table and a splicing table, wherein the user table is used to store user information, the video segment table is used to store video information, and the splicing table is used to store splicing information.

Images