522 results about "Film editing" patented technology

The invention relates to a high-quality video content automatic generation method and related equipment, and the method comprises the following steps: carrying out the multi-modal feature extraction of an input original video material, and obtaining a video feature vector set; performing content semantic analysis on the video feature vector set to obtain a video semantic map; performing narrative structure optimization on the video semantic map through a deep reinforcement learning technology to obtain an optimized video story line; performing multi-modal content generation based on the optimized video story line to obtain a candidate video clip set; and performing intelligent editing and synthesis on the candidate video clip set to obtain target high-quality video content, thereby solving the technical problem that the generated content is lack of depth and attraction due to the fact that many automatic attempts are limited to simple image or clip splicing and potential story clues in video materials cannot be deeply mined.

The invention relates to an AI intelligent short video generation method and system based on multi-agent collaboration. The method comprises the following steps: S1, input analysis and sub-shot script generation; s2, obtaining materials; s3, sub-shot video generation; step S4: editing and synthesizing; wherein the plurality of sub-shot video clips are edited and synthesized into a complete video according to a script sequence, and style fusion processing is performed on the whole video by using a picture style unification algorithm; step S5, background music matching; and S6, outputting the slices. Through the structured sub-shot script generation, intelligent material completion, multi-shot style fusion and music synchronization technology, a professional short video of multi-scene coherent narrative can be generated, the structured sub-shot script is automatically generated, and intelligent material completion, picture style unification and music rhythm and emotion expression synchronization are realized.

The invention discloses a video editing method and related equipment, and the method comprises the steps: receiving an editing intention of a user, carrying out the semantic analysis of an intention analysis model, and generating an editing copywriting, a style and a structured instruction; the edited copywriting is split according to the edited copywriting; performing cross-modal analysis on video materials by using a video understanding model trained based on an open-source multi-modal model, and accurately positioning sub-lens segments; secondly, editing the sub-lens segments through an editing model to generate a preliminary sheet, performing quantitative scoring through a video scoring model, and obtaining a scoring result according to a multi-dimensional index; and finally, the result is fed back to the editing model, and iterative adjustment is carried out until a final slice is produced. According to the method, the editing efficiency is improved, the manual operation time is shortened, the material adaptability is enhanced, the personalized requirement is met, the editing effect consistency is improved, the video content understanding is deepened, the editing effect is optimized, the technical threshold is reduced, the existing technical problems are solved comprehensively, and an efficient, intelligent and personalized editing scheme is provided.

The invention discloses a short video intelligent editing method and system based on multi-modal analysis, and relates to the technical field of video editing. The method is used for improving editing efficiency and visual experience and comprises the following steps: extracting lip motion features of a character, visual saliency features of a commodity and a voice emotion intensity value from a target short video stream to form multi-modal time sequence data; afterwards, the voice stream is recorded, a product keyword timestamp is extracted, the alignment degree is calculated through dynamic time warping in combination with a visual saliency peak value, and a preliminary editing point set is generated through weighted evaluation in combination with an emotional intensity value; constructing an editing decision optimization model based on deep reinforcement learning, taking the multi-modal features as state input, adjusting the retention probability of editing points through a joint reward function, and selecting an optimal transition mode; and the lip movement and voice synchronization error before and after the editing point and the emotional and visual continuity of the transition section are analyzed, the discontinuous region is smoothed, and the edited finished product is output, so that precise short video intelligent editing is realized.

The invention relates to an automatic video editing method based on semantic analysis, and belongs to the technical field of video editing. The method comprises the following steps: extracting anchor point information of text content in a streaming media file based on a knowledge graph, establishing a support relationship, and determining a main anchor point, a sub anchor point and a argument anchor point by combining the support relationship and the anchor point information; constructing a dynamic trigger mechanism, setting a verification direction of the dynamic trigger mechanism, determining a semantic extension direction of the anchor point information according to the verification direction, and verifying whether a precondition chain supporting the anchor point information exists or not; and setting a credibility scoring strategy, determining the credibility of the anchor point information according to the logic complexity, the language confidence and the text consistency, forming a sequence set of the anchor point information, and splicing to form a logically coherent video editing text result. According to the method, automatic and intelligent editing of the video is realized based on semantic analysis, and the editing efficiency and quality are remarkably improved.

The invention discloses a short video editing synthesis method based on fuzzy logic. The method comprises the following steps: S1, carrying out digital video preprocessing on an input original short video; s2, forming a short video feature data set; s3, generating a fuzzy logic decision result; s4, performing multi-target and multi-parameter optimization on the fuzzy logic decision result by adopting a random score programming method to form an optimized editing parameter set; s5, generating a preliminarily synthesized short video; s6, generating a video quality evaluation result; and S7, carrying out iterative optimization on the preliminarily synthesized short video according to a video quality evaluation result, adjusting the editing parameters and re-executing the editing synthesis step until the video quality evaluation result meets a preset standard, and generating a final edited finished product. According to the method, the editing scheme can achieve the best balance in the aspects of visual rhythm, information integrity and emotion expression consistency.

The invention provides an intelligent self-adaptive video editing method and system based on deep learning, and relates to the technical field of video processing.The method comprises the steps that firstly, a semantic mapping relation between a to-be-edited video material and a preset editing requirement is established, and an editing requirement mapping result is generated, the preset editing demand comprises a content style and a rhythm control demand, and then semantic feature association processing is carried out based on the mapping result to obtain a semantic association feature set comprising lens unit content semantic features and rhythm association features; then calling a pre-trained editing decision model (including a semantic matching module and a rhythm adjusting module) to carry out editing strategy matching on the set, generating a preliminary editing strategy set, generating an initial video editing scheme according to the preliminary editing strategy set, carrying out parameter adjustment on the initial scheme according to a strategy optimization suggestion output by the model, and carrying out video editing on the initial scheme; and a final video editing scheme is obtained, and intelligent self-adaptive editing of the video is realized.

The embodiment of the invention provides a method and a device for generating a video based on a text, the method is applied to a server, and the method comprises the following steps: acquiring a plot description text uploaded by a client; splitting the plot description text to obtain a plurality of split texts, and determining a split prompt word corresponding to each split text; extracting at least one key content label and a feature text corresponding to each key content label from the plot description text, and determining a label prompt word corresponding to each feature text; and according to the split cue word and the label cue word, carrying out text generation processing to obtain a plurality of split illustrations, and according to the plurality of split illustrations, carrying out editing to generate a target video. According to the technical scheme, the process from splitting the plot description text and extracting the label to generating the illustration can be automatically completed, a user does not need to manually edit and process, the efficiency of converting the copywriting into the video is improved, and the user requirement of producing a large number of videos can be met.

The invention relates to the technical field of director and picture synthesis methods, in particular to an intelligent director and picture synthesis method of a panoramic live broadcast system, which comprises the following steps: acquiring panoramic video data shot by a panoramic camera; obtaining user feedback data; based on the panoramic video data, generating a shot selection strategy by using a deep reinforcement learning algorithm; detecting a live broadcast key event in real time by using a target detection and tracking algorithm based on the panoramic video data; generating a picture shooting plan sequence according to the shot selection strategy and the live broadcast key event; performing intelligent editing and synthesis on the panoramic video data based on the picture shooting plan sequence; and outputting the synthesized live video. And updating parameters of the deep reinforcement learning algorithm based on the user feedback data, thereby realizing full automation of the program directing process, greatly improving the efficiency, and enabling the system to continuously learn from live broadcast experience through the deep reinforcement learning algorithm and gradually improve the decision-making ability of the system.

The embodiment of the invention provides a video generation method and device and a storage medium, and the method comprises the steps: obtaining a video script, and obtaining a text feature of the video script; acquiring a video feature of each video material in the plurality of video materials; obtaining a similarity matrix between the text features and the video features; matching the video material with the video script based on the similarity matrix to obtain a video material sequence; and generating a target video file according to the video material sequence. According to the embodiment of the invention, through matching between the video script and the video material, retrieval and sorting of the video material are realized, so that video packaging is carried out based on the video material sequence, and automatic editing and production of the video are better realized.

The invention relates to the technical field of editing and special effect generation, in particular to a digital media content intelligent editing and special effect generation system based on artificial intelligence. Comprising a content understanding analysis module, an editing decision module, a special effect generation preview module, an audio processing module, a dynamic transition special effect module, a subtitle generation editing module, a virtual interaction module and a content distribution optimization module. The content understanding analysis module is used for video content identification and sentiment analysis; and the editing decision module is used for recommending an editing point and providing a dynamic editing strategy. The video content can be automatically analyzed, the editing point and the special effect adding position can be identified, the editing and special effect generation efficiency is greatly improved, the editing strategy and the special effect type can be dynamically adjusted according to the video content and the sentiment analysis result, the editing and the special effect can better meet the user requirement and the video content, and the user experience is improved. Abundant editing and special effect options are provided, and the editing and special effect generation process is simplified.

The invention relates to an intelligent video editing method fusing human face features and human voice features, which comprises the steps of input preprocessing, multi-modal analysis, fusion scoring and automatic editing, and adopts a multi-modal mode for analysis, so that the recall rate of key segments is improved, and the efficiency of editing is improved. A personalized editing strategy is supported, facial expression changes and voice emotion peak values are aligned through dynamic time warping, a CLIP-like structure is used for training a bimodal encoder, the human face and the voice are mapped to a unified vector space, the association weight of the human face and the voice is automatically learned, and the intelligent degree of editing is improved.

The invention discloses a video editing method and device, electronic equipment and a nonvolatile storage medium. The method comprises the following steps: acquiring an audio data stream of a target video, and segmenting the audio data stream into a plurality of audio clips; determining a classification result corresponding to the audio clip, and determining a time period corresponding to the audio clip as a candidate ball hitting time period when the classification result is that the audio clip contains the ball hitting sound; acquiring a video frame corresponding to the candidate ball hitting time period in the target video, and judging that the candidate ball hitting time period is a real ball hitting time period under the condition that the visual feature of the video frame is matched with a preset ball hitting rule; and determining an editing time point according to the real ball hitting time period, and editing the target video according to the editing time point to obtain a ball hitting round video clip. The technical problem that the accuracy of ball hitting detection segment detection is low due to the fact that ball hitting detection is conducted only through sound and is easily interfered by environmental noise in the prior art is solved.

The invention relates to the technical field of artificial intelligence content generation, and provides a video generation method and device based on multi-agent cooperation. The method comprises the following steps: selecting a proper copywriting processing agent according to text information input by a user, so as to use the copywriting processing agent to expand or condense a plurality of sub-mirror descriptions; selecting a proper image generation agent; inputting the picture description, the picture style and the mirror operation method in the mirror splitting description into the selected image generation agent to generate a mirror splitting picture; selecting a proper video generation agent; inputting the split picture and the character action and the mirror moving method in the corresponding split description into a selected video generation agent to generate a split video; and selecting a proper automatic editing agent, and performing post-production on the split video to generate a finished video. The technical problems that in the prior art, the video generation process is fragmented, and multi-element collaboration is difficult are solved, and automatic production of complex video content is achieved.

The invention discloses a multi-mode-based short episode video editing method, system and device and a medium, and the method comprises the steps: carrying out the preprocessing of an original short episode video, and obtaining a second short episode video, subtitles and a subtitle timestamp; analyzing the subtitles, and generating a short episode abstract according to an analysis result of the subtitles; according to the short episode abstract and the highlight editing prompt, performing plot analysis and editing on the second short episode video, and performing editing to form a first video set; scoring videos in the first video set according to a multi-dimensional scoring rule, and screening out M highlight video clips before scoring; and adjusting the timestamps of the M highlight video clips according to the subtitle timestamps, and outputting the adjusted M highlight video clips. According to the method and the device, the full link from short video input to short play mixed video output is constructed, a user only needs to input the to-be-edited short play video, the mixed video can be automatically generated, and the video editing efficiency is improved while the video editing threshold is reduced.

The invention discloses a video editing method and device, electronic equipment and a storage medium. The method comprises the following steps: segmenting a to-be-edited video to obtain a plurality of video clips; understanding text generation and subtitle generation are carried out on each video clip, and a clip understanding text and a clip subtitle of each video clip are obtained; determining a target description text based on fragment understanding texts and / or fragment subtitles corresponding to a plurality of target video fragments selected from the plurality of video fragments; and performing video synthesis based on the plurality of target video clips and the target description text to obtain a target video corresponding to the to-be-edited video. According to the method provided by the invention, the video editing efficiency is relatively high, and the video editing cost is relatively low.

The invention discloses a multi-agent collaborative short play digital production system, which belongs to the technical field of artificial intelligence, and comprises a data and state management module driven by a digital thread, which uniformly manages and synchronizes data, states and decisions of all production links through a throughout digital thread; the full-process intelligent production module takes an intelligent control center as a core, decomposes and dispatches a complex task to five professional intelligent agents for cooperative execution, and covers a complete production link from script generation, visual preview, video shooting and special effects to intelligent editing and final sound and picture synthesis; the man-machine collaborative evaluation and feedback closed-loop module provides an interactive interface for human experts to supervise, guide and correct key production nodes and records artificial decisions as feedback to form a closed loop of a continuous optimization system; according to the multi-agent collaborative short play digital production system provided by the invention, the digital thread penetrates through multi-agent collaboration, so that data tracing and state synchronization of the whole process of short play production can be realized, challenges such as narrative continuity, cross-modal consistency and physical authenticity are effectively solved, and the quality of generated content and the production efficiency are remarkably improved.

The invention discloses an intelligent editing style learning and shot arrangement method and device, and the method comprises the steps: firstly carrying out the shot segmentation of an original material video, obtaining a plurality of independent video clips, carrying out the multi-dimensional analysis of each video clip, generating a structured label text containing image semantic features and shooting grammar features, and carrying out the segmentation of the shot; semantic segmentation is carried out on a manuscript to be edited to obtain a plurality of text paragraphs, each text paragraph is matched with at least one edition example, finally prompt words are constructed and input into the generative language model to carry out shot arrangement, and the generative language model outputs a shot arrangement sequence of the current paragraph. The problem of error accumulation caused by the fact that a traditional intelligent editing method depends on an editing script intermediate link is solved, the defect that in the prior art, it is difficult to dynamically learn a specific editing style is overcome, collaborative optimization of semantic matching and editing grammar is achieved, and shot selection accuracy, arrangement fluency and style adaptability are remarkably improved.

The invention provides a video processing method and device, equipment and a storage medium, and the method comprises the steps: segmenting a video material into a plurality of semantically coherent video clips, automatically extracting related video clips from the video material according to the text content provided by a user, and generating corresponding subtitles and voice broadcast ports matched with the related video clips, and finally synthesizing a section of finished video with clear logic and coherent content. According to the scheme, full-process automation from video material generation to final video file generation is realized, a large number of video materials can be quickly processed, the tedious manual editing process in traditional video production is reduced, the dependence on manual intervention is greatly reduced, the operation cost is reduced, the video production process is simplified, the video production efficiency is improved, and the user experience is improved. And the quality and the efficiency of finished products are also improved.

Embodiments of the present disclosure provide a video generation method and device, and a storage medium. The method comprises: acquiring a video script, and acquiring text features of the video script; acquiring video features of each video material among a plurality of video materials; acquiring a similarity matrix between the text features and the video features; matching the video material with the video script on the basis of the similarity matrix to obtain a video material sequence; and generating a target video file on the basis of the video material sequence. In the embodiments of the present disclosure, retrieval and sorting of the video materials are implemented by means of the matching between the video script and the video materials, and then video packaging is carried out on the basis of the video material sequence, thereby better achieving automated editing and production of videos.

The invention relates to an editing processing method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: displaying a video editing interface, the video editing interface comprises a material region and a timeline region, and when a material package option displayed in the material region is in a selected state, the timeline region is a timeline region; at least one material package identifier is also displayed in the material area, each material package identifier is used for indicating one material package resource, and each material package resource is a material package in a composite fragment form generated by a plurality of materials; in response to a target triggering operation on a target material package identifier in the plurality of material package identifiers, converting a target material package resource indicated by the target material package identifier into a target material package combination, and displaying the target material package combination in a timeline area; wherein the target material package combination is a combination of a plurality of target materials corresponding to the target material package identifier.

The invention discloses an AI automatic editing method and related equipment, and the method comprises the steps: obtaining a video prototype template selected by a user, prompt information inputted by the user, and original materials uploaded by the user through a user interaction interface, and calling a language large model to generate a structured video script; performing association degree matching on the structured script and the original material through a target detection model, and screening the original material according to a matching result and a quality scoring model to obtain an original video clip; performing background music matching according to the video script to obtain background music, generating voice dubbing and a flower-character chartlet according to the video script, generating video subtitles according to the voice dubbing, performing time axis alignment on each video media element, and synthesizing into a finished video. According to the embodiment of the invention, full-process automatic processing from script generation to video synthesis can be realized, and a high-quality finished video meeting user requirements can be efficiently output. The method can be widely applied to the technical field of automatic editing.

Methods and systems are described to create transitions between a set of video clips according to a style choice and to pick a next video clip in a sequence of ordered clips. In one embodiment, a device receives a plurality of video clips. In addition, the device may encode the plurality of video clips. The device further may compute a set of predicted transition embeddings using the target style and the encoded plurality of video clips. Furthermore, the device may determine a set of transitions for the plurality of video clips using the set of predicted transition embeddings in a recurrent manner.

The invention discloses an automatic video editing method and device based on text and shot similarity and a terminal, and belongs to the technical field of artificial intelligence. The method comprises the following steps: determining the end time of a mixed video based on a music interval identification result of specified music; selecting a lens of which the main body label is scenery as a lens head lens; performing similarity analysis with other lenses based on a subject recognition result, a behavior recognition result and a motion calculation result, calculating visual similarity between the lenses based on a deep learning model, recognizing repeated or redundant pictures, and selecting a high-energy lens as an in-chip high-combustion lens; retrieving and intercepting a corresponding lens as a tail lens based on a corresponding segment of the selected end word; and carrying out audio and video mixed cutting and assembling on the specified music, the head lens, the in-chip high-combustion lens and the tail lens. According to the invention, by fusing multi-modal feature analysis and intelligent editing logic generation, efficient and high-quality video automatic production is realized.

The embodiment of the invention provides a live video editing method, and the method comprises the steps: obtaining the target modal data of a to-be-edited live video, and the target modal data at least comprises audio data and image data; performing multi-dimensional analysis on the live video based on the target modal data, and determining a wonderful fragment in the live video based on an analysis result; and editing the wonderful clip, and obtaining an edited video based on an editing result. According to the technical scheme provided by the embodiment of the invention, the highlights in the live video can be automatically edited, and the efficiency and accuracy of editing the live video are improved.

The invention relates to the technical field of animation generation, in particular to an animation generation method based on AIGC. The method comprises the following steps: inputting a text corresponding to a story outline and an optimal cue word into a script generation model, and outputting a script text; respectively constructing a semantic relation graph and a spatial relation graph based on the phrase features and the object region features; calculating the similarity of the text images according to an integration result, judging whether the similarity exceeds a preset similarity threshold, and if yes, outputting a pre-generated scene image; and inputting a pre-generated scene image into the animation generation model, and outputting an initial animation video: generating a sound effect and background music of the initial animation video by adopting the optimal cue word combination, and automatically editing the generated animation to export a final animation file. According to the method, the animation creation efficiency and quality can be remarkably improved, the manufacturing cost is reduced, high customizability and expandability are achieved, and personalized customization and expansion can be carried out according to the requirements and preferences of users.

Described herein is a computer implemented method for automatically generating a trimmed video clip from a video content item. The method includes: receiving a trim request from a user device, the trim request including the video content item; determining trim parameters for the trimmed video clip, the trim parameters including a trim start time and a trim end time; generating the trimmed video clip based on the trim parameters; and causing display of the trimmed video clip on the user device.

The invention discloses a video editing processing method and system based on artificial intelligence, and the method comprises the steps: obtaining an initial video, extracting the visual semantic features of the initial video through a visual semantic model, and extracting the sound semantic features of the initial video through a sound semantic model; an indication text input by a user is obtained, a preference model of the user is obtained, and the preference model is constructed based on historical behavior data of the user; and processing the visual semantic features and the sound semantic features based on the indication text and the preference model to obtain an edited target video. In this way, the video can be efficiently and accurately edited, and it is ensured that the video editing result can meet the personalized requirements of the user.

The invention discloses an automatic video editing method and system for film list recommendation, and the method comprises the steps: obtaining film data, and carrying out the preprocessing of the film data; according to the preprocessed film data, generating a recommendation list and basic data of a film list by utilizing a preset large model and cue words; generating a copywriting corresponding to the film list data according to the recommendation list and the basic data, and selecting corresponding film resources and background music; and according to the copywriting, the film resource and the background music, performing video synthesis editing, and outputting an automatic edited video recommended by a film list. According to the method, the material combinatorial logic can be dynamically adjusted according to the sheet theme, deep mining and structured application are performed on the sheet recommendation data, and high-efficiency and large-scale sheet recommendation video generation is realized.

The invention provides a video mixing and cutting system, which comprises a material preprocessing unit used for preprocessing an original video material to generate a standardized edited material; the intelligent editing decision-making unit is used for carrying out semantic analysis and editing logic generation on the standardized editing materials so as to generate an editing decision-making instruction; the automatic editing execution unit is used for performing automatic editing processing on the standardized editing material according to the editing decision instruction so as to generate a preliminary mixed cutting video; and the effect optimization output unit is used for performing visual effect enhancement and format optimization on the preliminary mixed cutting video to generate a target mixed cutting video.