461 results about "Video production" patented technology

The invention relates to a character-driven lip sound synchronous digital human generation method and device, equipment and a medium, and the method comprises the steps: obtaining an input text and a single object video, and carrying out the preprocessing of the input text, and obtaining a phoneme sequence and semantic features; the method comprises the following steps: preprocessing a single-object video to obtain a circularly played video paragraph, a mask face image and a reference face image; generating voice features based on the phoneme sequence and the semantic features; generating an audio sequence based on the voice features; acquiring face deformation parameters according to the mask face image, the reference face image and the voice features, and deforming the reference face image to generate a target face image; and embedding the target face image into a video frame of the video paragraph to generate a video sequence, and splicing the video sequence with the audio sequence to obtain a target digital human video. The digital human video is generated based on text driving, so that the voice and lip-shaped video matched with the text can be generated in time, the time delay for waiting for text to be converted into voice processing is eliminated, and the digital human video production efficiency is greatly improved.

The invention discloses a short video production method and system based on artificial intelligence, and relates to the technical field of multimedia processing, and the method comprises the steps: inputting a split script into a multi-modal generation engine, employing a lower triangle space-time attention matrix to generate a visual stream, and generating a text stream and an audio stream; calculating a neural conduction delay amount between the visual stream and the audio stream based on an audio-visual perception delay prediction model, and generating a corrected audio stream through time axis forward compensation; calculating a cross-modal attention weight matrix according to the node association strength of the dynamic causal graph, and projecting the text stream and the corrected audio stream to a joint feature space to generate a multi-modal fusion feature; and inputting the multi-modal fusion features into a format adaptation engine, and after time-space consistency verification, embedding a neural implicit watermark and encoding the neural implicit watermark into a short video. According to the invention, the semantic consistency and coordination among the text, the audio and the visual content are improved, so that high-quality and high-intelligence automatic generation of the short video is realized on the whole.

The invention provides a relatively controllable video generation system based on an AIGC large model, and relates to the technical field of video generation, and the system comprises a user input module which is used for receiving a demand of a needed video input by a user; the language construction module is used for generating a video character script based on a large language model according to a demand input by a user; the graph generation module is used for generating a static image of a video scene according to the video character script; the image-to-video module is used for converting the static image into a dynamic video shot; and the video generation module is used for combining the plurality of dynamic video shots into a complete video. According to the relatively controllable video generation system based on the AIGC large model provided by the invention, the video is quickly generated based on the AIGC, the video production efficiency is improved, and a plurality of software platforms do not need to be switched for use.

The invention provides a video production method and device for automatically explaining static PPT by a digital human, computer equipment and a computer storage medium, and relates to the technical field of video processing. Comprising the following steps: extracting first target text information in each sub-image from a sequence image set of static PPT; converting the first target text information in each subimage into voice, and synthesizing the obtained initial audio files corresponding to each subimage to obtain a target audio file for the static PPT; wherein a preset pause duration is added between the initial audio files in the target audio file, and a corresponding relation between the audio time of each initial audio file and the display time of each sub-image is constructed; adding a PPT transition animation with a preset pause duration between the sub-images to obtain an initial PPT video for the static PPT; and based on the target audio file, controlling the virtual digital human to explain first target text information in the initial PPT video to obtain a target PPT video. According to the method, the video playing fluency can be improved.

The invention relates to the technical field of computers, in particular to a mathematical physics explanation video generation method and device based on multi-agent collaboration, and the method comprises the steps: obtaining the actual task demand information of a mathematical physics explanation video; based on the actual task demand information, controlling a scriptor agent to generate an animation frame script, so that the cartoon agent generates an animation video corresponding to the animation frame script, and generating a synchronous subtitle and an explanation audio corresponding to the animation video through an interpreter agent; and synchronously integrating the animation frame script, the animation video, the synchronous subtitles and the explanation audio to construct an initial explanation video, carrying out picture analysis on the initial explanation video through a quality inspector agent to obtain a picture analysis result, correcting the initial explanation video, and generating a final mathematical physics explanation video. Therefore, the problems that an existing teaching video making technology is poor in content accuracy and visual expression effect, high in video making cost, difficult to meet actual teaching requirements and the like are solved.

The invention discloses a multi-angle video automatic editing method based on content defect detection, and relates to the technical field of video processing. According to the method, multi-track video materials are accurately synchronized to the same time axis through cross-correlation calculation, and flaws in video content are analyzed frame by frame and classified and identified by applying fuzzy detection of a dynamic threshold and combining jitter detection and shielding detection of rotation and displacement estimation. And according to a detection result, an editing scheme is intelligently generated through a dynamic programming algorithm of state transition optimization, high-quality fragments are selected, defective parts are automatically removed, the continuity and multi-view diversity of video contents are reserved, and finally, a high-quality recorded video is generated through integration. The video editing efficiency is greatly improved, the manual intervention requirement is reduced, meanwhile, it is ensured that the quality of the output video meets the professional application requirement, and the method is suitable for multiple scenes such as conference recording, educational training and multi-angle video production and has high practical value and popularization prospects.

The invention provides an intelligent agent system and method for short video marketing customer obtaining based on a large language model.The intelligent agent system comprises an AI short video planning device, an AI short video making device and an AI short video operating device, the AI short video planning device captures topics from a public media platform and performs topic selection recommendation in combination with commercial positioning of customers, and the AI short video making device makes the selected topics according to the selected topics; the customer completes confirmation of short video topic selection; the AI short video making device generates a client IP short video according to the selected question confirmed by the client, and publishes the client IP short video on a whole-network short video media platform; the AI short video operation device captures video playing data and net friend comment content, performs data analysis and summary report on video release conditions, and replies net friend comments. Through an agent application technology driven by a large language model, three key agent devices are constructed in a client, and a new employment normal form which only provides exclusive short video production service for the client for 7 * 24 hours is started.

The invention provides a video generation method and device based on multi-agent cooperation and agents, relates to the technical field of artificial intelligence, in particular to the technical fields of deep learning, large models, agents, AIGC, element universe and the like, and is applied to application scenes such as wisdom education, video production, animation production and the like. The method comprises the following steps: executing a target sub-task in a target task by utilizing at least one target agent to obtain a target sub-execution result; and generating a target video based on the target sub-execution result, the target agent executing the following operations: obtaining sub-task demand information for the target sub-task; determining a subtask execution element for controlling the execution process of the target subtask by using a first subagent of the target agent based on the subtask demand information; and utilizing a second sub-agent of the target agent to execute the target sub-task based on the sub-task execution element to obtain a target sub-execution result.

The invention discloses a text-to-video full-link generation method and system based on a multi-modal large model, and belongs to the technical field of artificial intelligence content generation. Through cooperative work of multiple agents, analysis of a text input by a user and construction of a cross-modal memory library, unification of videos and audios for generating a sub-mirror is ensured based on memory library content, and the generation efficiency of the sub-mirror is improved. The full-process automatic generation from the text to the video is realized; the method is implemented by the following steps of: acquiring text input of a user; text analysis: dynamically extracting, analyzing, generating, associating and storing image-text-tone multi-modal information from an input text through an Agent working cooperatively, and constructing a multi-modal memory library; generating a split mirror, and generating a split mirror video and an audio according to the memory bank; and performing audio and video synthesis and audio and picture synchronous alignment to form a final video. According to the method, the narrative continuity of long video generation can be realized, the feature consistency of the split image is improved, the consistency of cross-modal emotion is enhanced, manual intervention is reduced, and the video production efficiency is improved.

A full-automatic movie and television video production system based on digital actors belongs to the field of artificial intelligence, computer graphics and movie and television production and comprises a creative engine unit, a production unit, an intelligent shooting unit, a post-processing unit and a quality inspection and rendering unit. The method has the advantages that 1, the manufacturing efficiency is greatly improved, the traditional film and television manufacturing period is usually 6-12 months, the manufacturing period can be shortened to 4 hours by the method, and the efficiency is improved by about 1000 times; 2, the manufacturing cost is obviously reduced: the manufacturing cost of traditional movies and other movies is usually 5 million to 20 million dollars, but the method only needs the computing power cost, and the cost is less than one percent of that of the traditional movies; 3, the style consistency is guaranteed, traditional film and television production depends on personal ability, the style consistency is difficult to guarantee, and the style consistency is strictly guaranteed through an algorithm and is improved by 100%.

The invention provides an interaction method and device based on agent cooperation, an agent and a storage medium, belongs to the technical field of artificial intelligence, particularly relates to the technical fields of deep learning, large models, agents, AIGC and the like, and is applied to application scenes such as wisdom education, video production, wisdom medical treatment and the like. The intelligent agent cooperation-based interaction method comprises the following steps: performing intention understanding on initial input information for a target object to obtain an initial intention understanding result; performing interaction mode demand detection on the initial intention understanding result by using a first agent to obtain an interaction mode demand attribute; an interaction element matched with the interaction mode demand attribute is called to interact with the target object, interaction information representing the demand intention of the target object is obtained, and the interaction element is used for responding to the interaction behavior; and controlling the second agent to execute the target task based on the interaction information to obtain an execution result, and pushing the execution result to the target object.

The embodiment of the invention provides a vehicle-mounted video production method and device, electronic equipment and a storage medium. The method comprises the following steps: identifying a highlight moment picture from video frames shot by cameras with different visual angles inside and outside a vehicle according to a preset period; determining a target camera according to the camera where the highlight moment picture is located, and recording a video by using the target camera to obtain a video material; fusing the video picture tag corresponding to the video material and the vehicle state tag according to a timestamp to obtain a vehicle end tag file; and performing video editing on the video material at least based on the vehicle end label file to generate a target video. Therefore, according to the scheme, automatic recording and video production of the vehicle-mounted video can be realized by identifying the highlight picture, and the generation efficiency and quality of the vehicle-mounted video are improved.

The embodiment of the invention discloses a video generation method and electronic equipment. The method comprises the following steps: creating a 3D virtual film field environment based on a 3D development engine; after a video generation demand text is received, a script is generated through mutual cooperation among multiple agents based on an artificial intelligence AI large model, the multiple agents are used for simulating multiple function posts involved in the manual video production process, and the script comprises role brief introductions in the script. A line text and role positions, actions and lens types corresponding to lines; and performing structured processing on the script, and simulating a video shooting process in the 3D virtual film field environment according to the structured script so as to generate a target video. According to the embodiment of the invention, the video generation quality and the character consistency can be improved.

The invention relates to the technical field of audio and video production, and discloses a distributed audio and video production system, which comprises a user operation interface and a media processing center, and is characterized in that the media processing center integrates audio and video data from a plurality of creation nodes, such as video recording equipment, audio acquisition equipment and the like, provides comprehensive data support for users, and improves the user experience. And real-time audio and video editing, manufacturing and publishing are realized. The core of the system is composed of a network communication layer, a service processing layer, a media access layer and a media storage layer, the network communication layer provides flexible connection services, the service processing layer adopts a distributed architecture and supports efficient data acquisition and processing, the media access layer realizes rapid data access, and the media storage layer ensures safe storage and expansion of data. By optimizing key links such as data management and control, communication connection, service processing and data storage, the audio and video production efficiency and quality are remarkably improved, and the large-scale, multi-node and high-real-time production requirements are met.

The invention discloses a method, a system and equipment for generating an oral video of a digital human, and a medium, and the method comprises the steps: obtaining oral copywriting and video material data, and analyzing and determining a timestamp of the copywriting in a video material through a multi-mode large model; converting the copywriting into audio data, preprocessing the audio data, and combining the audio data with the timestamp to generate first video data; and generating a digital human according to a user demand, and combining the digital human with the first video after image matting processing to obtain an oral playing video. According to the method, a traditional template generation mode is broken through, and customized production of the digital human broadcast video is realized through a multi-modal semantic matching and personalized digital human generation technology; and meanwhile, audio and video accurate synchronization, high-quality image matting and synthesis technologies are adopted, so that the content adaptability and the video quality are guaranteed, and the flexibility, the efficiency and the effect of digital population broadcast video production are remarkably improved.

The invention relates to the technical field of image information processing, in particular to an image information processing method for short video production. According to the invention, each segment in a short video is analyzed and classified in real time by using a scene cognition algorithm; the scene cognition algorithm recognizes different scene types, and applies the most suitable image processing strategy for each scene; the definition of facial details and expressions is enhanced in a character close-up scene, the blurring and distortion of key points are reduced in a fast moving scene, and the optimal image quality is realized in each scene through dynamic processing; a digital twinning technology is introduced, a virtual model based on digital twinning is constructed, and virtual elements generated by AI are seamlessly integrated into an actual scene; physical characteristics of illumination, shadow, material reflection and the like in a real scene are simulated in real time by using a digital twin model, so that fusion between virtual content and a real background is more natural; the problem of image information processing in current short video production is solved.

The embodiment of the invention provides a video editing method and device, a storage medium and a program product. In the embodiment of the invention, a first video template used for describing a rendering rule and a hierarchical relationship of a group of video materials is downloaded to local terminal equipment, and video editing software is imported; opening the first video template in an editing area of the video editing software, and displaying a first video generated based on the first video template in a preview area of the video editing software; further, determining a modified rendering rule in any target materialized template and / or a modified position relationship between any two target materialized templates by responding to a modification operation on the first video template, and editing the first video according to the modified rendering rule and / or the modified position relationship, according to the video editing method and device, the video production efficiency and diversity can be improved, the dependence on professional equipment and manual intervention is reduced, and the diversified video requirements of high efficiency and low cost are met.

The invention discloses a short video automatic generation method and device based on a new media content creation model, and a server side method comprises the steps: receiving a short video generation request sent by a client side, wherein the short video generation request carries a video production description text and a user identifier; inputting the video production description text into a pre-fine-tuned large language model, and outputting video production scheme information; searching temporary video materials and system materials uploaded by the user from a BI system through the user identifier; under the condition that the temporary video material is not empty, inputting the video production scheme information, the temporary video material and the system material into a video generation model; or under the condition that the temporary video material is empty, inputting the video production scheme information and the system material into the video generation model; and outputting the target short video, and sending the target short video to the client. Therefore, by adopting the embodiment of the invention, the generated short video can show rich layering sense and emotion tension, so that the quality of the short video is improved.

The present disclosure relates to a video processing method, apparatus, electronic device and storage medium. The video processing method comprises: receiving input content; the input content used for characterizing video production requirements; generating an initial video script based on the input content, the initial video script including video production outlines and video production elements corresponding to the video production outlines, the video production elements including shooting information and copywriting content corresponding to the video production outlines, the shooting information including at least one of a shooting location, a shooting angle, a shooting prop and a shooting sample material, the initial video script being used to assist a video creator in video creation; and displaying the initial video script on a first page.

The invention provides a video generation method and system of a self-adaptive model and related equipment. The method comprises the following steps: constructing a multi-model aggregation video generation platform; performing model characteristic labeling of a preset table on each model in the multi-model aggregation video generation platform; receiving contents and demands input by a user; based on the content and the demand input by the user and in combination with the model characteristic label, performing model matching of adaptive modes including a user preference priority mode, a resource priority mode, a quality priority mode, a cost priority mode and a fault-tolerant priority mode, and obtaining a recommended video generation model; and processing the content input by the user based on the recommended video generation model to obtain a target video. According to the technical scheme, the user only needs to input the content and the demand, the multi-model aggregation video generation platform can adaptively recommend the appropriate model based on the content and the demand input by the user, and the efficiency and the convenience of video production of the user are improved.

The invention provides a video processing method and device, equipment and a storage medium, and the method comprises the steps: segmenting a video material into a plurality of semantically coherent video clips, automatically extracting related video clips from the video material according to the text content provided by a user, and generating corresponding subtitles and voice broadcast ports matched with the related video clips, and finally synthesizing a section of finished video with clear logic and coherent content. According to the scheme, full-process automation from video material generation to final video file generation is realized, a large number of video materials can be quickly processed, the tedious manual editing process in traditional video production is reduced, the dependence on manual intervention is greatly reduced, the operation cost is reduced, the video production process is simplified, the video production efficiency is improved, and the user experience is improved. And the quality and the efficiency of finished products are also improved.

The invention provides a projection transformation method for hexahedral panoramic data to spherical panoramic data, and the method achieves the seamless splicing of panoramic images of six surfaces of a cube and the mapping of the panoramic images to a spherical coordinate system through the determination of a direction vector, the normalization of the vector, the conversion of spherical coordinates, the projection to an equidistant histogram, and an illumination and color correction algorithm. The problems of splicing gaps, deformation, texture distortion and the like in a traditional method are solved. The method is not only widely applied to the fields of virtual reality, augmented reality, panoramic video production and the like, but also greatly expands the application scenes, including but not limited to panoramic roaming, streetscape roaming experience, integrated use of specific roaming plug-ins, seamless embedding on a map platform and the like, and has wide application prospects. Therefore, the display effect of the panoramic data and the immersive experience of the user are remarkably improved.

The invention provides an automatic video generation method and device, equipment and a medium, and relates to the technical field of video production. The method comprises the following steps: acquiring video related information input by a user, and generating copywriting content according to the video related information and a preset copywriting script material library; according to a preset sound material library, converting the copywriting content into audio by using a text-to-voice conversion technology to obtain an audio material; according to the audio material, a digital human-driven technology is utilized, and a preset image material library and a video sub-mirror material library are combined, so that a visual material synchronized with the copywriting content is obtained; according to a preset packaging element material library, obtaining a packaging material matched with the copywriting content; and performing video synthesis and packaging on the audio material, the visual material and the packaging material to obtain a final video. According to the method, related materials can be generated through accurate matching and intelligent recommendation according to user requirements and recent popularity, a mixed cutting type and generation type material fusion arrangement mechanism is combined, one-key film formation is achieved, and the video production efficiency is improved.

Embodiments of the invention disclose a video generation method and apparatus. The method comprises the steps of obtaining a target story text; the target story text is subjected to content splitting processing, scene information, role information and subtitle information are obtained, and an incidence relation exists between the role information and the subtitle information; according to the role information, determining a role sticker corresponding to the subtitle information having an association relationship with the role information, and determining a scene material corresponding to the scene information; and generating a story video according to the subtitle information, the role sticker and the scene material. According to the technical scheme of the embodiment of the invention, the threshold of video production is reduced, the AI enabling creation is utilized, the user can be assisted to generate the video with the recarving modeling factor type playing method, the video uses some specific hot stem materials, the emotion feeling of the user in a certain scene is expressed in a picture mode, the video conversion of text stories is realized, and the user experience is improved. The user is helped to generate the video more quickly and more easily, the video production efficiency is improved, and the user experience is improved.

The invention discloses a video processing method and device, a storage medium and electronic equipment, and relates to the technical field of image processing, in a processing mode corresponding to a processing demand, a diffusion model generation graph is used as a reference graph, and super-resolution processing is performed on a single-scene video clip and a reference image through a video super-resolution model, so that the video processing efficiency is improved. Due to the fact that super-resolution processing is an image processing mode that detail information in the reference image is extracted and supplemented to super-resolution, the detail richness of the image is improved, time consumption and instability caused by frame-by-frame generation of a diffusion model are effectively avoided, video production is carried out according to the reconstructed resolution video sequence, and the video quality is improved. The purpose of improving the resolution of video production is achieved.

The invention discloses a video generation method and device based on AIGC and a storage medium, and the method comprises the steps: extracting information expressed in lyrics of a song, generating a story summary according to the information expressed by the lyrics, and generating a corresponding story plot according to each lyric segment; inputting the lyric segments and the corresponding story lines into the artificial intelligence model, generating sub-shots corresponding to the lyric segments, and generating corresponding images / videos according to the sub-shots; and sorting and processing the images / videos corresponding to the sub-shots according to a time sequence to obtain song videos corresponding to the songs. According to the method, the video conforming to the artistic conception of the song can be efficiently generated, and the song video production efficiency and quality are improved.

The invention relates to a video work determination method and device, computer equipment, a storage medium and a program product, and relates to the technical field of artificial intelligence. The method comprises the following steps: acquiring at least two different versions of material contents uploaded for the same video material; combining the material content of each version in the at least two video materials to generate candidate video works of at least two versions; labeling each candidate video work based on a large language model, and generating a video tag corresponding to each time anchor point in the candidate video work; displaying the putting effect score information of each video tag; the putting effect score information is used for the user to select a target video work for putting from the candidate video works. By adopting the method, the video production efficiency and the video delivery effectiveness can be improved.

The invention relates to a video production method and device, electronic equipment, a storage medium and a program product, and the method comprises the steps: obtaining a session between a user and a virtual object, and generating a corresponding initial video material based on the session; in response to an editing operation of the user on the initial video material, obtaining an edited video material; and generating a target video file based on the edited video material. The method can improve the flexibility of video production.

The invention provides a special effect video generation method and device, computer equipment and a storage medium, and the method comprises the steps: extracting an initial video frame in a to-be-processed video, and carrying out the main recognition of the initial video frame through taking a person and an animal as main objects, and obtaining all main objects; performing image semantic segmentation by taking each main body object as a foreground to obtain a layer mask, obtaining an initial background image based on the layer mask, and rendering the target season sticker to the initial background image to obtain a target background image; performing expression recognition on each main body object, and determining a target foreground image according to a recognition result; generating candidate video frames based on the target foreground image and the target background image; and performing filter processing on each candidate video frame based on the target filter mode to generate a target special effect video. By adopting the method, the workload of the user in the video acquisition process is reduced, the difficulty and complexity of obtaining the special effect video are reduced, meanwhile, the consumed labor cost and time cost are reduced, and the video production efficiency is improved.

The invention relates to the technical field of videos, and discloses a video generation method and system based on an AI script, and the method comprises the steps: carrying out the frame-by-frame analysis of an input video through a convolutional neural network, extracting a visual feature vector, building the inter-frame time sequence correlation through a recurrent neural network, achieving the segmentation of video segments, and carrying out the semantic annotation, and constructing a multi-dimensional feature vector space. In combination with personalized requirements input by a user, the matching degree is calculated by applying a cosine similarity algorithm, and candidate segments are screened and clustered and grouped. And finally, determining an optimal fragment combination sequence, and generating a personalized video meeting user requirements. According to the method, the video content can be intelligently analyzed, the intention of the user is accurately grasped, the personalized video is automatically generated, and the video production efficiency and quality are improved.