251 results about "Video production" patented technology

The invention discloses a short video production method and system based on artificial intelligence, and relates to the technical field of multimedia processing, and the method comprises the steps: inputting a split script into a multi-modal generation engine, employing a lower triangle space-time attention matrix to generate a visual stream, and generating a text stream and an audio stream; calculating a neural conduction delay amount between the visual stream and the audio stream based on an audio-visual perception delay prediction model, and generating a corrected audio stream through time axis forward compensation; calculating a cross-modal attention weight matrix according to the node association strength of the dynamic causal graph, and projecting the text stream and the corrected audio stream to a joint feature space to generate a multi-modal fusion feature; and inputting the multi-modal fusion features into a format adaptation engine, and after time-space consistency verification, embedding a neural implicit watermark and encoding the neural implicit watermark into a short video. According to the invention, the semantic consistency and coordination among the text, the audio and the visual content are improved, so that high-quality and high-intelligence automatic generation of the short video is realized on the whole.

The invention discloses a text-to-video full-link generation method and system based on a multi-modal large model, and belongs to the technical field of artificial intelligence content generation. Through cooperative work of multiple agents, analysis of a text input by a user and construction of a cross-modal memory library, unification of videos and audios for generating a sub-mirror is ensured based on memory library content, and the generation efficiency of the sub-mirror is improved. The full-process automatic generation from the text to the video is realized; the method is implemented by the following steps of: acquiring text input of a user; text analysis: dynamically extracting, analyzing, generating, associating and storing image-text-tone multi-modal information from an input text through an Agent working cooperatively, and constructing a multi-modal memory library; generating a split mirror, and generating a split mirror video and an audio according to the memory bank; and performing audio and video synthesis and audio and picture synchronous alignment to form a final video. According to the method, the narrative continuity of long video generation can be realized, the feature consistency of the split image is improved, the consistency of cross-modal emotion is enhanced, manual intervention is reduced, and the video production efficiency is improved.

A full-automatic movie and television video production system based on digital actors belongs to the field of artificial intelligence, computer graphics and movie and television production and comprises a creative engine unit, a production unit, an intelligent shooting unit, a post-processing unit and a quality inspection and rendering unit. The method has the advantages that 1, the manufacturing efficiency is greatly improved, the traditional film and television manufacturing period is usually 6-12 months, the manufacturing period can be shortened to 4 hours by the method, and the efficiency is improved by about 1000 times; 2, the manufacturing cost is obviously reduced: the manufacturing cost of traditional movies and other movies is usually 5 million to 20 million dollars, but the method only needs the computing power cost, and the cost is less than one percent of that of the traditional movies; 3, the style consistency is guaranteed, traditional film and television production depends on personal ability, the style consistency is difficult to guarantee, and the style consistency is strictly guaranteed through an algorithm and is improved by 100%.

The invention provides an interaction method and device based on agent cooperation, an agent and a storage medium, belongs to the technical field of artificial intelligence, particularly relates to the technical fields of deep learning, large models, agents, AIGC and the like, and is applied to application scenes such as wisdom education, video production, wisdom medical treatment and the like. The intelligent agent cooperation-based interaction method comprises the following steps: performing intention understanding on initial input information for a target object to obtain an initial intention understanding result; performing interaction mode demand detection on the initial intention understanding result by using a first agent to obtain an interaction mode demand attribute; an interaction element matched with the interaction mode demand attribute is called to interact with the target object, interaction information representing the demand intention of the target object is obtained, and the interaction element is used for responding to the interaction behavior; and controlling the second agent to execute the target task based on the interaction information to obtain an execution result, and pushing the execution result to the target object.

The invention discloses a method, a system and equipment for generating an oral video of a digital human, and a medium, and the method comprises the steps: obtaining oral copywriting and video material data, and analyzing and determining a timestamp of the copywriting in a video material through a multi-mode large model; converting the copywriting into audio data, preprocessing the audio data, and combining the audio data with the timestamp to generate first video data; and generating a digital human according to a user demand, and combining the digital human with the first video after image matting processing to obtain an oral playing video. According to the method, a traditional template generation mode is broken through, and customized production of the digital human broadcast video is realized through a multi-modal semantic matching and personalized digital human generation technology; and meanwhile, audio and video accurate synchronization, high-quality image matting and synthesis technologies are adopted, so that the content adaptability and the video quality are guaranteed, and the flexibility, the efficiency and the effect of digital population broadcast video production are remarkably improved.

The invention provides a video generation method and system of a self-adaptive model and related equipment. The method comprises the following steps: constructing a multi-model aggregation video generation platform; performing model characteristic labeling of a preset table on each model in the multi-model aggregation video generation platform; receiving contents and demands input by a user; based on the content and the demand input by the user and in combination with the model characteristic label, performing model matching of adaptive modes including a user preference priority mode, a resource priority mode, a quality priority mode, a cost priority mode and a fault-tolerant priority mode, and obtaining a recommended video generation model; and processing the content input by the user based on the recommended video generation model to obtain a target video. According to the technical scheme, the user only needs to input the content and the demand, the multi-model aggregation video generation platform can adaptively recommend the appropriate model based on the content and the demand input by the user, and the efficiency and the convenience of video production of the user are improved.

The invention provides a projection transformation method for hexahedral panoramic data to spherical panoramic data, and the method achieves the seamless splicing of panoramic images of six surfaces of a cube and the mapping of the panoramic images to a spherical coordinate system through the determination of a direction vector, the normalization of the vector, the conversion of spherical coordinates, the projection to an equidistant histogram, and an illumination and color correction algorithm. The problems of splicing gaps, deformation, texture distortion and the like in a traditional method are solved. The method is not only widely applied to the fields of virtual reality, augmented reality, panoramic video production and the like, but also greatly expands the application scenes, including but not limited to panoramic roaming, streetscape roaming experience, integrated use of specific roaming plug-ins, seamless embedding on a map platform and the like, and has wide application prospects. Therefore, the display effect of the panoramic data and the immersive experience of the user are remarkably improved.

The invention discloses a video processing method and device, a storage medium and electronic equipment, and relates to the technical field of image processing, in a processing mode corresponding to a processing demand, a diffusion model generation graph is used as a reference graph, and super-resolution processing is performed on a single-scene video clip and a reference image through a video super-resolution model, so that the video processing efficiency is improved. Due to the fact that super-resolution processing is an image processing mode that detail information in the reference image is extracted and supplemented to super-resolution, the detail richness of the image is improved, time consumption and instability caused by frame-by-frame generation of a diffusion model are effectively avoided, video production is carried out according to the reconstructed resolution video sequence, and the video quality is improved. The purpose of improving the resolution of video production is achieved.

The invention relates to the technical field of videos, and discloses a video generation method and system based on an AI script, and the method comprises the steps: carrying out the frame-by-frame analysis of an input video through a convolutional neural network, extracting a visual feature vector, building the inter-frame time sequence correlation through a recurrent neural network, achieving the segmentation of video segments, and carrying out the semantic annotation, and constructing a multi-dimensional feature vector space. In combination with personalized requirements input by a user, the matching degree is calculated by applying a cosine similarity algorithm, and candidate segments are screened and clustered and grouped. And finally, determining an optimal fragment combination sequence, and generating a personalized video meeting user requirements. According to the method, the video content can be intelligently analyzed, the intention of the user is accurately grasped, the personalized video is automatically generated, and the video production efficiency and quality are improved.

The embodiment of the invention provides a video processing method and device, electronic equipment, a storage medium and a program product, and relates to the fields of video processing, artificial intelligence, cloud technology and the like. The method comprises the following steps: acquiring a to-be-processed video, performing lens splitting processing to obtain a plurality of sub-lens segments, generating a segment abstract of each sub-lens segment through a first big language model based on multi-modal information and first instruction information of each sub-lens segment, and generating a second segment abstract of each sub-lens segment based on the segment abstract of each sub-lens segment and acquired second instruction information, and determining at least one target sub-lens segment from the sub-lens segments through a trained second large language model, fusing the target sub-lens segments, and generating a target video segment corresponding to the to-be-processed video. According to the scheme of the invention, semantic understanding and content extraction are carried out based on the large language model by combining the various modal information of each sub-lens segment in the video, the target sub-lens segment meeting the selection condition in content is more accurately positioned, and the video production efficiency is improved.

The invention discloses an online teaching video production method and device based on a virtual scene, and a medium, belongs to the technical field of teaching video production, and is used for solving the technical problem of high curriculum abandoning rate caused by low construction efficiency, low content updating rate and low knowledge transmission accuracy of an existing online curriculum. The method comprises the steps of customizing a digital teacher image of a target teacher based on modeling software; wherein the digital teacher image comprises a 3D digital teacher image and a 2D digital teacher image; constructing a virtual teaching scene, and training a virtual scene model to identify a user instruction so as to adjust features in the virtual teaching scene; based on the made teaching courseware, generating a corresponding digital human control script and a voice explanation script; placing the digital teacher image and the virtual teaching scene into a virtual environment, and fusing the digital teacher image and the virtual teaching scene with the digital human control script and the voice explanation script to form a virtual teaching model; and performing video rendering on the virtual teaching model to obtain a teaching video.

The invention relates to the technical field of digital people, and provides a method and equipment for generating a digital people video, which can be applied to a digital marketing scene. According to the method, the generation of the digital human video is divided into an audio generation process and a video generation process, when the audio is generated, a target text, an emotion parameter and a reference audio are taken as input, and the target audio of the target text is broadcasted by the sound of a reference person in the reference video and a set emotion, so that sound cloning is realized, the degree of violation of the generated digital human video is reduced, and the user experience is improved. And the text features are extracted from two dimensions of characters and pronunciation, so that the pronunciation accuracy during sound cloning is ensured. When the video is generated, the cloned target audio and the cloned reference video are used as input, and the fidelity of the digital human video is improved through expression and mouth shape matching, so that a reference person can quickly and efficiently generate vivid digital human videos with different broadcast contents only by shooting one reference video without shooting one by one, thereby reducing the manufacturing cost of the digital human video, and improving the user experience. And the video production efficiency is improved.

The invention discloses a full-automatic video generation system and method based on digital twinning and AI technologies, relates to the technical field of image data processing, and aims to solve the problem that full-process automatic production is difficult to realize in existing meteorological and ocean forecast video production. The method comprises the following steps: automatically acquiring structured data from an external digital twin API (Application Program Interface) through an automatic data acquisition module; a broadcast text is automatically generated and synthesized into an audio file based on the structured data through an AI audio automatic generation module; through a dynamic visualization rendering and capturing module, generating a dynamic visualization picture based on structured data driving, capturing the picture to form a continuous image frame sequence, and recording a timestamp of specific element switching in the picture at the same time; and synchronously aligning the voice audio file and the continuous image frame sequence according to the timestamp through an audio and video intelligent packaging module, mixing background music, and packaging and outputting a final video file. And full-process automatic production from structured data to flaking is realized.

The invention provides a video generation method, a training method and an intelligent agent based on a hybrid expert architecture, and relates to the technical field of artificial intelligence, in particular to the technical fields of large models, computer vision, video production, meta universe and the like. The video generation method based on the hybrid expert architecture comprises the following steps: receiving demand information related to a target object; processing the demand information by using a large model determined based on the hybrid expert architecture, generating a target video matched with the demand information, the large model comprising a routing layer and a plurality of expert layers, and determining a target expert layer in the plurality of expert layers by using the routing layer to perform semantic understanding on the demand information, and executing a video generation task by using the target expert layer according to the demand information to obtain a target video.

A system (100) for providing a recommended video production (80) is disclosed herein. The system (100) comprises an overview camera (10) for capturing an overview recording, additional camera(s) (15a-n) for capturing additional recordings, and a back-end video production unit (44). The back-end video production unit is configured to receive the recordings being synchronized in time, apply image processing algorithm(s) to the overview recording for determining interest levels, wherein interest levels are associated with real-world events occurring within and around subareas of the real-world target field (20), select video contents among the recordings, wherein the selection is based on the interest levels as defined by the processed overview video recording, and based on said selection, produce the recommended video production (80) that, for each time unit, comprises video contents reflecting a currently highest interest level among the overview video recording and the additional video recording(s).

Embodiments of the present disclosure disclose a video generation method and an electronic device. The method comprises: creating a 3D virtual set environment on the basis of a 3D development engine; after receiving a video generation requirement text, generating a script by means of mutual coordination between multiple intelligent agents on the basis of an artificial intelligence (AI) large model, the multiple intelligent agents being used for simulating multiple functional jobs involved in an artificial video production process, the script comprising a character introduction in the script, actor lines, and a character position, action and shot types corresponding to the actor lines; performing structural processing on the script, and simulating a video shooting process in the 3D virtual set environment on the basis of the structured script, so as to generate a target video. By means of the embodiments of the present disclosure, video generation quality and character consistency can be improved.

The invention discloses a method and a system for outputting PGM and PVW signals through seamless switching of 24 paths of 12G-SDI ultra-high-definition videos, relates to the technical field of video production, and discloses a method and a system for outputting PGM and PVW signals through seamless switching of 24 paths of 12G-SDI ultra-high-definition videos. 24 paths of 12G-SDI video signals are subjected to grouping selection processing, the video format is unified, and a double-cache structure and a time synchronization mechanism are adopted, so that the problems of signal processing bottleneck and clock difference under a high-bandwidth condition are effectively solved; the problems of picture tearing and switching delay caused by high-bandwidth processing and signal clock difference in seamless switching of 24 paths of 12G-SDI video signals are solved, and low-delay and high-reliability PGM and PVW signal output is realized.

The invention provides a voice data generation method based on a large model and a method for training the large model, and relates to the technical field of artificial intelligence, in particular to the technical fields of voice generation, intelligent customer service, video production and the like. The large model-based voice data generation method comprises the following steps of: receiving a rhythm description text and a voice text, wherein the rhythm description text describes a pronunciation rhythm intention of a plurality of text words in the voice text; semantic fusion is conducted on the rhythm description text and the voice text through a large model, rhythm fusion features are obtained, sub-features in the rhythm fusion features represent the pronunciation rhythm of the voice segments for the text words, and the to-be-generated target voice data comprise the voice segments; and according to the rhythm fusion feature and a specified pronunciation attribute related to the specified object, generating target voice data which represents that the specified object pronunciates according to the pronunciation rhythm intention and corresponds to the voice text.

Described herein is a computer implemented method. The method includes displaying, on a display, a scene timeline including a time-ordered sequence of scene previews, each scene preview corresponding to a scene of a video production and having a display width that provides a visual indication of a duration of that scene. The method further includes displaying a canvas including a first visual element that is associated with the first scene, and in response to detecting selection of the first visual element from the canvas, causing a first visual element timing indicator to be displayed. The first visual element timing indicator is aligned with the scene timeline based on a first visual element start time and a first visual element end time.

The invention discloses an XML-based video template language definition method and device, and the method comprises the steps: creating a VTL video template, and setting a plurality of XML attributes for a template element for definition; embedding one or more scene elements in the template element through a parent-child relationship of XML (Extensible Markup Language); various content elements are nested in each scene element; and introducing a plurality of logic elements with the same level as the template element, wrapping the template element and the plurality of logic elements by using a root element, and realizing dynamic logic processing and data binding in cooperation with a dynamic calculation expression so as to generate the VTL video template capable of being analyzed and rendered. Through the method provided by the invention, the VTL completely, accurately and flexibly defines a complex video item as a standardized text file by utilizing the structuralization, extensibility and self-description characteristics of the XML, so that comprehensive description from static layout to dynamic content generation is realized; standardized description of the video content is achieved, high dynamic performance is achieved, secondary editing and cross-terminal unified construction are easy, and the efficiency and flexibility of video production are improved.

This disclosure provides a video production method, apparatus, electronic device, and storage medium. The method includes: when producing a video file using high dynamic range imaging technology, determining first metadata information, wherein the first metadata information is ambient light-related metadata information; and writing the first metadata information into the header information of the video file. This disclosure expands the metadata information of video files, improves the display effect of video files produced under different ambient light conditions, and enhances the usability of HDR technology.

The invention provides a video generation method and device, a server, a storage medium and a program product, and the method comprises the steps: obtaining a specified video type from a video generation instruction in response to the video generation instruction; obtaining a target video template corresponding to the specified video type from a video template library; obtaining state data of a target service, and determining matching data of the target video template from the state data of the target service; using the matching data to update at least one image frame template in the target video template to obtain at least one updated image frame template; and generating a target video according to the updated at least one image frame template. By adopting the method provided by the embodiment of the invention, the target video can be automatically generated according to the target video template and the state data of the target service, and the video production efficiency is effectively improved.

The invention discloses an intelligent video creation method and system based on AI drive, and relates to the technical field of video processing, and the method comprises the steps: recording audio data in a program recording process and multi-camera video data, and inserting a timestamp on each segment of data; according to the recorded content of the program, dotting the program on a time axis, and slicing all video data and audio data according to a hit-in point; intelligent analysis is carried out on the slices with the same time interval, and figure information and environment information in the slices are identified; generating a switching rule of a panorama, a medium scene and a close shot of a lens through the environment information; and performing video creation of each program according to the switching rule and the character information, and synthesizing the corresponding audio data fragments to obtain a final video creation result. According to the whole scheme, manual intervention is reduced, meanwhile, the film forming quality and the manufacturing efficiency are guaranteed, and the method is suitable for various video manufacturing scenes.

The present invention discloses a full-link text-to-video generation method and system based on a multimodal large model, which belongs to the field of artificial intelligence content generation technology. Through the collaborative work of multiple intelligent agents, user input text is analyzed, a cross-modal memory library is constructed, and the unified video and audio of the generated storyboard is ensured based on the memory library content, thereby realizing the full-process automatic generation from text to video. The implementation of this method includes the following steps: obtaining user text input; text analysis, through collaborative agents, dynamically extracting, analyzing, generating, associating, and storing multimodal information of images, texts, and audios from the input text to construct a multimodal memory library; generating storyboards, generating storyboard videos and audios according to the memory library; audio and video synthesis, and forming the final video after synchronous alignment of audio and video. The present invention can achieve narrative coherence in long video generation, improve the feature consistency of storyboards, enhance the consistency of cross-modal emotions, reduce manual intervention, and improve the efficiency of video production.

The embodiment of the invention provides a video production method and device, a vehicle and a storage medium, and the method comprises the steps: obtaining video data of an automobile data recorder, and carrying out the interception of the video data, and obtaining a candidate video; determining a picture attribute of the candidate video, and determining a target video template according to the picture attribute; the target video template comprises a plurality of video slots; the plurality of video slots are respectively provided with corresponding cutting targets; and respectively clipping a plurality of video clips corresponding to the clipping targets in the plurality of video slots from the candidate video, filling the plurality of video clips into the plurality of video slots to obtain a target video, and outputting the target video. Therefore, even if the vehicle is running, the video data in the automobile data recorder can be automatically intercepted, the target video is made through the target template, a user does not need to make the video by himself / herself after parking, the driving safety of the user is not affected, meanwhile, the user does not need to make the video manually, and the use experience of the user is improved.

A system is provided.SOLUTION: A system comprising: means for a user to send a request for video production; means for a server to receive the user's request and provide related data to generative artificial intelligence; means for the generative artificial intelligence to generate a script and a proposed configuration of a video based on the provided data; means for the server to generate a simplified preview video based on the generated proposed configuration and provide the preview video to the user; means for the user to provide feedback on the preview video; means for the generative artificial intelligence to generate a final version of the video based on the feedback; and means for the server to provide the final version of the video to the user.SELECTED DRAWING: Figure 1

1. The name of the design product: photography spotlight (PH-354). 2. The use of the design product: the design product is used for mounting on a photography lamp to create special light effects such as spotlighting, light chasing, projection, modeling, and light supplementation during photography and video production. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view 1.

The utility model discloses a portable short video making and shooting device, and relates to the technical field of shooting devices. The portable short video making and shooting device comprises a camera, an optical lens arranged on one side of the camera, a gear ring arranged on the outer wall of the optical lens and a support arranged on the bottom face of the camera and used for supporting the camera, a grip is arranged on one side of the support, and a lighting lamp is arranged at one end of the grip. According to the device, the adjusting gear meshed with the gear ring on the outer wall of the optical lens is arranged on the support, the adjusting gear is in linkage with the connecting rod through the connecting belt, and the shifting wheel convenient for fingers of a photographer to shift is arranged at one end, close to the grip, of the connecting rod, so that the photographer rotates the shifting wheel without releasing the grip by two hands, and the optical lens can be conveniently taken out. Therefore, regulation and control of shooting parameters such as the focal length of the optical lens are realized, so that in the whole shooting process, a photographer can stably hold the support and the camera placed on the support, and it is ensured that shot short videos meet shooting requirements.

1. Name of the product in this design: Graphical User Interface for Video Production in Electronic Devices. 2. Intended use of this design: for use in an electronic device. 3. The key design features of this product are its graphical user interface. 4. The image or photograph that best illustrates the design's key features: the front view. 5. Purpose of the Graphical User Interface: The graphical user interface is used for the management page where users input audio and create videos; the main view displays the homepage of the management page; clicking the "AI Generate Video" button at the bottom of the main view leads to interface state diagram 1; in interface state diagram 1, clicking the "Go to Record" button leads to interface state diagram 2; in interface state diagram 2, clicking the red button below "Click to Start Recording" leads to interface state diagram 3; in interface state diagram 3, clicking the "√" button in the lower right corner leads to interface state diagram 4; after the "My Cloned Voice" in interface state diagram 4 has finished loading, interface state diagram 5 is displayed, and the sound plays automatically; waiting for the interface to load... After the "My Cloned Voice" in state diagram 5 finishes playing, the interface changes to state diagram 6. In state diagram 6, click the "+" button in the "Select Your Desired Solution" field at the top to enter state diagram 7. In state diagram 7, select any solution and click the "OK" button in the upper right corner to enter state diagram 8. In state diagram 8, click the "Smart Generation" button at the bottom to enter state diagram 9. In state diagram 9, click any video to enter state diagram 10. In state diagram 10, click the "Share to Acquire Customers" button at the bottom to enter state diagram 11.

The present invention relates to the technical field of video production, and discloses a real-time video processing method and system in an augmented reality environment. The method comprises: constructing graph structure data based on a concept image sequence, a storyboard text sequence, and a scene text sequence, wherein the graph structure data comprises basic data elements, wherein one data element is associated with one concept image, one storyboard text, or one scene text, and the correlation between two data elements is defined according to the following rules: inputting the graph structure data into a trained augmented intelligent agent, and outputting an enhancement result of a concept image in the concept image sequence; the present invention separates the scene script and the storyboard script, and performs sparse processing to correspond to the concept image; finally, the sparse script semantics and the concept image features are integrated into a model to achieve local targeted enhancement of the concept image corresponding to the script artistic expression, and the enhanced concept image can provide a better reference for video production.