886 results about "Special effects" patented technology

The invention belongs to the technical field of visual special effects, and discloses an AI visual special effect dynamic generation system fusing multi-modal perception. Through cooperative work of six core modules of multi-modal input processing, importance analysis, parameter configuration, parameterized rendering, parameter optimization and rendering and output, deep fusion of special effects and contents is realized. An image sequence, audio data and scene parameters can be processed at the same time, a multi-modal feature data set is constructed, a scene key visual area is scientifically recognized, a visual importance distribution map is generated, and the special effect parameter configuration and rendering process is guided. An improved neural radiation field technology and a physical constraint model are adopted to ensure the consistency and reality of the special effect at different visual angles; and a multi-dimensional quality evaluation and parameter automatic optimization mechanism is introduced, so that the visual expressive force and the artistic value of the special effect are guaranteed. The creation threshold is remarkably reduced, the cooperative expression ability of the special effect and the content is improved, and the special effect becomes a powerful tool for enhancing the narration and enhancing the emotion.

The invention discloses an efficient three-dimensional reconstruction method based on data-driven compression and adaptive splitting. The method comprises the following steps: acquiring a multi-view image to generate a 3D Gaussian; constructing a mask generation network and a discrimination network, generating a mask by the mask generation network, and screening the eliminated 3D gauss; the attributes of 3D Gaussian are optimized through a microgradable grating renderer; gaussian selection and elimination are carried out by using the mask, and a rendering image after partial Gaussian elimination is generated; if the preset number of iterations is reached, the contribution to the scene is reserved or eliminated according to 3D Gaussian; otherwise, performing Gaussian splitting or copying operation. And through antagonistic learning and reconstruction loss optimization of the mask generation network and the discrimination network, high-precision three-dimensional scene reconstruction is realized while the Gaussian number is reduced. The method is suitable for various three-dimensional reconstruction scenes, can greatly improve the rendering speed, reduces the consumption of computing resources, maintains the visual quality of a reconstruction result, and is suitable for the fields of virtual reality, augmented reality, movie special effects and the like.

The invention relates to the field of animation rendering, and provides an intelligent rendering method for realizing an animation picture, which comprises the following steps of: firstly, collecting an initial animation picture, identifying a scene of the initial animation picture, analyzing an animation effect demand, carrying out picture analysis in combination with style characteristics to obtain a scene picture element, and detecting an element type to determine a special effect demand degree; a special effect rendering scheme is generated; an adaptive color mode is queried; visual atmosphere parameters are evaluated to calculate a color adjustment amount; a color optimization strategy is constructed; and determining a rendering target based on the special effect rendering scheme, the color optimization strategy and the visual angle adjustment plan, optimizing a picture to obtain a record, monitoring the rendering quality, and finally generating an intelligent rendering scheme. According to the invention, the efficiency and quality of animation picture rendering can be improved.

Method for generating a live streaming video having real-time special effects starts with a processor displaying on a display device a lens selection user interface including a plurality of lens selections. The lens selections are associated with a plurality of special effects, respectively, and include a first lens selection associated with a first special effect and a second lens selection associated with a second special effect. The processor then receiving a selection of the first lens selection and applies in real-time the first special effect to a video stream captured by a camera to generate a video stream having the first special effect. The processor then transmits in real-time the video stream having the first special effect via a network to be displayed on a plurality of client devices. Other embodiments are disclosed.

The embodiment of the invention provides a video editing method. The video editing method comprises the following steps: acquiring background music according to a video editing demand; on the basis of drumbeat recognition and emotion analysis on the background music by an expert template, selecting a key drumbeat for video picture switching, and generating an editing configuration file on the basis of the key drumbeat; segmenting and classifying the to-be-processed video through multi-modal analysis to obtain different types of video clips; and automatically selecting a video clip combination based on the editing configuration file, and adding a transition special effect to obtain an edited video. According to the embodiment of the invention, by introducing the intelligent editing scheme based on the expert template, the editing result can be ensured to be highly matched with the music rhythm, the scene segment selected in the editing process meets the preset emotion and theme requirements, and the logicality and ornamental value of the video are improved.

The invention relates to the technical field of editing and special effect generation, in particular to a digital media content intelligent editing and special effect generation system based on artificial intelligence. Comprising a content understanding analysis module, an editing decision module, a special effect generation preview module, an audio processing module, a dynamic transition special effect module, a subtitle generation editing module, a virtual interaction module and a content distribution optimization module. The content understanding analysis module is used for video content identification and sentiment analysis; and the editing decision module is used for recommending an editing point and providing a dynamic editing strategy. The video content can be automatically analyzed, the editing point and the special effect adding position can be identified, the editing and special effect generation efficiency is greatly improved, the editing strategy and the special effect type can be dynamically adjusted according to the video content and the sentiment analysis result, the editing and the special effect can better meet the user requirement and the video content, and the user experience is improved. Abundant editing and special effect options are provided, and the editing and special effect generation process is simplified.

The invention discloses a method and system for generating a visual special effect video, and relates to the technical field of video generation, and the method comprises the steps: carrying out the collection and preprocessing of multi-modal data, synchronously collecting an RGB video, a depth map and environment illumination data, and generating a registered 3D point cloud; carrying out time-space domain combined motion compensation image matting, and extracting a moving object Alpha mask; by means of edge purification of self-adaptive illumination separation, illumination pollution and edge color overflow of a green screen scene are eliminated; the multi-scale transparency estimation network outputs a transparency graph; dynamic special effect synthesis and output guarantee video fluency; and the special effect video is intelligently recommended, and a self-adaptive output strategy is realized. The image matting and edge processing precision is improved, the transparency estimation and special effect synthesis effect is enhanced, intelligent recommendation and resource optimization are realized, and the defects in dynamic scene processing in the prior art are overcome.

An ethernet device connector built-in module for a controllable apparatus from lighting, sound, video or special effects engineering, for incorporating the apparatus in a chain of apparatuses serially connected by ethernet. The construction of the built-in module allows serial control of complexly switchable apparatuses. The built-in module provides a data supply and, for example, a power supply of a chain of serially interconnected apparatuses via two external plug-in locations being interconnected via an interposed distributor component that has an ethernet contact interface on a PCB of the built-in module for connecting within the apparatus, the built-in module to control electronics of the apparatus. The distributor component is configured here to distribute a data supply signal and optionally a power supply signal supplied by one of the two external plug-in locations to the other one of the two external plug-in locations and the ethernet contact interface on the PCB.

The invention is suitable for the technical field of computers, and provides an optimization method, system and equipment for a particle system, and the method comprises the steps: loading the particle system, and randomly initializing the particle attributes of particles in the particle system; based on motion and interaction rules of particles, quantum calculation is adopted to predict behaviors of the particles in real time, and dynamic special effects of corresponding scenes are generated; according to the scene and the state of the player, the special effect attributes of the particles are dynamically adjusted, and the special effect attributes comprise the transparency, the color and the texture of the particles; the method comprises the following steps: tracking the life state of each particle in real time, marking each particle, generating a particle multiplexing pool, and generating a particle multiplexing strategy based on the particle multiplexing pool, and the particle multiplexing strategy is used for dynamic distribution of reusable particles. And the overall adaptability and rendering performance of the particle system are improved, so that a more real and vivid visual effect can be obtained.

The invention relates to an indoor virtual scene building method and system based on an unreal engine, and relates to the technical field of virtual reality, and the method comprises the steps: obtaining a user browsing direction, carrying out the interaction switching probability prediction of sub-virtual scenes, and pre-calling a plurality of virtual resources in a plurality of sub-virtual scenes according to the probability of a plurality of sub-scenes to carry out the pre-building of a virtual scene; predicting multi-sub-scene browsing time, and correcting the multi-sub-scene browsing time according to the multi-sub-scene probability; and obtaining a plurality of special effect precisions according to the plurality of corrected sub-scene browsing time decisions, and carrying out special effect pre-loading on the plurality of sub-virtual scenes to complete indoor virtual scene construction. Through the method and the device, the technical problems of low operation efficiency and incapability of meeting real-time interaction requirements due to insufficient real-time performance and accuracy of resource loading in an existing virtual scene building method can be solved, and the real-time performance and accuracy of resource loading can be effectively improved, so that the overall operation efficiency can be improved, and the user experience can be improved. And smooth real-time interaction experience is ensured.

The invention relates to the technical field of image processing, and further relates to a video decoding and unreal engine rendering method based on GPU full-link zero copy, which comprises the following steps of: 1, performing hardware decoding on an input video code stream on a GPU, and constructing a motion vector description buffer region for storing compressed domain motion vector information according to a macro block sequence; step 2, reading the motion vector description buffer area on the GPU through a calculation shader, and generating dynamic special effect control buffer areas in one-to-one correspondence with the macro blocks; and step 3, in a post-processing material of the unreal engine rendering module, taking the shared video texture resource as an input texture, and outputting a video picture. On the premise of not depending on a host processor and not excessively occupying video memory bandwidth, unified management of pixel data and motion data is achieved, delay is remarkably reduced, and special effect stability and direction consistency are improved.

The invention provides a meta-universe scene rapid construction method and system based on a modular engine, and relates to the technical field of meta universe, and the method comprises the steps: obtaining a creation instruction of a user for a meta-universe scene, and calling a corresponding scene rendering module from a preset modular engine library according to scene type information; performing feature extraction and scene layering on scene environment parameters based on a scene intelligent analysis model of deep learning, and analyzing the scene environment parameters into a plurality of scene function layers with a progressive hierarchical relationship; and calling a physical engine module, an illumination rendering module and an environment special effect module to construct a scene. Through the modular engine and the intelligent analysis model, rapid establishment of the meta-universe scene is realized, the scene establishment efficiency is improved, and the scene reality sense and the interaction experience are enhanced.

The invention relates to an AR card interaction method and system based on a user portrait and a dynamic matching algorithm, and the method comprises the steps: obtaining the materials of an IP card in the aspects of videos, 3D models and special effect resources, and constructing a user portrait database; identifying card features and associating a user account based on an AR module; according to the user portraits and the material labels, matching scores are calculated through a weighting formula, and a recommendation list is generated according to score sorting; loading the recommended material, and adjusting the special effect according to the 3D engine in combination with the environment data; and associating recommendation priorities according to the degrees of collecting, liking, commenting or purchasing the materials by the user, and updating the user portrait in real time. According to the method, a highly personalized effect is achieved by combining the user portrait and the environment data, the scene immersion is enhanced and the dynamic adaptability is improved by adjusting the recommended content and rendering the special effect in real time, and the viscidity is improved by supporting the user to actively participate in content selection and feedback, so that the interaction diversity is realized.

The invention relates to a special effect real-time generation method, device and system in virtual shooting, and the method comprises the steps: displaying a first image shot by an image collection device in a display device of terminal equipment in a virtual shooting process; the first picture comprises a virtual scene displayed in a screen and a real scene in front of the screen; in response to an operation of adding a special effect to a target object in the real scene, adding a target special effect corresponding to the target object in the first picture in real time, and generating a second picture; and displaying the second picture in a display device of the terminal equipment. According to the method and the device, the target special effect is added in real time in the picture shot by the image acquisition device, the special effect generation efficiency can be effectively improved, meanwhile, the special effect production cost is effectively reduced, and the economical efficiency is higher.

The embodiment of the invention provides a special effect video generation method and device, electronic equipment and a storage medium. A to-be-processed image is acquired; based on a to-be-processed image, a target image is generated, the target image is an image generated after a target special effect is applied to a target object in the to-be-processed image, and the target object in the target image has a target effect generated by the target special effect; a video generation model is called to process the to-be-processed image and the target image, a special effect video is generated, the special effect video comprises a video first frame, a video tail frame and at least one video middle frame located between the video first frame and the video tail frame, and the video first frame and the to-be-processed image have the same image content; the video tail frame and the target image have the same image content, and the at least one video middle frame is used for representing the continuous change process of the generated target effect. The content change of the special effect video is smoother and more real, and the video quality of the special effect video is improved.

The invention discloses a multi-agent collaborative short play digital production system, which belongs to the technical field of artificial intelligence, and comprises a data and state management module driven by a digital thread, which uniformly manages and synchronizes data, states and decisions of all production links through a throughout digital thread; the full-process intelligent production module takes an intelligent control center as a core, decomposes and dispatches a complex task to five professional intelligent agents for cooperative execution, and covers a complete production link from script generation, visual preview, video shooting and special effects to intelligent editing and final sound and picture synthesis; the man-machine collaborative evaluation and feedback closed-loop module provides an interactive interface for human experts to supervise, guide and correct key production nodes and records artificial decisions as feedback to form a closed loop of a continuous optimization system; according to the multi-agent collaborative short play digital production system provided by the invention, the digital thread penetrates through multi-agent collaboration, so that data tracing and state synchronization of the whole process of short play production can be realized, challenges such as narrative continuity, cross-modal consistency and physical authenticity are effectively solved, and the quality of generated content and the production efficiency are remarkably improved.

The embodiment of the invention relates to a method and device for interaction and special effect production, equipment and a storage medium. The interaction method provided by the invention comprises the following steps: detecting a plurality of reference key points associated with a to-be-mounted virtual object from a target image; determining the mounting position of the virtual object based on the position information of the plurality of reference key points in the target image; and mounting the virtual object to the mounting position in the target image. Based on the above mode, the embodiment of the invention can realize more accurate mounting of the virtual object, and improve the interaction experience of the user.

To provide a game machine capable of enhancing amusement properties of a performance using a special image.SOLUTION: A game machine includes: suggestive performance execution means that can suggest that a game state is controlled to an advantageous state and can execute suggestive performances of a plurality of kinds in which degrees of expectation differ according to performance modes; particular image display performance execution means that can display a particular image; and special performance execution means that can execute a special performance for changing the suggestive performance executed in one performance mode to a performance mode with a degree of expectation higher than that of the one performance mode by using the particular image being displayed. The special performance execution means displays a particular correspondence image when the suggestive performance is executed, and executes the special performance in a mode that the particular image acts on the particular correspondence image.SELECTED DRAWING: Figure 294-8

The invention provides a multimedia file synthesis method and device, electronic equipment and a storage medium, and the method comprises the steps: decoding a first multimedia file to obtain video and audio frame data, constructing audio waveform data, and analyzing statistical parameters and a specific time interval average value of the audio waveform data; determining a control parameter to regulate and control the special effect output of the video frame, synthesizing target video data, combining the target frame and the audio frame to generate a second multimedia file, and dynamically displaying the special effect based on the audio content when the file is played; the video special effect can be controlled through audio data analysis, and the function of dynamically displaying rich visual effects according to the audio content when the multimedia file is played is achieved.

To provide an apparatus for incorporating an apparatus in a chain of apparatuses serially connected by ethernet and capable of controlling lighting, sound, video or special effects engineering.SOLUTION: An ethernet-based construction of an ethernet device connector built-in module 1 allows serial control of complexly switchable apparatuses. The built-in module provides data and power of a chain of serially interconnected apparatuses via two external slots 3A, 3B being connected to an ethernet contact interface on a circuit board via distributors 10 interconnected to each other, for connecting the ethernet device connector built-in module 1 to control electronics of the apparatus within the apparatus. The distributor 10 (e.g., PoE switch or PoDL switch) is configured to distribute a data signal and a power supply signal, as necessary, supplied by one of the two external slots 3A, 3B to the other one of the slots and the ethernet contact interface on the circuit board.SELECTED DRAWING: Figure 2

The invention relates to a bullet screen data processing method and device, computer equipment, a storage medium and a computer program product. The method comprises the steps of displaying at least one bullet screen configuration data set in response to a configuration input operation for a bullet screen special effect content file; the bullet screen configuration data set comprises an animation layer identifier and a matched data identifier which are recorded in an associated manner; in response to a configuration release operation for the bullet screen special effect content file, generating a bullet screen special effect scheduling file corresponding to the bullet screen special effect content file based on each bullet screen configuration data set, and forming a bullet screen special effect resource by the bullet screen special effect content file and the bullet screen special effect scheduling file; and the bullet screen special effect scheduling file is used for applying the video bullet screen triggering the bullet screen special effect to the animation layer corresponding to the corresponding animation layer identifier based on the bullet screen special effect style association data corresponding to the matching data identifier, thereby obtaining the special effect bullet screen. By adopting the method, the implementation flexibility of the bullet screen special effect can be improved.

The invention discloses a WebGL-based Unity asset cross-platform preview method and system, and a storage medium. The preview method comprises the following steps: 1) preprocessing an editor plug-in: scanning a target asset through the Unity editor plug-in, extracting a resource GUID,. Meta metadata and a dependency relationship, generating a lightweight AB packet and adding a dynamic thumbnail; step 2) cloud dependency analysis: the server side recursively constructs a dependency tree based on GUID, filters redundant resources, and generates a resource loading list which can be identified by the browser side; and step 3) a WebGL rendering engine: loading an AB packet in a browser, realizing particle effect regeneration, animation control and scene interaction by simulating a Unity Runtime environment, and adapting to a WebGL 1.0 / 2.0 rendering pipeline. The invention aims to provide a WebGL-based Unity asset cross-platform preview method and system and a storage medium, aims to solve the problem that a browser cannot directly preview Unity resource files, and provides a set of resource management workflow based on Unity-cloud storage-browser preview for the Unity resource files.

The invention relates to a clinical surgery experiment virtual simulation teaching method and device, equipment and a medium. The method comprises the following steps: responding to an obtained teaching task configuration file; the teaching task configuration file comprises a clinical scene and an evaluation standard; calling a corresponding three-dimensional digital physiological model according to the teaching task configuration file, and performing special effect rendering according to the clinical scene to obtain a visual virtual simulation experiment scene; responding to the obtained user action data, performing real-time deformation on the three-dimensional digital physiological model, and generating feedback parameters; the feedback parameter is used for indicating the interaction control to work according to the feedback parameter; and comparing the user action data with preset standard expert action data, and generating a teaching evaluation result based on an evaluation standard. By adopting the method, high fidelity can be carried out on the whole process of clinical surgery experiment teaching, effective technical support is provided for medical skill teaching, and the method is suitable for multi-scene and multi-level medical teaching practice requirements.

A video effect processing method, apparatus and system, an electronic device, a storage medium, a computer program product, and a computer program provided by embodiments of the present disclosure realize a function of displaying an effect video resulting from a rendering processing of effects by performing, during a driving process of a vehicle, target recognition processing based on at least two algorithms on a captured driving video, and performing target tracking processing on a result of the target recognition processing, so as to perform the rendering processing on the driving video according to an image trajectory of the target to be rendered in the driving video. By doing so, users can view the effect video of the photo-capturing tour while self-driving thus improving the user experience.

The embodiment of the invention provides a special effect rendering method and device, equipment and a storage medium, and the method comprises the steps: responding to an instruction for controlling a game role to release a special effect attack skill, and determining a target release object corresponding to the special effect attack skill; target special effect rendering information is determined based on the skill type of the special effect attack skill and the object type of the target release object, and the target special effect rendering information comprises special effect identification information and special effect rendering configuration parameters; the special effect rendering configuration parameter comprises a model hanging point position used for mounting a target special effect corresponding to the special effect identification information in the target release object; and rendering the target special effect at the model hanging point position of the target release object. By means of the scheme, planners can freely configure the special effect rendering information so as to controllably achieve rendering of different types of special effects through the special effect rendering information.

The embodiment of the invention provides a video processor, a video processing method, video processing equipment, a storage medium and a program product. In the scheme, after the display layer receives the special effect style configuration, the algorithm engine layer calls the matched physical mathematical model according to the target special effect style and the basic video, outputs the high-fidelity special effect description file, and improves the special effect parameter accuracy; the rendering adaptation layer dynamically selects an optimal rendering engine according to the resources of all the rendering engines, and the time consumption of single-example rendering is shortened; two-layer hierarchical decoupling is adopted, so that description file generation and rendering execution are parallel, batch description files can be shared by multiple preview positions after being prepared at one time, rendering resources are only input when real preview requirements are met, and idling is avoided; the display layer, the algorithm engine layer, the rendering adaptation layer and the rendering layer are sequentially relayed to form a compact link of quasi-generation-fast rendering-playback, so that waiting and repeated export links of a user in a subsequent video editing stage are remarkably reduced, and the video editing efficiency is integrally improved.

The invention relates to the technical field of video special effect rendering, in particular to a video special effect high-quality rendering method, device and system in the film and television manufacturing process, and the method comprises the steps: carrying out the framing processing of a film and television video, and obtaining each frame of image; obtaining each angular point and each connected domain in each frame of image; obtaining the displacement fluctuation saliency of each angular point in each frame of image; acquiring a matched connected domain of each connected domain in each frame of image in the previous frame of image, and acquiring an adjacent frame abrupt change value of each connected domain by analyzing the contour difference and color difference between each connected domain and the matched connected domain thereof and combining the displacement fluctuation saliency of all angular points in each connected domain; clustering analysis is carried out through the adjacent frame abrupt change values of all the connected domains in all the frame images, and all suspected key frames are obtained; acquiring a key coefficient of each suspected key frame and a key change connected domain of each key frame; the invention aims to improve the quality of video special effect rendering by improving the recognition precision of the key frame.

The invention relates to the technical field of network live broadcast, in particular to a non-traditional video live broadcast system and method based on Web technology, the system comprises a server side, a user side and an anchor side, the server side comprises the following modules: a resource pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module and a video pre-loading module when the user side opens a live broadcast room corresponding to a certain anchor side; the core resources of the live broadcast room are preloaded to a user side through a Web technology; the core resources comprise a virtual role model, a scene background and a special effect; the information stream transmission module is used for obtaining a control instruction of the virtual role transmitted by the anchor side after the user side opens the live broadcast room and establishes connection with the live broadcast room, and forwarding the control instruction to the user side in real time, so that the user side renders the animation, audio and special effect of the virtual role according to the control instruction; the control instruction comprises an action instruction and a voice instruction. According to the invention, efficient and stable resource loading can be realized so as to achieve low-delay and smooth live broadcast experience.

The invention relates to an interface display method and device, equipment and a storage medium, and relates to the technical field of multimedia. The method comprises the steps of collecting music in a target space; acquiring mirror moving parameters based on at least one of rhythm features of the music and facial information, wherein the facial information comprises at least one of facial expressions and facial actions of an object in the target space; and displaying a live broadcast interface of the target space based on the mirror operation parameter, the live broadcast interface including a mirror operation effect corresponding to the mirror operation parameter. The mirror moving parameters are not artificially determined based on experience, but are obtained through real-time reasoning based on the music rhythm and the face information of the object during live broadcasting, so that the accuracy of the mirror moving parameters is obviously high, and the mirror moving special effect displayed by the live broadcasting interface is more visual and accurate. Moreover, according to the method, manual participation is not needed, a machine can automatically determine the accurate mirror operation parameters and display the live broadcast interface based on the determined mirror operation parameters, and the man-machine interaction efficiency is further improved.

The invention discloses a method, a system and a computer program product for generating a three-dimensional video. The method comprises the following steps of: receiving text input which comprises content describing a dynamic scene; a three-dimensional video generation process is interactively supervised through three intelligent agents, and the intelligent agents autonomously decide and execute actions conforming to physical rules in a three-dimensional environment through a physical perception intelligent agent module on the basis of a physical engine and a motion planning algorithm; meanwhile, action coherence is ensured through a time sequence optimization module; and the consistency of the generated content and the input description is ensured through the semantic verification module. Automatic generation of a dynamic scene is realized through intelligent agent simulation, high-quality three-dimensional video content can be interactively created, and the method can be widely applied to the fields of virtual reality, game development, movie and television special effects and the like. In addition, the invention further provides a corresponding generation device, a computer storage medium and an electronic equipment implementation scheme.