589 results about "Special effects" patented technology

The invention belongs to the technical field of visual special effects, and discloses an AI visual special effect dynamic generation system fusing multi-modal perception. Through cooperative work of six core modules of multi-modal input processing, importance analysis, parameter configuration, parameterized rendering, parameter optimization and rendering and output, deep fusion of special effects and contents is realized. An image sequence, audio data and scene parameters can be processed at the same time, a multi-modal feature data set is constructed, a scene key visual area is scientifically recognized, a visual importance distribution map is generated, and the special effect parameter configuration and rendering process is guided. An improved neural radiation field technology and a physical constraint model are adopted to ensure the consistency and reality of the special effect at different visual angles; and a multi-dimensional quality evaluation and parameter automatic optimization mechanism is introduced, so that the visual expressive force and the artistic value of the special effect are guaranteed. The creation threshold is remarkably reduced, the cooperative expression ability of the special effect and the content is improved, and the special effect becomes a powerful tool for enhancing the narration and enhancing the emotion.

Method for generating a live streaming video having real-time special effects starts with a processor displaying on a display device a lens selection user interface including a plurality of lens selections. The lens selections are associated with a plurality of special effects, respectively, and include a first lens selection associated with a first special effect and a second lens selection associated with a second special effect. The processor then receiving a selection of the first lens selection and applies in real-time the first special effect to a video stream captured by a camera to generate a video stream having the first special effect. The processor then transmits in real-time the video stream having the first special effect via a network to be displayed on a plurality of client devices. Other embodiments are disclosed.

The invention relates to the technical field of editing and special effect generation, in particular to a digital media content intelligent editing and special effect generation system based on artificial intelligence. Comprising a content understanding analysis module, an editing decision module, a special effect generation preview module, an audio processing module, a dynamic transition special effect module, a subtitle generation editing module, a virtual interaction module and a content distribution optimization module. The content understanding analysis module is used for video content identification and sentiment analysis; and the editing decision module is used for recommending an editing point and providing a dynamic editing strategy. The video content can be automatically analyzed, the editing point and the special effect adding position can be identified, the editing and special effect generation efficiency is greatly improved, the editing strategy and the special effect type can be dynamically adjusted according to the video content and the sentiment analysis result, the editing and the special effect can better meet the user requirement and the video content, and the user experience is improved. Abundant editing and special effect options are provided, and the editing and special effect generation process is simplified.

The invention discloses a method and system for generating a visual special effect video, and relates to the technical field of video generation, and the method comprises the steps: carrying out the collection and preprocessing of multi-modal data, synchronously collecting an RGB video, a depth map and environment illumination data, and generating a registered 3D point cloud; carrying out time-space domain combined motion compensation image matting, and extracting a moving object Alpha mask; by means of edge purification of self-adaptive illumination separation, illumination pollution and edge color overflow of a green screen scene are eliminated; the multi-scale transparency estimation network outputs a transparency graph; dynamic special effect synthesis and output guarantee video fluency; and the special effect video is intelligently recommended, and a self-adaptive output strategy is realized. The image matting and edge processing precision is improved, the transparency estimation and special effect synthesis effect is enhanced, intelligent recommendation and resource optimization are realized, and the defects in dynamic scene processing in the prior art are overcome.

The invention relates to the technical field of image processing, and further relates to a video decoding and unreal engine rendering method based on GPU full-link zero copy, which comprises the following steps of: 1, performing hardware decoding on an input video code stream on a GPU, and constructing a motion vector description buffer region for storing compressed domain motion vector information according to a macro block sequence; step 2, reading the motion vector description buffer area on the GPU through a calculation shader, and generating dynamic special effect control buffer areas in one-to-one correspondence with the macro blocks; and step 3, in a post-processing material of the unreal engine rendering module, taking the shared video texture resource as an input texture, and outputting a video picture. On the premise of not depending on a host processor and not excessively occupying video memory bandwidth, unified management of pixel data and motion data is achieved, delay is remarkably reduced, and special effect stability and direction consistency are improved.

The invention provides a meta-universe scene rapid construction method and system based on a modular engine, and relates to the technical field of meta universe, and the method comprises the steps: obtaining a creation instruction of a user for a meta-universe scene, and calling a corresponding scene rendering module from a preset modular engine library according to scene type information; performing feature extraction and scene layering on scene environment parameters based on a scene intelligent analysis model of deep learning, and analyzing the scene environment parameters into a plurality of scene function layers with a progressive hierarchical relationship; and calling a physical engine module, an illumination rendering module and an environment special effect module to construct a scene. Through the modular engine and the intelligent analysis model, rapid establishment of the meta-universe scene is realized, the scene establishment efficiency is improved, and the scene reality sense and the interaction experience are enhanced.

The invention relates to an AR card interaction method and system based on a user portrait and a dynamic matching algorithm, and the method comprises the steps: obtaining the materials of an IP card in the aspects of videos, 3D models and special effect resources, and constructing a user portrait database; identifying card features and associating a user account based on an AR module; according to the user portraits and the material labels, matching scores are calculated through a weighting formula, and a recommendation list is generated according to score sorting; loading the recommended material, and adjusting the special effect according to the 3D engine in combination with the environment data; and associating recommendation priorities according to the degrees of collecting, liking, commenting or purchasing the materials by the user, and updating the user portrait in real time. According to the method, a highly personalized effect is achieved by combining the user portrait and the environment data, the scene immersion is enhanced and the dynamic adaptability is improved by adjusting the recommended content and rendering the special effect in real time, and the viscidity is improved by supporting the user to actively participate in content selection and feedback, so that the interaction diversity is realized.

The invention discloses a multi-agent collaborative short play digital production system, which belongs to the technical field of artificial intelligence, and comprises a data and state management module driven by a digital thread, which uniformly manages and synchronizes data, states and decisions of all production links through a throughout digital thread; the full-process intelligent production module takes an intelligent control center as a core, decomposes and dispatches a complex task to five professional intelligent agents for cooperative execution, and covers a complete production link from script generation, visual preview, video shooting and special effects to intelligent editing and final sound and picture synthesis; the man-machine collaborative evaluation and feedback closed-loop module provides an interactive interface for human experts to supervise, guide and correct key production nodes and records artificial decisions as feedback to form a closed loop of a continuous optimization system; according to the multi-agent collaborative short play digital production system provided by the invention, the digital thread penetrates through multi-agent collaboration, so that data tracing and state synchronization of the whole process of short play production can be realized, challenges such as narrative continuity, cross-modal consistency and physical authenticity are effectively solved, and the quality of generated content and the production efficiency are remarkably improved.

To provide a game machine capable of enhancing amusement properties of a performance using a special image.SOLUTION: A game machine includes: suggestive performance execution means that can suggest that a game state is controlled to an advantageous state and can execute suggestive performances of a plurality of kinds in which degrees of expectation differ according to performance modes; particular image display performance execution means that can display a particular image; and special performance execution means that can execute a special performance for changing the suggestive performance executed in one performance mode to a performance mode with a degree of expectation higher than that of the one performance mode by using the particular image being displayed. The special performance execution means displays a particular correspondence image when the suggestive performance is executed, and executes the special performance in a mode that the particular image acts on the particular correspondence image.SELECTED DRAWING: Figure 294-8

The invention provides a multimedia file synthesis method and device, electronic equipment and a storage medium, and the method comprises the steps: decoding a first multimedia file to obtain video and audio frame data, constructing audio waveform data, and analyzing statistical parameters and a specific time interval average value of the audio waveform data; determining a control parameter to regulate and control the special effect output of the video frame, synthesizing target video data, combining the target frame and the audio frame to generate a second multimedia file, and dynamically displaying the special effect based on the audio content when the file is played; the video special effect can be controlled through audio data analysis, and the function of dynamically displaying rich visual effects according to the audio content when the multimedia file is played is achieved.

The invention discloses a WebGL-based Unity asset cross-platform preview method and system, and a storage medium. The preview method comprises the following steps: 1) preprocessing an editor plug-in: scanning a target asset through the Unity editor plug-in, extracting a resource GUID,. Meta metadata and a dependency relationship, generating a lightweight AB packet and adding a dynamic thumbnail; step 2) cloud dependency analysis: the server side recursively constructs a dependency tree based on GUID, filters redundant resources, and generates a resource loading list which can be identified by the browser side; and step 3) a WebGL rendering engine: loading an AB packet in a browser, realizing particle effect regeneration, animation control and scene interaction by simulating a Unity Runtime environment, and adapting to a WebGL 1.0 / 2.0 rendering pipeline. The invention aims to provide a WebGL-based Unity asset cross-platform preview method and system and a storage medium, aims to solve the problem that a browser cannot directly preview Unity resource files, and provides a set of resource management workflow based on Unity-cloud storage-browser preview for the Unity resource files.

The invention relates to a clinical surgery experiment virtual simulation teaching method and device, equipment and a medium. The method comprises the following steps: responding to an obtained teaching task configuration file; the teaching task configuration file comprises a clinical scene and an evaluation standard; calling a corresponding three-dimensional digital physiological model according to the teaching task configuration file, and performing special effect rendering according to the clinical scene to obtain a visual virtual simulation experiment scene; responding to the obtained user action data, performing real-time deformation on the three-dimensional digital physiological model, and generating feedback parameters; the feedback parameter is used for indicating the interaction control to work according to the feedback parameter; and comparing the user action data with preset standard expert action data, and generating a teaching evaluation result based on an evaluation standard. By adopting the method, high fidelity can be carried out on the whole process of clinical surgery experiment teaching, effective technical support is provided for medical skill teaching, and the method is suitable for multi-scene and multi-level medical teaching practice requirements.

The embodiment of the invention provides a video processor, a video processing method, video processing equipment, a storage medium and a program product. In the scheme, after the display layer receives the special effect style configuration, the algorithm engine layer calls the matched physical mathematical model according to the target special effect style and the basic video, outputs the high-fidelity special effect description file, and improves the special effect parameter accuracy; the rendering adaptation layer dynamically selects an optimal rendering engine according to the resources of all the rendering engines, and the time consumption of single-example rendering is shortened; two-layer hierarchical decoupling is adopted, so that description file generation and rendering execution are parallel, batch description files can be shared by multiple preview positions after being prepared at one time, rendering resources are only input when real preview requirements are met, and idling is avoided; the display layer, the algorithm engine layer, the rendering adaptation layer and the rendering layer are sequentially relayed to form a compact link of quasi-generation-fast rendering-playback, so that waiting and repeated export links of a user in a subsequent video editing stage are remarkably reduced, and the video editing efficiency is integrally improved.

The invention relates to the technical field of video special effect rendering, in particular to a video special effect high-quality rendering method, device and system in the film and television manufacturing process, and the method comprises the steps: carrying out the framing processing of a film and television video, and obtaining each frame of image; obtaining each angular point and each connected domain in each frame of image; obtaining the displacement fluctuation saliency of each angular point in each frame of image; acquiring a matched connected domain of each connected domain in each frame of image in the previous frame of image, and acquiring an adjacent frame abrupt change value of each connected domain by analyzing the contour difference and color difference between each connected domain and the matched connected domain thereof and combining the displacement fluctuation saliency of all angular points in each connected domain; clustering analysis is carried out through the adjacent frame abrupt change values of all the connected domains in all the frame images, and all suspected key frames are obtained; acquiring a key coefficient of each suspected key frame and a key change connected domain of each key frame; the invention aims to improve the quality of video special effect rendering by improving the recognition precision of the key frame.

The invention relates to the technical field of network live broadcast, in particular to a non-traditional video live broadcast system and method based on Web technology, the system comprises a server side, a user side and an anchor side, the server side comprises the following modules: a resource pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module and a video pre-loading module when the user side opens a live broadcast room corresponding to a certain anchor side; the core resources of the live broadcast room are preloaded to a user side through a Web technology; the core resources comprise a virtual role model, a scene background and a special effect; the information stream transmission module is used for obtaining a control instruction of the virtual role transmitted by the anchor side after the user side opens the live broadcast room and establishes connection with the live broadcast room, and forwarding the control instruction to the user side in real time, so that the user side renders the animation, audio and special effect of the virtual role according to the control instruction; the control instruction comprises an action instruction and a voice instruction. According to the invention, efficient and stable resource loading can be realized so as to achieve low-delay and smooth live broadcast experience.

The invention discloses a method, a system and a computer program product for generating a three-dimensional video. The method comprises the following steps of: receiving text input which comprises content describing a dynamic scene; a three-dimensional video generation process is interactively supervised through three intelligent agents, and the intelligent agents autonomously decide and execute actions conforming to physical rules in a three-dimensional environment through a physical perception intelligent agent module on the basis of a physical engine and a motion planning algorithm; meanwhile, action coherence is ensured through a time sequence optimization module; and the consistency of the generated content and the input description is ensured through the semantic verification module. Automatic generation of a dynamic scene is realized through intelligent agent simulation, high-quality three-dimensional video content can be interactively created, and the method can be widely applied to the fields of virtual reality, game development, movie and television special effects and the like. In addition, the invention further provides a corresponding generation device, a computer storage medium and an electronic equipment implementation scheme.

The invention discloses a special effect animation processing method and device, electronic equipment and a storage medium. The special effect animation processing method comprises the steps of obtaining a special effect animation comprising at least one special effect component; performing image rendering of the special effect animation based on the special effect component to play the special effect animation; in the playing process of the special effect animation, obtaining performance monitoring data of each special effect component, the performance monitoring data comprising a first parameter value of the special effect component under at least one preset performance influence parameter dimension; and according to each special effect component and the first parameter value of the special effect component under the at least one preset performance influence parameter dimension, determining a target comprehensive performance index of the special effect animation. On the basis, in the process of playing the special effect animation, the performance monitoring data of the special effect components forming the special effect animation are obtained, so that performance evaluation is carried out on the special effect animation in combination with different special effect components and the corresponding performance monitoring data, and the accuracy and efficiency of performance detection on the special effect animation are improved.

The invention relates to a short video stitching and distributing method, a program and a storage medium, the method comprises the following steps: constructing an intelligent layered material library, the intelligent layered material library comprises a six-dimensional material management system, which is respectively a frame picture material, a background video material, a dynamic patch material, a background music material, a transition special effect material and a dynamic text material; the dynamic combination duplicate removal engine realizes intelligent combination and duplicate removal of each material in the intelligent layered material library to generate a short video, and the dynamic combination duplicate removal engine adopts a double-factor duplicate removal mechanism of a frequency control module and a content detection module to ensure that the generated short video is unique in intelligent combination and content presentation of each material; and the intelligent distribution control system completes high-efficiency compliance distribution of short video contents through a multi-stage state circulation and real-time decision-making mechanism. Through large-scale commercial verification, the generation amount of a single template per hour is increased from 80 to 380, and the material reuse rate is reduced from 47% to 8.5%; the image content similarity is reduced from 61.2% to 4.3%, and the audio repetition rate is reduced from 58.7% to 2.1%.

The invention discloses a three-dimensional visualization display method, device, equipment and medium for a gas compressor test, and relates to the technical field of three-dimensional visualization, and the method comprises the steps: building a three-dimensional model of a test part in a gas compressor, defining motion logic based on the kinematics principle of the test part, and generating an animation sequence containing time-space attributes; and making a corresponding special effect resource for the target test part based on a particle special effect engine, inputting the animation sequence and data corresponding to the special effect resource into a three-dimensional model to establish a real-time mapping relationship between the test parameters and the three-dimensional model animation, determining the target test parameters, and performing dynamic three-dimensional visual display on the test part in the gas compressor. Light-weight model construction, data-driven animation mapping and a light-weight special effect system are organically fused, and real-time and accurate visual expression of kinematics characteristics of complex gas compressor test equipment is achieved.

The invention discloses a special effect rendering method and device, electronic equipment and a readable storage medium. The method comprises the steps of determining a first scene texture corresponding to a to-be-rendered virtual scene; the virtual scene comprises at least one virtual object represented by the target special effect to be rendered; determining a first special effect texture and a second special effect texture corresponding to the first scene texture; the first special effect texture is used for storing preset color information represented by the target special effect corresponding to each virtual object; the second special effect texture is used for storing initial special effect configuration information of target special effect performance of each virtual object; according to the first special effect texture and the second special effect texture, each virtual object in the first scene texture is rendered, and the second scene texture with the special effect information represented by the target special effect is obtained. According to the method, the operation overhead in the rendering process can be reduced, and the rendering performance consumption of the game is reduced.

The invention provides a short play subtitle translation system based on artificial intelligence, and relates to the technical field of artificial intelligence, and the system comprises a subtitle recognition module, an erasing module, a translation module and an output module, and can automatically recognize time information, position coordinates and visual style parameters of subtitles in a short play video. And generating a picture sequence without original subtitles in combination with the erasing processing, and translating the recognized original subtitle text into target language subtitles. The system generates target rendering parameters based on explicit style parameters and implicit style embedding vectors, realizes high restoration of fonts, strokes, shadows, gradient, transparency, textures and dynamic special effects, and performs adaptive adjustment according to target subtitle text features. Therefore, the visual consistency and culture adaptability of translated subtitles are improved in a short drama scene with complicated subtitle styles, frequent dynamic changes and obvious cross-culture differences, the audience impression is improved, and the manual post-processing workload is reduced.

The invention provides a video data generation method and device, an information display method and device and a program product. The video data generation method comprises the steps of obtaining original description information of a to-be-processed dish; according to the original description information, generating a video effect text description matched with the to-be-processed dish and a dish category label corresponding to the to-be-processed dish; and based on the original description information, the video effect text description and the category label, generating a display video frame of the to-be-processed dish by using a preset video generation model. According to the method, the dish display video frame is automatically generated, the visual attraction of the video frame is enhanced through the special effect, and the vividness, the generation efficiency and the quality of the dish display video frame are improved.

The invention discloses a movie and television examination system supporting multi-track customized playing and version switching, and relates to the technical field of movie and television examination systems, and the movie and television examination system comprises a cutting mirror module which carries out mirror identification based on editing and publishing of a timeline; the multi-track playing module adopts a visual multi-track layout and lists timelines and mirror results corresponding to synthesis, lamplight, special effects, animations and movie and television editing links; according to the method, the efficiency and quality of film reviewing work in film and television production can be greatly improved, by means of the multi-track customized playing and efficient version switching functions, film reviewing personnel can quickly and accurately recognize problems and put forward improvement suggestions, the production speed of film and television works is increased, and the film reviewing efficiency is improved. In addition, due to integration of personalized playing setting and a lens recognition function, the flexibility and the practicability of the system are further improved, and a brand-new film examination mode is provided for the film and television production industry.

This application relates to a physical special effect rendering method performed by a computer device. The method includes: obtaining physical special effect data of physical special effect particles emitted by a particle emission plug-in in a previous frame; obtaining a first target instance obtained by instantiating a scene management class; invoking, through the first target instance, a scene manager of a particle simulation tool to calculate motion state information of the physical special effect particles in a current frame based on the physical special effect data in the previous frame; and updating the physical special effect data in the previous frame based on the motion state information of the current frame to render a physical special effect in the current frame.

The invention provides a virtual space display method and device, equipment and a storage medium, and belongs to the technical field of computers. The method comprises the steps that a live broadcast event and interaction quantification information are displayed in a virtual space, the live broadcast event is an event that an anchor in the virtual space simulates a reference behavior, and the interaction quantification information is used for displaying a value obtained after quantification of the interaction behavior of audiences for the live broadcast event in the virtual space; when the interactive quantization information meets a target special effect display condition, a spatial special effect event is displayed in the virtual space, the target special effect display condition comprises at least one preset quantization value, and the spatial special effect event is used for representing that a virtual space special effect in the virtual space changes. The virtual space special effect is used for reflecting the interaction condition of the audience in the virtual space. According to the scheme, the audience can intuitively perceive the change of the visual environment of the virtual live broadcast room by the interaction behavior of the audience, so that the audience is upgraded from a bystander to an atmosphere co-building person of the virtual live broadcast room, and the experience of the audience in the virtual live broadcast room is remarkably improved.

The invention relates to a game map switching method and device, equipment and a medium. The method comprises the steps of determining a target object needing to be transmitted in a current map in a game scene in response to a map switching event, and keeping a motion state of the target object according to motion state information of the target object; loading a scene transition special effect to cover the game scene, displaying an additional transmission tool of the scene transition special effect, and rendering a target object to enable the target object to be mounted with the transmission tool; keeping a visual mounting effect of the transmission tool and the target object, transferring the target object to a barrier-free channel space between the current map and the target map, and clearing the current map and scene resources thereof; and completing loading of the target map and the scene resources thereof, controlling the target object to be transferred from the channel space to a landing point in the target map determined according to the motion state information, and clearing the scene transition special effect to completely expose the game scene. According to the method and the device, seamless and efficient map switching is realized, and the immersion and fluency of a game are remarkably enhanced.

The invention discloses a high-simulation audio-driven character expression generation method based on a multi-modal large model feedback mechanism, and aims to remarkably improve the expression generation precision and naturalness through the large model feedback mechanism. According to the method, firstly, through multi-scale speech feature extraction, multi-dimensional feature representation including audio detail feature vectors and global semantic vectors is generated, and complete capture of sound information is ensured; then, constructing a preliminary three-dimensional face geometric model based on the input image; thirdly, driving the three-dimensional face geometric model by using the audio data, so that the three-dimensional face geometric model generates an initial expression; finally, through a feedback mechanism of a large model, expression generation is optimized at specific interval steps; according to the method, a multi-mode large model feedback mechanism is introduced, so that the fidelity of expression generation, the naturalness of emotion transmission and the matching degree between the model and an input signal are effectively improved, and the method is widely applied to the fields of virtual character animation, movie special effects, game character driving and the like and has important application value.

To improve a player's convenience.SOLUTION: An information processing program allows a computer to execute processing for displaying a game medium in a first display area of a game screen on the basis of a player's operation, processing for starting a particular effect when a starting condition related to the particular effect is satisfied by using a game medium to which the particular effect is related, processing for relating a special effect corresponding to a particular effect to a player ID or a player character when the particular effect is started and when effect related to the player ID or the player character is less than a predetermined number, processing capable of starting a particular effect related to the player ID or the player character, and processing for displaying an effect display showing that a special effect is related to the player ID or the player character in a second display area of the game screen on the basis that the special effect is related to the player ID or the player character.SELECTED DRAWING: Figure 13

The method comprises: in response to a special effect triggering operation, sequentially collecting to-be-processed video frames; when a touch point on a display interface is detected, determining a target display position of the touch point in the to-be-processed video frames, and adding a target control object at the target display position; when a special effect playing condition is detected, sequentially determining display forms of the target control object; and controlling the target control object to display according to the corresponding display forms in the to-be-processed video frames. The technical solution provided in the embodiments of the present disclosure can determine the placement position of the target control object based on the triggering operation of the user, that is, the interaction effect between the user and the display interface is achieved. Furthermore, on the basis of meeting the special effect playing condition, each target control object can be controlled to display according to the corresponding display form, thereby improving the richness of the picture content.

The invention discloses a film and television later special effect intelligent rendering system and a rendering resource allocation method, the system adopts a four-layer architecture design, and comprises a data management layer, a copyright tracking layer, an intelligent rendering layer and a resource scheduling layer. The data management layer establishes a traceable training database, three-level copyright classification management is performed on training data, and each data sample is equipped with a unique digital identity identifier generated by an SHA-256 Hash algorithm. And the copyright tracking layer constructs a non-tampering copyright chain recording system by using a block chain technology. The intelligent rendering layer integrates a deep learning model based on a Transform architecture and a multi-mode copyright recognition engine, and adopts a layered rendering architecture to process data sources of different copyright risk levels. And the resource scheduling layer carries out dynamic resource allocation by adopting a Q-learning algorithm based on reinforcement learning. According to the method, the problem of copyright ownership of an intelligent rendering technology is solved, legal risks are remarkably reduced on the premise of ensuring the rendering quality, and a standardized copyright management system is established for the later-stage movie and television industry.