52 results about "Animation system" patented technology

A method of three-dimensional reconstruction of human heads using a single photo in the form of polygonal mesh, with animation and realistic rendering capabilities for novel head poses is provided. The method includes encoding, by using a first convolutional neural network, a single source image into a neural texture; estimating, by a pre-trained detailed expression capture and animation (DECA) system, a face shape, a facial expression, and a head pose by using the single source image and a target image, and providing an initial mesh; providing a predicted mesh of a head mesh based on the initial mesh and the neural texture; rendering a human image by using the predicted mesh.

The invention provides a virtual reality interaction method, electronic equipment, a storage medium and a program product. The virtual reality interaction method comprises the following steps: when interacting with a virtual world, fusing a skeleton posture captured by a motion with a skeleton posture of a virtual world animation system; a physical effect is added to the virtual world in an interaction process, so that a real interaction behavior is simulated in the virtual world. According to the method, the motion space of an operator is expanded to an infinite virtual world by fusing the skeleton posture captured by the motion with the skeleton posture of the virtual world animation system, and the reality of interaction is enhanced by adding a physical effect to the virtual world, so that the purposes of improving the reality of user interaction and expanding the motion mapping space are achieved.

Systems and methods are provided for enhanced animation generation based on generative modeling. An example method includes training models based on faces and information associated with persons, each face being defined based on location information associated with facial features, and identity information for each person. The modeling system being trained to reconstruct expressions, textures, and models of persons.

Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.

Systems and methods are provided for enhanced animation generation based on generative modeling. An example method includes training models based on faces and information associated with persons, each face being defined based on location information associated with facial features, and identity information for each person. The modeling system being trained to reconstruct expressions, textures, and models of persons.

The invention relates to a mechanical disassembly and assembly animation generation method and device of mechanical equipment and a storage medium, and belongs to the technical field of mechanical overhaul, and the method comprises the steps that based on a configuration file corresponding to a target model, an interaction mode of the target model is added; the target model is a model corresponding to the disassembly and assembly steps of the mechanical equipment to be disassembled and assembled for maintenance; based on the interaction mode, generating an animation path corresponding to the target model; and based on a preset preview mode and the animation path, generating a mechanical dismounting animation of the mechanical equipment to be dismounted and maintained. According to the mechanical assembly and disassembly animation generation method of the mechanical equipment, the system can efficiently and accurately generate the mechanical assembly and disassembly animation meeting the assembly and disassembly maintenance requirements by reading the configuration file, adding the interaction mode, generating the animation path and previewing the animation, the mechanical assembly and disassembly animation generation process is complete, and the mechanical assembly and disassembly animation generation efficiency is improved. Powerful support is provided for teaching, training and on-site operation, and important application values are provided for scenes such as maintenance training, operation instructions and virtual demonstration of mechanical equipment.

A synthetic lifelike behavioral character animation system and methods for simulating lifelike behavior in an animated character. The system provides simulated lifelike character behavior for use in a variety of interactive contexts such as AI interactive agents, video games, and metaverse-type experiences. The system processes contextual information and generates behavioral outputs that drive character animation that is lifelike and believable in nature.

The invention provides a cluster animation generation method and device, electronic equipment and a storage medium, and relates to the technical field of animation rendering. The method comprises the following steps: acquiring skeleton animation data of a role; calculating and updating vertex data on a GPU (Graphics Processing Unit) on the basis of the skeletal animation data, and generating a vertex texture and a static grid body; applying the position texture map and the normal texture map to the static grid body to obtain a role attitude; material control parameters corresponding to the static grid bodies of the application position texture map and the normal texture map are linked to a Niagara particle system; and repeatedly executing the steps S1-S4, and generating a cluster animation containing a plurality of roles. According to the cluster animation generation method, the problem that a large number of resources are consumed when a traditional skeleton animation system is used for generating the cluster animation is solved, on the premise that the equipment performance is not improved, resource occupation is greatly reduced, and the effect of improving the manufacturing efficiency and the manufacturing quality is achieved.

Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.

Animation systems including an expressive deformation model configured to transform expression settings, pose settings, and a template mesh into an animatable mesh, a first generator branch configured to transform identity controls for the animatable mesh into base Gaussian attributes, a second generator branch configured to transform detail controls for the animatable mesh into residual Gaussian attributes, the system configured to embed the base Gaussian attributes and residual Gaussian attributes in UV maps of the animatable mesh and to combine the UV maps and the animatable mesh to form an animatable Gaussian representation of an object to animate.

The invention relates to the technical field of video synthesis, and discloses an efficient sign language video synthesis system which comprises a data uploading and processing module, a natural language processing module, an action code generation module, an action optimization module, a virtual human animation system, a user interface and a display module. The data uploading and processing module is used for receiving and preprocessing text, voice input, keyboard input and handwriting input provided by a user; the natural language processing module is used for performing word segmentation, part-of-speech tagging and semantic understanding on an input text, translating the input text into a sign language symbol sequence, and enhancing understanding in combination with multi-modal data; and the action code generation module is used for predicting and generating a sign language action sequence by using a time sequence model and a generative adversarial network, and generating expressions and body languages based on text emotion. By combining text and video data, richness and accuracy of sign language translation are remarkably improved, and the generated sign language video can be closer to a real communication scene.

The invention discloses an audio driven facial animation supporting varying identity and speaking styles. In various examples, systems and methods are disclosed for animating a virtual or digital actor or image using audio-driven animation. The system may identify an animation of the grid corresponding to the audio data and the indication of the speaking style. The system may generate a plurality of vertex increments using animations and neutral gestures of the grid. The system may update the machine learning model using the plurality of vertex increments, the audio data, and the indication of the speaking style to generate an output vertex increment for the grid given an input speaking style and input audio data.

Systems and methods for realistic real-time portrait animation are provided. An exemplary method includes receiving a scene video having at least one input frame. The input frame includes a first face. The method further includes receiving a target image having a second face. The method further includes determining a two-dimensional (2D) deformation based on the at least one input frame and the target image, wherein the 2D deformation, when applied to the second face, modifies the second face to mimic at least a facial expression and a head orientation of the first face. The method further includes applying the 2D deformation to the target image by a computing device to obtain at least one output frame of an output video.

Mechanical automaton (10) comprising a manual control member (12) and a mechanical animation system (14), the manual control member (12) comprising a gripping element (16) attached to the automaton (10) and configured so that its rotation along a principal direction (X16) relative to the frame (11) of the automaton (10) causes the animation mechanism (14) to rewind, in a first configuration, the manual control member (12) is integrated inside the mechanical automaton (10) so that it is not manually accessible, the mechanical automaton (10) includes a locking device (20) configured to allow the translational release of the gripping element (16) along the principal direction (X16), from the inside to the outside of the mechanical automaton (10),so as to switch the mechanical automaton (10) from the first configuration to a second configuration in which the gripping element (16) is manually accessible.

Systems and methods for avatar eye animation is provided. The method include obtaining a first gaze vector of a user associated with a first eye of the user and obtaining a second gaze vector of the user associated with a second eye of the user. The method further includes determining a first point in a three-dimensional (3D) virtual space that the user is looking toward. The method also includes creating a second point in the 3D virtual space corresponding to the first point in the 3D virtual space. The method then includes rendering a first eye and a second eye of an avatar of the user in the 3D virtual space based on the second point in the 3D virtual space such that the first eye and the second eye of the avatar are looking toward the second point in the 3D virtual space.

Systems or methods for presenting or generating an animated realization of one or more letter glyphs based on progressively exposing a continuous mapping of brush head shapes following a letterform stroke order. A machine-learning model is used to generate animation metadata from the one or more letter glyphs. The animation metadata including a centerline, the continuous mapping of brush head shapes that is used to sweep along the centerline, and the letterform stroke order to generate the animated realization of the one or more letter glyphs.

The present invention provides a virtual reality interaction method, electronic device, storage medium and program product. The virtual reality interaction method includes: when interacting with a virtual world, fusing the motion-captured skeletal posture with the skeletal posture of a virtual world animation system; adding physical effects to the virtual world during the interaction process, thereby simulating real interactive behavior in the virtual world. By fusing the motion-captured skeletal posture with the skeletal posture of the virtual world animation system, the operator's motion space is expanded to an infinite virtual world, and by adding physical effects to the virtual world, the authenticity of the interaction is enhanced, thereby achieving the purpose of improving the realism of user interaction and expanding the action mapping space.

Systems and methods for single image-based body animation are provided. An example method includes receiving an input image including an image of a body of a person, fitting a model to the image of the body of the person, where the model is configured to receive a set of pose parameters corresponding to a pose of the body and generate, based on the set of pose parameters, an output image including an image of the body adopting the pose, receiving a further set of pose parameters corresponding to a further pose of the body, providing the further set of pose parameters to the model to generate the output image of the body adopting the further pose, and generating, based on the output image, a frame of an output video including the output image.

The embodiment of the invention provides a music playing animation display method and device, a vehicle, a storage medium and a product. Under the condition that music in a car pet mode is in a playing state, acquiring an animation configuration file, determining a plurality of target visual elements, randomly generating an attribute value of each target visual element, and respectively determining an initial position of each target visual element based on a canvas size, an element size of each target visual element and a motion path parameter, the initial positions of different target visual elements are not overlapped and do not exceed a canvas area corresponding to the canvas size; based on the single cycle duration of each target visual element, determining the initial motion time of different target visual elements; and generating a music playing animation based on the attribute values, the initial positions and the initial motion time of the different target visual elements. According to the embodiment of the invention, the animation generation scheme is flexible and configurable, the visual sense is natural and vivid, and an iterative vehicle-mounted pet mode music playing animation system is convenient to maintain.

A video animation system can include at least one processor and at least one computer-readable storage medium having encoded thereon instructions that, when executed by the at least one processor, cause the at least one processor to perform operations. The operations can include generating a first frame of a video including a first avatar wherein the first avatar has a first gaze direction and / or a first pose; generating a second frame of the video, wherein the first avatar has a second gaze direction and / or a second pose, wherein the second gaze direction and / or second pose is based on a plurality of environmental features of the first frame, the environmental features including one or more emotional environmental features of the first frame and / or one or more social environmental features of the first frame; and outputting the first and second frames. Various other methods and systems are also disclosed.

An animation system configured for generating an animation scene that includes at least one animation stylization effect applied to one or more three-dimensional digital objects is described. The animation system includes an interface having a timeline portion and a node graph portion. The timeline portion represents various animation stylization effects as clips arranged chronologically relative to a timeline and the node graph portion includes a node cluster for each clip, where individual node clusters are made up of an animate node, an action node, and an effect node. Input at the timeline portion modifying at least one parameter of the animation scene propagates to the node graph portion, and vice versa. The animation system thus presents dual representations of an animation scene in a manner that enables complex animation customizations while organizing animation effects in a simplified, chronological manner.

The invention discloses a dynamic three-dimensional data conversion method based on an open dynamic asset format, which solves the defects of the existing animation format in the aspects of compatibility, expansibility, file volume and dynamic support through a modularized layered structure, a dynamic animation system, physical and animation fusion, cross-medium compatibility, safety cooperation and efficient analysis technology. The converted data supports hierarchical compression, nodal program logic, real-time physical interaction and multi-platform efficient decoding, is suitable for the fields of games, movies and televisions, VR / AR and the like, and has remarkable technical advantages.

Embodiments relate to a method for real-time facial animation, and a processing device for real-time facial animation. The method includes providing a dynamic expression model, receiving tracking data corresponding to a facial expression of a user, estimating tracking parameters based on the dynamic expression model and the tracking data, and refining the dynamic expression model based on the tracking data and estimated tracking parameters. The method may further include generating a graphical representation corresponding to the facial expression of the user based on the tracking parameters. Embodiments pertain to a real-time facial animation system.

The invention relates to an electronic hanging watch integrated with a Murphy dripping speed animation system, which comprises a shell, a mainboard, a storage battery, a display screen and a control button, and an intelligent control system is embedded in the mainboard. The intelligent control system comprises a time management module, an animation generation module, a user interaction module and an optimization control module. The time management module generates real-time time data, the animation generation module calculates a dynamic display track based on the time data and realizes a Murphy dripping speed effect of a second hand animation, and the user interaction module receives user input and is used for setting parameters such as an animation mode, frequency and intensity and customizing an animation effect. The optimization control module adjusts the animation frequency through residual calculation, and ensures the animation fluency and the time display accuracy. The display screen adopts a high-refresh-rate flexible OLED screen, and the second hand animation effect is dynamically rendered. According to the invention, the Murphy dripping speed animation is creatively combined with the electronic hanging watch, so that the aesthetic property and interestingness of the hanging watch are improved.

Systems and methods are provided for enhanced animation generation based on generative modeling. An example method includes training models based on faces and information associated with persons. The modeling system being trained to reconstruct expressions, textures, and models of persons.

The invention discloses a multi-feature fusion audio-driven three-dimensional face animation system and an operation method, and aims to solve the problems of uncontrollable animation style, identity leakage and uncoordinated action caused by content and style coupling in the prior art. The system comprises: an audio factorization coding module for decoupling an input audio into a sequential content representation and a global style representation; and a hierarchical style modulation generator module. The generator takes a learnable initial attitude as a substrate, firstly carries out accurate time sequence deformation conforming to pronunciation logic according to content representation, then generates affine transformation parameters by utilizing style representation, carries out layered style injection on the deformation process through adaptive instance normalization (AdaIN), and finally generates a collaborative and unified animation. Through thorough decoupling and controllable recombination of contents and styles, free editing and migration of animation emotions and identity styles are realized, and the sense of reality, expressive force and controllability of animations are remarkably improved.

An avatar animation system is provided herein. The avatar animation system receives first video data of a user that includes a depiction of a face of the user. The avatar animation system generates a model of the user based on the first video data. The avatar animation system receives an indication that the user is participating in a video conference call via a computing device and receives second video data of the user associated with the video conference call. The avatar animation system identifies one or more video alteration triggers based on one or more of the second video data, the video conference call, or the computing device. The avatar animation system determines that the second video data is to be altered based on the identified video alteration triggers and alters the depiction of the user before the second video data is received by other computing devices associated with the conference call.

The present disclosure relates to systems, methods, and non-transitory computer readable media that utilizes neural networks to generate cinemagraphs from single RGB images. For example, the cyclic animation system includes a cyclic animation neural network trained with synthetic data, wherein different wind effects can be replicated using physically based simulations to create cyclic videos more efficiently. More specifically, the cyclic animation system generalizes a solution by operating in the gradient domain and using surface normal maps. Because normal maps are invariant to appearance (color, texture, illumination, etc.), the gap between synthetic and real data distribution in the normal map space is smaller than in the RGB space. The cyclic animation system performs a reshading approach that synthesizes RGB pixels from the original image and the animated normal maps to create plausible changes to the real image to create the cinemagraph.

The application provides a kind of based on 3D virtual space's realistic embodied AI interaction system and its implementation method, belong to artificial intelligence and virtual reality technical field, the system includes: open object visual space positioning system, for identifying the environmental information under current visual angle / panoramic field of view by visual language model;Hierarchical memory and narrative memory generation system, for establishing hierarchical memory architecture, store the memory information corresponding to conversation;Director engine and context assembly system, for assembling structured context information, task reasoning is carried out by director engine;Natural language driven multi-track generative animation system, for arranging time sequence to multiple track instructions by large language model, and compiling into target instruction;In front-end analysis and execution the target instruction, generate the animation sequence of the role.The AI interaction system of the application has visual perception, autonomous space movement, emotional state expression and continuous behavior control ability, and improves the sense of reality.

This disclosure describes a vehicle-icon-animation system that determines render orientations for rendering a vehicle icon to represent a public transportation vehicle traveling along a predicted route. For example, based on analyzing public transit information, the disclosed systems can determine render orientations corresponding to locations of a public transportation vehicle along a predicted route. In addition, the disclosed systems can render (or cause a client device to render) a vehicle icon to portray the public transportation vehicle pointing in different render orientations at various locations along the predicted route. Further, the disclosed systems can update the vehicle icon to render it in a new location within a graphical map display based on updated public transit information.