497 results about "Anime" patented technology

The invention provides a game cartoon character display method based on a virtual reality technology. The method comprises the following steps: acquiring three-dimensional model data of a game cartoon character in a target display area through a user interaction terminal; the virtual reality content management platform determines a dynamic rendering precision level according to the model data, and generates a real-time rendering strategy including a model patch reduction coefficient, a texture compression rate and a skeleton animation updating frequency in combination with terminal performance parameters; the strategy is sent to a virtual reality supervision platform and a user interaction terminal, and a virtual reality rendering engine platform is instructed to execute real-time rendering; and the virtual reality supervision platform monitors the frame rate fluctuation data of the head-mounted display device, calculates the scene rendering stability, sends a rendering optimization instruction if the scene rendering stability is lower than a threshold value, and adjusts the model data acquisition frequency and the video memory cleaning period to optimize the performance. The rendering efficiency and the system stability can be improved, and the hardware load and the frame rate fluctuation are reduced.

Systems and techniques for generating and animating non-player characters (NPCs) within virtual digital environments are provided. Multimodal input data is received that comprises a plurality of input modalities for interaction with an NPC having a set of body features and a set of facial features. The multimodal input data is processed through one or more neural networks to generate animation sequences for both the body features and facial features of the NPC. Generating such animation sequences includes disentangling the multimodal input data to generate substantially disentangled latent representations, combining these representations with the multimodal input data, and using a large-language model (LLM) to generate speech data for the NPC. Further processing using reverse diffusion generates face vertex displacement data and joint trajectory data based on the combined representation and generated speech data. The face vertex displacement data, joint trajectory data, and speech data are used to produce an animated representation of the NPC, which is then provided to environment-specific adapters to animate the NPC within a virtual digital environment.

The invention discloses an animation script automatic generation method and system, a storage medium and a program product, and the method comprises the steps: extracting a scene element set, a plot element set and a role element set in a static text; generating an element association graph containing weights; calculating the content matching degree of each element in the element association graph and each plot unit; selecting a core plot unit; calculating a semantic vector included angle cosine value between the core plot units as a semantic association degree, and constructing a plot unit association network by taking the semantic association degree as a connection weight; determining a plot development main line between the core plot units; determining an extended core plot unit; according to weight distribution of role elements in the element association graph, distributing corresponding roles for the extended core plot unit and generating role dialogue content to obtain a final core plot unit; and integrating the final core plot unit according to a preset animation script format to generate an animation script text. According to the method, the correlation between the generated script and the result required by the user is improved.

The embodiment of the invention provides a character animation generation method and device based on voice driving, equipment and a medium, and belongs to the technical field of financial science and technology. The method comprises the following steps: acquiring an audio signal input by a user, a target human portrait picture and a target scene reference video; encoding the audio signal to obtain an audio code; generating a three-dimensional face model motion coefficient according to the portrait picture of the target person and the audio code; extracting blink information and head posture information from the target scene reference video; correcting the motion coefficient of the three-dimensional face model according to the blinking information and the head posture information to obtain a corrected motion coefficient of the three-dimensional face model; and taking a three-dimensional deformable head model as a potential vector, mapping the three-dimensional deformable head model to the corrected three-dimensional face model motion coefficient frame by frame, converting the three-dimensional face model motion coefficient into a video frame, and generating a head speech video of the target person. According to the embodiment of the invention, the quality and reality of character animation generation driven by voice can be improved.

Generation of avatar animations for virtual environments using motion modifiers. In some implementations, a computer-implemented method includes determining a base animation defined by animation curves that each include position values that indicate positions of an associated portion of an avatar at points of time. One or more motion modifiers and parameters therefor are determined, each motion modifier composed of one or more modification primitives configured to modify respective animation curves of the base animation that are associated with respective portions of the avatar. A modified animation is generated by applying the motion modifiers to the base animation, where each of the modification primitives of each motion modifier modifies a respective animation curve for an associated portion of the avatar based on the parameters of the motion modifiers.

The invention discloses a 3D animation model intelligent generation method based on image recognition, and relates to the technical field of 3D animation models.Physical accuracy and visual fidelity of mechanical arm animation are remarkably improved through a multi-view feature fusion and physical constraint fusion mechanism; the space-time convolution kernel module is combined with mechanical kinematics constraint to effectively inhibit action distortion under high-speed motion; a dynamic anti-aliasing algorithm and a speed-adaptive LOD strategy are subjected to collaborative optimization, and edge aliasing and fuzzy mismatching are eliminated while the calculation load is reduced; external vibration data are converted into microscopic deformation through a micro-amplitude displacement superposition technology, and the limitation of traditional deformation simulation is broken through.

The invention relates to the technical field of generative artificial intelligence, and particularly provides a film and television animation scene rapid generation method and system combined with an AI algorithm, and the method comprises the steps: firstly receiving scene description text input, carrying out the semantic analysis, obtaining a scene element set and element association features, and then calling a pre-trained scene resource matching model, matching a scene resource combination in a multi-modal resource library according to an analysis result, then performing spatio-temporal layout optimization on the resource combination, generating a layout adjustment parameter and a dynamic adjustment parameter, constructing a three-dimensional space topological structure according to the layout adjustment parameter and the dynamic adjustment parameter, and rendering to generate a target animation scene frame sequence, and finally, synchronously calibrating the target animation scene frame sequence and a preset plot time axis, and outputting a complete animation scene flow, thereby improving the efficiency and accuracy of movie and television animation scene generation by means of an AI algorithm, and realizing rapid and intelligent scene generation highly conforming to the plot.

Methods, devices, media, and other embodiments are described for generating, modifying, and outputting pseudorandom animations that can be synchronized to audio data. In one embodiment, a computer animation model made up of comprising one or more control points is accessed by one or more processors, which associate motion patterns with a first control point of the one or more control points, and associate one or more speed harmonics with the first control point. A set of motion states is identify with a motion state for the combinations of possibilities, and a probability value is assigned to each motion state of the set of motion states. The probability value can be used to probabilistically determine a particular motion state to be part of displayed animation for the computer animation model.

The invention provides an animation generation method and device and electronic equipment, and relates to the field of animation production. The method comprises the following steps: acquiring an original image and a target mask image; acquiring action description information, wherein the action description information is used for describing an action expected to be made by the animation character; inputting the action description information into an action generation model to obtain an action file; extracting the animation character from the original image by using the animation character area in the target mask image, and binding the joint part points of the animation character with the joint motion information of each frame to generate a target animation; the target animation is used for displaying the motion described by the motion description information made by the animation figure. The problem that the difficulty of a method for generating animations based on pictures is too high in the prior art is solved.

A loading animation implementation method, a hybrid development application and a storage medium, the method comprising: when an instruction for opening a page input by a user is received, selecting a type of loading animation from preset loading animation types as a current loading animation, and starting the current loading animation; and after an instruction that loading of the native page in the current page and the web sub-page nested in the native page is completed is received, closing the currently loaded animation. According to the animation loading implementation method of the scheme, only one loading animation is displayed in the page loading process of the mixed development application, and compared with a traditional animation loading implementation mode of the mixed development application, the animation loading implementation method of the scheme has the advantages that the animation loading process is greatly simplified, and the animation loading efficiency is improved. And the problems of double loading animations, white screen, slow playing of loading animations, disordered calling of various animations and the like in a traditional animation loading mode are also avoided.

The invention provides a portrait animation generation method, device and system based on audio driving and a medium. The method comprises the following steps: acquiring a figure picture and animation voice data; inputting the character picture and the animation voice data into an animation generation model to obtain a portrait animation video output by the animation generation model; wherein the animation generation model is obtained by training according to a character picture sample and a motion label and a video sample corresponding to the character picture sample; and the animation generation model is used for extracting picture features according to an input figure picture, extracting audio features according to input animation voice data, performing stream matching in combination with an emotion tag predicted based on the audio features, predicting a corresponding video frame based on a potential feature sequence obtained based on a stream matching result, and obtaining a portrait animation video. According to the method, the video can be quickly generated, and natural emotion expression, consistent time sequence and stable generation of the video are ensured.

The invention provides an interactive three-dimensional animation generation method, and relates to the technical field of interactive three-dimensional animations. The interactive three-dimensional animation generation method comprises the following steps: data preparation: collecting and preparing a three-dimensional animation data set for training a deep learning model, including a model, an animation sequence and user interaction data; deep learning model training: using the three-dimensional animation data set to train a deep learning model; interactive animation generation: automatically generating a three-dimensional animation sequence by using the trained deep learning model according to user input; and interactive control: adjusting and controlling the generation of the three-dimensional animation in real time through interactive data input by the user, and realizing the interaction between the user and the animation. By using the deep learning model, the three-dimensional animation can be automatically generated, the workload of manual modeling and animation production is reduced, meanwhile, the three-dimensional animation can be dynamically generated and adjusted according to real-time input of a user, high interactivity is provided, and the user can directly participate in the animation creation process.

The objective is to provide a secure electronic online system featuring technology that enables users to utilize deepfake and voice-changing technology. This technology allows for the replacement of the original cast's face, color, figure, voice, accent, or language in movies, television series, reality shows, animations, music videos, and video games with their own, celebrities', or other individuals' features. The system is designed to integrate seamlessly with various streaming services and platforms for the purpose of selecting and modifying movies, television series, reality shows, animations, music videos, and video games.

The invention relates to the technical field of network live broadcast, in particular to a non-traditional video live broadcast system and method based on Web technology, the system comprises a server side, a user side and an anchor side, the server side comprises the following modules: a resource pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module, a video pre-loading module and a video pre-loading module when the user side opens a live broadcast room corresponding to a certain anchor side; the core resources of the live broadcast room are preloaded to a user side through a Web technology; the core resources comprise a virtual role model, a scene background and a special effect; the information stream transmission module is used for obtaining a control instruction of the virtual role transmitted by the anchor side after the user side opens the live broadcast room and establishes connection with the live broadcast room, and forwarding the control instruction to the user side in real time, so that the user side renders the animation, audio and special effect of the virtual role according to the control instruction; the control instruction comprises an action instruction and a voice instruction. According to the invention, efficient and stable resource loading can be realized so as to achieve low-delay and smooth live broadcast experience.

The invention provides a transition video generation method, a virtual character video switching method, devices and equipment, and is applied to the technical field of artificial intelligence. The transition video generation method comprises the steps that a first animation video and a second animation video are acquired, and the first animation video and the second animation video are different animation videos of the same virtual character; determining an interruption time point on a time axis of the first animation video; and according to the video frame at the interruption time point and the video frame in the second animation video, generating a transition video corresponding to the interruption time point, the transition video being used for a transition stage of switching from playing of the first animation video to playing of the second animation video. Therefore, the fluency of virtual character animation video switching is improved by setting the interruption time point and generating the transition video in advance.

The invention relates to the technical field of animation generation, in particular to an animation generation method based on AIGC. The method comprises the following steps: inputting a text corresponding to a story outline and an optimal cue word into a script generation model, and outputting a script text; respectively constructing a semantic relation graph and a spatial relation graph based on the phrase features and the object region features; calculating the similarity of the text images according to an integration result, judging whether the similarity exceeds a preset similarity threshold, and if yes, outputting a pre-generated scene image; and inputting a pre-generated scene image into the animation generation model, and outputting an initial animation video: generating a sound effect and background music of the initial animation video by adopting the optimal cue word combination, and automatically editing the generated animation to export a final animation file. According to the method, the animation creation efficiency and quality can be remarkably improved, the manufacturing cost is reduced, high customizability and expandability are achieved, and personalized customization and expansion can be carried out according to the requirements and preferences of users.

Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.

The application discloses various systems and methods for generating and utilizing computer animation transition methods and systems in the leveling of a video to an upright, earth normal orientation which may be used in pipe inspections. Such computer animation transitions may be generated from a single inspection image at one time in the inspection video or from subsequent inspection images at different times and points in space in the inspection video. Some leveling methods may include rotating a square GL surface in ninety degree increments that includes one or more computer animation transition. Other leveling methods may also include rotating a three dimensional GL surface that is shaped to match the shape of the pipe that includes one or more. Further methods may include rotating a GL surface that is a regular polygon in shape that includes one or more computer animation transition.

The utility model relates to the technical field of copyboards, and discloses an animation copyboard which comprises a shell, ground glass arranged on the shell, a lamp box arranged below the ground glass and located in the shell, a first clamping mechanism and a second clamping mechanism. The second clamping mechanism comprises an extrusion roller and a sliding assembly, the extrusion roller makes contact with the upper surface of the ground glass, and sliding grooves allowing the sliding assembly to slide are formed in the two sides of the shell; the sliding assembly comprises a sliding column, a connecting column and a spring; a movable cavity for the connecting column to slide is formed in the top of the sliding column, a sliding shaft matched with the sliding groove is formed on the side wall of the sliding column, the spring is fixedly installed in the movable cavity, the top end of the spring is fixedly connected to the bottom of the connecting column, and the bottom end of the spring is fixedly connected to the cavity bottom of the movable cavity. The problem that when original manuscript paper and blank paper are clamped by a copyboard in the prior art, a gap exists between the original manuscript paper and the blank paper, and the copying effect is affected is solved.

A device that creates animation via the illumination of various LEDs through a film into which an image is cut. The film includes an image cut therein. The device includes a housing with a housing compartment formed by the film connected to a base via a wall. Secured within the housing compartment is a divider, which divides the compartment into a first and second chamber. A printed circuit board is secured within the compartment and includes a first and second LED, wherein the first LED is secured within the first chamber and the second LED is secured within the second chamber. A microcontroller unit controls the illumination of the first and second LEDs in conjunction with sound either from a microphone or a speaker to animate the image cut into the film.

A synthetic lifelike behavioral character animation system and methods for simulating lifelike behavior in an animated character. The system provides simulated lifelike character behavior for use in a variety of interactive contexts such as AI interactive agents, video games, and metaverse-type experiences. The system processes contextual information and generates behavioral outputs that drive character animation that is lifelike and believable in nature.

The embodiment of the invention discloses an animation generation method and device, computer equipment and a storage medium, and belongs to the technical field of computers. The method comprises the steps of performing semantic analysis through a large language model, and determining a first text segment and a first semantic tag in a speaking text; searching a first animation matched with the first semantic tag from an animation library, wherein the semantics expressed by the virtual character in the first animation is matched with the semantics expressed by the first semantic tag; the audio segment corresponding to the second text segment is processed through an animation generation model to obtain a second animation, the second animation comprises an animation corresponding to the second text segment, and the rhythm of the virtual character in the animation corresponding to the second text segment is matched with the speaking rhythm of the second text segment; and generating a target animation of the virtual character based on the first animation and the second animation. According to the method and the device, the animation which is semantic-matched and rich in rhythm sensation is generated, the amount of information contained in the animation is enriched, and the animation playing effect is improved.

Systems and techniques for generating and animating non-player characters (NPCs) within virtual digital environments are provided. Multimodal input data is received that comprises a plurality of input modalities for interaction with an NPC having a set of body features and a set of facial features. The multimodal input data is processed through one or more neural networks to generate animation sequences for both the body features and facial features of the NPC. Generating such animation sequences includes disentangling the multimodal input data to generate substantially disentangled latent representations, combining these representations with the multimodal input data, and using a large-language model (LLM) to generate speech data for the NPC. Further processing using reverse diffusion generates face vertex displacement data and joint trajectory data based on the combined representation and generated speech data. The face vertex displacement data, joint trajectory data, and speech data are used to produce an animated representation of the NPC, which is then provided to environment-specific adapters to animate the NPC within a virtual digital environment.

The embodiment of the invention discloses a voice action synchronization method and device for a virtual character, equipment and a storage medium, and relates to the technical field of artificial intelligence, and the method comprises the steps: carrying out the voice generation of an answer text, obtaining an answer voice sequence and the attribute information of each phoneme, determining a standard mouth shape identifier of the corresponding phoneme based on the phoneme identifier of each phoneme, and obtaining a voice action synchronization result; generating a mouth shape animation sequence based on the standard mouth shape identifier of each phoneme according to the time range of each phoneme; determining an emotional action sequence and an emotional action starting timestamp corresponding to the emotional label of the answer text, and generating a supplementary animation sequence based on the emotional action sequence and the emotional action starting timestamp; and synchronizing the answer voice sequence, the mouth shape animation sequence and the supplementary animation sequence according to the time sequence to obtain a synchronization relationship, and driving the virtual response character of the user based on the synchronization relationship, the mouth shape animation sequence and the supplementary animation sequence when the answer voice sequence is played, so that the voice action synchronization function of the virtual character is realized.

The invention provides a method and a system for generating a skeleton by matching animation data, and belongs to the technical field of animation character construction. Comprising the following steps that S1, biological skeletons of a role are established, and the biological skeletons at different positions have unique codes and the same initial length but are not completely the same in shape; s2, constructing a complete skeleton model; s3, adjusting the length of each biological skeleton according to the height of the role and whether the next section of adjacent biological skeleton exists or not; and S4, according to the pose matrix of the corresponding biological skeleton in each frame of character animation data, the animation data uses the same coding mode as the biological skeleton, the corresponding biological skeleton in the skeleton model is adjusted to the corresponding position, and a biological skeleton image of each frame is generated. According to the method, a certain number of biological skeletons are preset and sequentially coded, the number and the positions of the biological skeletons are adjusted according to the body type, the biological skeleton combination structure conforming to the character image is constructed, and the skeleton animation file of the character is further obtained.

The invention relates to the technical field of movie and television animation production, in particular to a movie and television animation character expression generation method and system combined with motion capture, and the method comprises the steps: firstly collecting a real-time motion data set of a target actor through motion capture equipment, including face and body motion data subsets; the facial action data is composed of facial key point displacement data with multiple continuous timestamps, then calling a preset expression mapping model to decouple the facial action data to obtain a basic and personalized expression feature set, then adjusting the basic expression feature set according to preset emotion parameters of an animation role, generating an emotion adaptive expression feature set, and generating a personalized expression feature set according to the emotion adaptive expression feature set; the method comprises the steps of obtaining a personalized expression feature set, fusing with the personalized expression feature set to obtain a target expression feature set, finally driving a three-dimensional face model to generate an expression animation by using the target expression feature set, and binding body action data to a three-dimensional body model to generate a complete character animation, thereby improving the authenticity and expressive force of animation character expressions.

Using latent space manipulation and neural animation to generate hyperreal synthetic faces is described. A machine learning model(s) may be trained to generate a synthetic face of a subject featured in unaltered video content based at least in part on video data of an actor making a mouth-generated sound or a three-dimensional (3D) model of a face of the subject that has been animated in accordance with the mouth-generated sound. Latent space manipulation and neural animation may be used with the trained machine learning model(s) to generate instances of the synthetic face, and the instances of the synthetic face can be used to create altered video content featuring the subject with the synthetic face making the mouth-generated sound.

The invention discloses an interactive three-dimensional animation generation method and system based on an AI GC technology, and the method comprises the steps: carrying out the cross-modal joint understanding of an animation sketch and natural language description inputted by a user, and generating a preliminary three-dimensional animation low-fidelity preview based on the cross-modal joint understanding; then, by introducing a structured scene decoding mechanism, analyzing the complex animation intention multi-mode joint feature into a structured scene description containing a series of refined interaction modules, so as to decompose the macroscopic animation intention into local units capable of being accurately intervened by a user; a user can send a specific refining instruction for the specific refining interaction modules, the system updates the structured scene description after receiving the instruction, and generates an updated three-dimensional animation preview based on the updated structured scene description. Thus, the user can carry out targeted and refined adjustment on the animation, the controllability and flexibility of animation generation are greatly enhanced, and the problem that details are difficult to adjust in a traditional AI GC scheme is effectively solved.

The invention provides an animation real-time editing method and device applied to a director system, equipment and a medium. The method comprises the following steps: responding to an animation editing instruction from the director system; adaptively modifying the animation file according to an animation editing rule corresponding to the animation editing instruction to obtain a modified animation file; extracting animation parameters of each frame of image in the modified animation file; rendering each frame of image based on the animation parameters to obtain a corresponding video image; wherein each video image keeps a transparent channel; playing the video images on a playing interface of the director system according to the playing sequence; wherein the playing sequence is the playing sequence of the video images in the modified animation file. According to the embodiment of the invention, the animation file can be edited in real time in the director system, and the animation real-time editing efficiency is improved.

Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.