42 results about "Skeletal animation" patented technology

The invention relates to the technical field, in particular to a skeletal animation display method which comprises the steps of creating a static model based on a modeling tool, adjusting topological structures of high and low density areas of joints, verifying the symmetry of the model and correcting and optimizing the model. Establishing a skeleton hierarchy and a father-child skeleton chain based on the model; associating model vertexes to a skeleton system to establish an influence relationship, and optimizing weight parameters; the posture of the skeleton at different time points is defined by setting a key frame, and the animation effect is achieved; and ensuring that the animation basic logic is correct, and testing the motion state characteristics of the skeleton model. According to the skeleton animation display method and device, the equipment and the storage medium, the vertex density of the joint area is adjusted, symmetry processing is carried out, and weight gradual change processing and weight normalization verification are provided, so that the problem that a skeleton model is easy to tear, deform and distort in the animation can be solved; and meanwhile, a skeleton chain hierarchical structure is constructed, and the adaptability of a skeleton system and the model is further enhanced based on an IK controller.

The application provides a digital human head hair lighting data generation method and a digital human head hair rendering method, relates to the technical field of digital humans, and generates hair shape data capable of accurately controlling the shape of hair based on skeleton animation data through the calculation of a cloud server, and then directly generates hair lighting data in combination with environment data. The core of the method is that the inference ability of deep learning replaces traditional physical simulation and ray tracing calculation, successfully transfers the high complexity of the lighting calculation task to the cloud server, can realize high-fidelity real-time rendering of digital human hair in a dynamic motion and dynamic lighting environment without relying on high-performance terminal hardware, and solves the problems that the lighting map in the prior art cannot adapt to dynamic changes and the real-time ray tracing computing power is too high.

The invention provides a bone animation generation method and device suitable for a digital character developed by Unity. The method comprises the steps of obtaining action demand information of the digital character and packaging the action demand information into a bone animation generation instruction of a specific data structure; converting the skeletal animation generation instruction into a structured skeletal animation generation cue word data packet; according to the skeletal animation generation cue word data packet, generating a skeletal animation file in a BVH format; analyzing the bone animation file in the BVH format to obtain a bone structure and animation data; t-Pose difference compensation is carried out between the T-Pose of the BVH format file and the Unity Avatar standard T-Pose, the skeletal structure of the skeletal animation file of the BVH format is matched with the skeletal structure of a digital character VRM model, and an Animation Clip object of the digital character VRM model is generated according to the matching result and the animation data; and controlling the skeleton animation to be played on the digital character VRM model according to an Animation Clip object of the generated digital character VRM model, and transforming the skeleton of each frame of animation by applying a rotation compensation matrix in the animation playing process.

The invention provides a data set generation method, a model training method and a behavior recognition method. The method comprises the following steps: acquiring a skeleton animation of a digital human model through a preset acquisition frequency to obtain an acquisition frame; acquiring a local coordinate of each virtual skeleton node in the digital human model in the acquisition frame; performing coordinate conversion on the local coordinate of each virtual skeleton node to obtain a world coordinate corresponding to each virtual skeleton node; determining a first quaternion of each virtual skeleton node in the collection frame according to the world coordinate of each virtual skeleton node; constructing a virtual skeleton training sample according to the world coordinate corresponding to each virtual skeleton node in each collection frame and the first quaternion corresponding to each virtual skeleton node; and constructing a virtual skeleton data set according to the virtual skeleton training sample. The data quality of the skeleton data set can be improved.

The application relates to the technical field of motion capture, in particular to a tennis motion capture system, which comprises a motion sensor module, a multi-view synchronous camera module, a data fusion processing module and a real-time feedback module; the motion sensor module collects motion parameters of target joints of a tennis player; the multi-view synchronous camera module acquires spatial displacement data of target skeletal joint nodes when the player hits a ball; the data fusion processing module fuses the motion parameters and the spatial displacement data to generate a three-dimensional skeletal animation model; the real-time feedback module extracts a shoulder-hip torsion angle difference parameter from the three-dimensional skeletal animation model, outputs a directional vibration prompt signal through a tactile feedback device after the hitting action is completed, and outputs an overlapping comparison graph and a gradient heat map of a swing trajectory deviation by using a display terminal. The application can solve the problems of difficult precise capture of action details and provision of quantitative data feedback, overcome defects such as incomplete data collection, insufficient precision or poor adaptability of existing motion capture equipment, and provide strong support for precise optimization of a hitting action of a player.

The invention provides an animation processing method and device, a computer program product and electronic equipment, and relates to the technical field of animation production. The animation processing method comprises the steps of obtaining a first role animation, and performing particle conversion based on the first role animation to obtain a role cluster carrying physical attributes; the first character animation is an initial skeletal animation; the role cluster comprises a plurality of role particle swarms; a plurality of interaction particles are emitted to the role cluster, physical collision detection is carried out, collision calculation is carried out on role particle swarms generating collision interaction with the interaction particles in the role cluster, and a first role object carrying an interaction animation is obtained; and performing skeleton mapping on the first role object carrying the interactive animation to obtain a second role animation, the second role animation being a skeleton animation after collision calculation. According to the method and the device, batch generation of physical effects can be realized, animation variants in different forms are obtained, the animation production efficiency can be improved, and efficient animation library extension and animation modification are realized.

The application discloses a Unity implementation method and terminal for muscle skinning animation; a prefabricated character model with a set skeleton is imported, a muscle system object is created, and muscle data is configured in a muscle list of the muscle system object; the muscles are initialized according to the muscle data, and an initial conversion matrix of the muscle system is established; a muscle skinning object is created and initialized, muscle weight information is configured for vertices contained in the muscle skinning object; a skeleton animation is played, a muscle list is synchronously refreshed, a muscle matrix is calculated and synchronously updated, a position conversion matrix and a vector conversion matrix are calculated according to the muscle matrix and the initial conversion matrix; the muscle skinning object is refreshed according to the position conversion matrix and the vector conversion matrix and is applied according to the muscle weight information; the application realizes muscle driving by a skeleton, muscle driving body model deformation, muscle skinning animation, and more realistic and more accurate simulation of muscle deformation.

The invention discloses a skeletal animation rendering method and device, electronic equipment and a storage medium, and relates to the technical field of graphic processing. The method is applied to the electronic equipment, an operating system is installed in the electronic equipment, and the method comprises the steps that an application page of an application program is displayed, a runtime library with skeletal animations is imported into the application program, the runtime library is called through GLSkeletal View of the operating system to create Skeletal Drawable, the Skeletal Drawable is called through the GLSkeletal View to set animation parameters, an animation instance object is obtained, and the animation instance object is displayed on the application page. And calling the SkeleteronDrawable and the runtime library through the GLSkeleteronView, carrying out animation drawing according to the animation instance object to render a skeleton animation picture, and playing the skeleton animation page in the application page. According to the method and the device, the runtime library of the skeletal animation is imported into the application program, and the GLSkeleteronView of the operating system is called to realize rendering playing of the skeletal animation, so that a game engine does not need to be additionally introduced, and the access cost is low.

The invention discloses a presentation manuscript making and playing method based on a bone animation technology, and the method comprises the steps: building an original database, and binding an explanation human image with bone motion data of advancing display to generate an explanation model animation; and binding the figure image and the skeleton motion data according to the hospital department label to generate a demonstration motion model animation. When the presentation file is made, the explanation model animation or the demonstration action model animation is directly called from the skeletal animation database and then is matched with the first audio and the second audio to form vivid introduction, and particularly, the presentation file can be made according to the departments of the text content in the slide and the keywords of the demonstration actions. And the matched demonstration action model animation can be called, so that the production efficiency is greatly improved. In the presentation file playing process, the first video animation formed by combining the explanation model animation and the second audio can be played, the second video animation formed by combining the demonstration action model animation and the first audio can also be played, and the better simulation effect is achieved.

The invention discloses an intelligent generation method for AR, and belongs to the field of augmented reality methods, and the method comprises the following steps: 1, collecting user geographic coordinates, equipment pose data and environment image flow in real time through a mobile terminal; 2, calling a dynamic crowd portrait library according to the user ID; 3, pre-screening surrounding POI object categories by a space-object recognition engine based on a geofence, and generating an object three-dimensional feature tensor; step 4, a portrait-scene coupling module performs spatio-temporal context weighted fusion on the object feature tensor and the user interest label matrix, and outputs a scene AR content template; 5, selectively starting model LOD hierarchical compression, texture Mipmap downsampling or skeletal animation simplification; and step 6, differentiated AR model data packets are multicast to the target user through the edge computing node. According to the method, the dynamic coordination problem of'scene-user-equipment 'triple dimensions can be solved at the same time, and then the corresponding model is quickly and accurately generated.

The description relates to computer graphics techniques for generating animations. In the disclosed techniques, skeletal animation data is generated representing a skeleton. A mesh is then bound to the skeleton to create mesh binding data. The skeletal animation data and the mesh binding data can be used to deform the mesh to generate an animation. In some cases, the skeletal animation data and the mesh binding data can be generated during an offline process. Then, the deformation can be performed at runtime, e.g., by a graphics processing unit. The animation can be implemented in many different types of applications, including video games, virtual reality applications, augmented reality applications, etc.

This invention discloses a rendering method, system, and storage medium for skeletal animation. The method includes: acquiring animation control parameters for each model instance, the animation control parameters including an animation identifier, the current playback frame, and a world transformation matrix, but excluding the skeletal transformation matrix; writing the animation control parameters of each model instance into an instance data buffer and sending a single-draw instruction to the GPU, the instance data buffer being located in GPU video memory and configured to be writable by the CPU and readable by the GPU; the GPU responding to the single-draw instruction by sampling the skeletal transformation matrix from a pre-stored animation matrix texture based on the animation control parameters in the instance data buffer, and performing parallel skinning calculations on each model instance based on the sampled skeletal transformation matrix. This method frees the CPU from skeletal matrix calculations, avoiding CPU rendering thread overload and preventing severe frame rate fluctuations and frame drops.

The invention relates to the technical field of computers, in particular to a method for realizing skeletal animation based on Blender4 and UE5, which comprises the following steps of: S1, finishing skeletal binding of a target model in the Blender4, and manufacturing a required animation segment; s2, exporting assets of the target model from the Blender4 to a UE plug-in, and enabling the assets to generate an asset tree conforming to the UE5 specification by the UE plug-in; when the assets are exported from the Blender, the scaling factor is automatically adjusted to 0.01 through a written script; and S3, importing the asset tree into the UE5, and performing final skeletal animation production based on the imported asset tree. The method is used for solving the problems that in the unit conversion process, due to improper bone zooming, model dislocation is likely to be caused, manual adjustment is needed, and the manufacturing period is prolonged, and the problem that connection between multiple animation segments manufactured by Blender and the animation sequence of UE5 is not smooth is solved.

The invention provides a skeletal animation generation method, system and device, electronic equipment, a computer readable storage medium and a computer program product. The skeletal animation generation method comprises the steps that hand data, collected by first collection equipment, of a biological object and body data, collected by second collection equipment, of the biological object are obtained; generating a first hand skeletal animation of the biological object based on the hand data, and generating a body skeletal animation of the biological object based on the body data; fusing the first hand skeletal animation with the body skeletal animation to obtain a target body skeletal animation of the biological object; wherein the hand skeletal animation in the target body skeletal animation is obtained based on the generated hand skeletal animation. In this way, the accuracy and meticulous performance of the hand skeleton animation can be improved when the body skeleton animation is generated.

The invention relates to an interaction method and system based on a Web front end and electronic equipment, and the method comprises the steps: calling a terminal camera through a browser, obtaining a video stream of a user, and processing the video stream at the front end of the browser to extract human body key points; mapping the human body key points into skeleton animation parameters of the virtual image through a hierarchical action mapping engine; calculating a relative pose of the virtual article and the virtual image according to a preset attribute and a skeleton animation parameter of the virtual article; and in a browser environment, according to the relative pose, rendering and displaying an interaction picture of the virtual article and the virtual image. The problems of high hardware dependency, poor cross-platform compatibility, simple interaction link and serious delay and distortion in the prior art are solved. Special hardware is not needed, the use threshold of a user is lowered, and cross-platform compatibility is achieved based on a Web technology stack.

The embodiment of the invention provides a skeletal animation generation method and system. The skeletal animation generation method comprises the steps of obtaining a virtual skeleton of a virtual object and a grid model corresponding to the virtual skeleton; based on the orientation data of the virtual skeleton, mapping on the grid model to obtain a positioning point corresponding to the virtual skeleton; playing the grid model animation, and obtaining a first type of driving data and a second type of driving data of the positioning point; and controlling the virtual skeleton to rotate based on the first type of driving data, and controlling the virtual skeleton to move based on the second type of driving data to obtain a virtual skeleton animation. On the premise of not depending on manual binding and not losing physical details of a flexible object, automatic lossless mapping from a physical model vertex animation to an engine skeleton animation is achieved, the labor requirement for work is reduced, the skeleton animation manufacturing efficiency and quality are improved, and the method can be widely applied to the field of digital culture product manufacturing software.

The invention provides a skeletal animation generation method and device, a computer storage medium and electronic equipment, and relates to the technical field of computers. The method comprises the following steps: acquiring a skeleton static model, baking skeleton transformation data, performing texture sampling on an obtained skeleton animation parameter map, and determining animation parameter offset of each skeleton; determining a second normal according to the first normal of each model vertex and the animation parameter offset of each skeleton, and determining a first target position of a target skeleton corresponding to each model vertex in the target frame according to the animation parameter offset; determining a target normal of each model vertex based on the second normal and the skeleton weight parameter, and determining a second target position of each model vertex in the target frame according to the first target position and the skeleton weight parameter; and according to the target normal and the second target position, generating a skeletal animation corresponding to the to-be-processed animation. The rendering efficiency can be improved, the storage cost is reduced, and the quality of the generated skeletal animation is improved.

The application relates to a virtual object processing method and device, equipment and a medium. The method comprises the following steps: acquiring instance customization data corresponding to a virtual object instance and a pre-baked skeletal animation map associated with the virtual object instance; sampling the skeletal animation map based on the instance customization data to acquire skeletal transformation data of the virtual object instance at a current animation frame; and transforming an instance model vertex of the virtual object instance in an instance model space of the virtual object instance according to the skeletal transformation data to obtain spatial position data of the instance model vertex, so that the spatial position data is processed through a rendering pipeline. The technical scheme of the application can realize efficient rendering of large-scale on-screen differentiated animation without invading material logic and occupying material-specific channels.

The invention provides a method and a system for realizing animation interactive preview. The method comprises the following steps of: converting skeleton animation data of a role model to be previewed, which is originally processed by a CPU (Central Processing Unit), into a file in a special format for the GPU, loading the file into a GPU cache, and realizing high-efficiency preview and convenient edition and modification of the animation of the role model to be previewed through a four-order dynamic control mechanism (loading / enabling / disabling / removing) of the GPU. And meanwhile, tools such as Maya / PyTorch are losslessly compatible, so that the data integrity of a production chain is guaranteed. According to the technical scheme provided by the invention, the previewed character animation can be flexibly switched between the precision mode and the performance mode, the frame rate can be doubled and improved by a dual-core acceleration architecture of'simple mode agent + GPU calculation ', and finally, the occupation of a video memory is remarkably reduced while the occupation of CPU resources is greatly reduced.

The invention discloses a digital human real-time generation method and system fusing a layered light transmission model, and relates to the technical field of digital human modeling and real-time rendering. The method comprises the following steps: collecting optical parameters of each layer of skin, constructing a layered skin light transmission model and a radiation flux equation of each layer, carrying out layered adaptive photon mapping sampling, fusing radiation transmission results of each layer through a neural network accelerator, generating a skin material containing a dynamic reflectivity field, and outputting the skin material containing the dynamic reflectivity field. And finally, binding the optimized skin with a skeleton animation system in real time, and outputting a rendered digital human. Through layered optical modeling, dynamic sampling optimization, hardware acceleration rendering and the like, the skin optical optimization result is deeply embedded into the digital human modeling process, the skin rendering precision is improved, the dynamic adaptability is enhanced, and the problems that in the prior art, the skin of a digital human is not real, dynamic response is delayed, and the digital human is not real are solved. The skin texture and the muscle movement are not synchronous, and the like.

The invention relates to the technical field of computers, in particular to a skeletal animation generation method and device, a computer program product and electronic equipment. The skeletal animation generation method comprises the steps of obtaining a scaling parameter of a to-be-scaled skeletal, adding the scaling parameter to original skeletal data to obtain target skeletal data, and generating an initial animation based on the target skeletal data; analyzing the initial animation to obtain stretching transformation data of each skeleton; based on the stretching transformation data, carrying out stretching component separation processing on a local space matrix of a skeleton in the initial animation to obtain effective stretching data and local space matrix data after the effective stretching data is removed; and according to the effective stretching data and the local space matrix data, generating a skeleton zooming animation in the game engine. According to the invention, the manufacturing effect and efficiency of the skeleton zooming animation can be improved.

The application provides a method and device for generating skeletal animation of a digital character suitable for Unity development, comprising: obtaining motion requirement information of the digital character and encapsulating the information into skeletal animation generation instructions of a specific data structure; converting the skeletal animation generation instructions into structured skeletal animation generation prompt word data packets; generating a BVH format skeletal animation file according to the skeletal animation generation prompt word data packets; parsing the BVH format skeletal animation file to obtain a skeletal structure and animation data; performing T-Pose difference compensation between a T-Pose of the BVH format file and a standard T-Pose of a Unity Avatar, adapting the skeletal structure of the BVH format skeletal animation file to a skeletal structure of a digital character VRM model, and generating an AnimationClip object of the digital character VRM model according to the adaptation result and the animation data; and controlling the skeletal animation to play on the digital character VRM model according to the generated AnimationClip object of the digital character VRM model, and applying a rotation compensation matrix to transform the skeleton of each frame of animation during the animation playing process.

The present application relates to the technical field of data processing and three-dimensional modeling calculation, in particular to a non-heritage music digital twin reconstruction and immersive experience method and system, the method synchronously collects three-dimensional sound field directional energy data of a performance space, performer body movement data and historical performance scene geometry data and constructs a sound shape field multi-modal digital archive; reconstructs a performance space geometry model according to the historical performance scene geometry data; drives a digital twin performer model to obtain a skinning skeleton animation and simultaneously exports an initial sound source radiation directivity according to the performer body movement data; corrects to obtain a corrected sound source radiation directivity by taking the three-dimensional sound field directional energy data as a constraint; renders spatial audio signals according to the visitor roaming pose, the performance space geometry model and the corrected sound source radiation directivity and synchronously outputs to an immersive display device, reversely drives the directivity with the same motion data, peels off early reflections with the geometry model and eliminates the mismatch of the audio-visual azimuth.

The invention discloses a data processing method, electronic equipment, a storage medium and a computer program product, and the method comprises the steps: obtaining a token sequence which is obtained through the conversion of skeleton animation data of a first digital human; dividing tokens in the token sequence into a plurality of clusters; predicting a cluster center of each cluster in the plurality of clusters through an expert network in the multi-expert network model to obtain a first prediction value of each cluster center; and for each token in the token sequence, an estimated value of each token is obtained based on the first predicted value of the clustering center corresponding to each token and the compensation value of each token, the compensation value is used for compensating the difference between each token and the clustering center, and the estimated value of each token is used for generating the action of the first digital human. According to the invention, the searching and positioning requirements of a user in an emergency can be met, and the sensing and positioning capabilities of the terminal are improved.

The application relates to the technical field of virtual reality, and provides a three-dimensional human body model and skeleton synchronous updating method and an electronic device. An initial three-dimensional human body model and a preset skeleton are initialized to determine a plurality of target geometric vertices associated with each skeleton node, an influence weight corresponding to each target geometric vertex, and a scaling ratio between a child skeleton node and a parent skeleton node. The initial three-dimensional human body model is driven in a non-skeletal animation mode, the three-dimensional coordinates of the geometric vertices after driving are obtained, the three-dimensional coordinates of each skeleton node are reversely calculated according to the three-dimensional coordinates of the geometric vertices after driving and the initialization result, the skeleton structure of the preset skeleton is updated according to the three-dimensional coordinates of each skeleton node, a skeleton matching the target three-dimensional human body model is obtained, the consistency of the skeleton in the model animation process is ensured, the synchronous updating of the skeleton after the driving of the three-dimensional human body model is realized, and the authenticity of the model when performing skeletal animation based on the updated skeleton is improved, and the storage space occupied by the animation data is saved.

The embodiment of the invention provides an animation multi-thread updating method, system and device and a storage medium, relates to the technical field of game animation and is applied to an electronic device, and the electronic device runs a main thread and a plurality of sub-threads. The method comprises the steps that when a main thread conducts scene updating, acquired to-be-updated skeletal animation data is distributed to task data lists corresponding to multiple sub-threads in a balanced mode; if the sub-thread is not in the updating state currently, waking up the sub-thread to update the to-be-updated skeletal animation data; if the sub-thread is currently in the updating state, updating the to-be-updated skeletal animation data by utilizing the sub-thread; and after the scene of the main thread is updated, synchronizing the skeleton animation data updated by the sub-thread into the main thread. In this way, updating is conducted while obtaining is conducted, the spare time of the sub-threads is shortened, the main thread is synchronized in the process of waiting for calculation of the sub-threads, the generated data are synchronized in advance by fully utilizing the spare time, the degree of parallelism is improved, and therefore the multi-thread updating efficiency is improved.

The invention discloses a rendering and animation processing system and method for a multi-source heterogeneous 3D model, electronic equipment and a storage medium. The rendering and animation processing system comprises a unified abstraction layer module, a material mapping engine module, a skeleton animation processing module and a rendering module. The unified abstraction layer module executes standardized conversion from original data to internal scene data; the material mapping engine module maps an original material into an internal material with complete PBR parameters through a material processor with a built-in rule base; the skeletal animation processing module realizes a smooth animation effect by executing skeletal matrix calculation and an animation state machine; and the rendering module transmits the 3D model data processed by the unified abstraction layer module, the material mapping engine module and the skeletal animation processing module to the GPU in real time, and executes rendering calculation of the 3D data so as to output an accurate and vivid rendering result. According to the invention, processing and rendering display of 3D data in various formats can be efficiently, accurately and visually completed.

The invention provides a controllable digital human video generation method and device, equipment and a storage medium. The method comprises the following steps: acquiring an initial two-dimensional image and initial video data; the initial two-dimensional image comprises a first target body; the initial video data comprises a limb movement video of a second target body; based on the initial two-dimensional image, determining a target 3D digital person matched with the first target body; based on a limb movement video contained in the initial video data, determining a skeleton animation sequence of limb movement of a 3D skeleton corresponding to the second target body; based on the skeletal animation sequence, performing skeletal redirection processing on the target 3D digital human to generate a target video of limb movement of the target 3D digital human in a target three-dimensional scene; wherein the limb movement of the target 3D digital human in the target video is matched with the limb movement of the 3D skeleton of the skeleton animation sequence.

The application discloses an animation generation method and device of a model, a storage medium and an electronic device. The method comprises the following steps: acquiring a plurality of first models; merging the plurality of first models into a second model; determining first weight information of vertices of the second model; determining second weight information of the vertices of at least one first model based on the first weight information; and controlling the motion of each corresponding first model based on the second weight information to obtain a skeletal animation of each first model, wherein the skeletal animations of the plurality of first models constitute a broken animation of the second model. The application solves the technical problem of low animation production efficiency of a model.

The invention discloses a sign language expression optimization method based on edge collaborative computing, and the method comprises the following steps: S10, generating a skeleton animation based on a semantic vector: constructing a mapping data set of Chinese semantics and sign language actions at a cloud end, and extracting a skeleton joint motion track; through inverse kinematics solution and physical constraint optimization, a skeleton joint motion trail is converted into a skeleton animation, emotion features are extracted through a double-layer LSTM network, and animation frequency and amplitude parameters are adjusted; s20, a tree-shaped preloading mechanism is adopted; s30, collaborative loading optimization: decoupling the sign language role model into a static skeleton framework and a dynamic animation sequence; a dual-channel transmission strategy is adopted, static data are preloaded to a terminal, and dynamic data are dynamically requested according to semantic weight; generating three groups of control parameters including a speed coefficient, an amplitude gain and an emotional weight through acoustic feature mapping; and S40, ensuring the consistency of cross-layer semantics.