35 results about "Human body modeling" patented technology

The invention discloses a virtual garment customization method based on 3D modeling, and relates to the technical field of garment customization, and the method comprises the steps: collecting image video data corresponding to the body data of a user, and carrying out the preprocessing of the collected data, and obtaining the basic three-dimensional point cloud data of a human body; carrying out primary human body modeling according to the human body basic three-dimensional point cloud data, then adjusting the model shape based on key parameters input by a user, and carrying out body type matching to realize parameterized human body modeling; secondly, modeling the clothes, predicting clothes deformation by adopting machine learning, simulating cloth dynamics by adopting a physical engine, performing collaborative tracking and matching on clothes and human body dynamic characteristics according to a clothes template selected by a user, and realizing virtual try-on through an AR (Augmented Reality) technology; the customized order confirmation information of the user is obtained, the 2D garment pattern graph is generated and sent to the customized production server, it can be ensured that the user can obtain a high-quality 3D modeling result under different devices and environments, and the user experience can be enhanced through AR try-on.

The invention discloses a costume design assisting method and system based on artificial intelligence, and belongs to the field of costume intelligent design, and the method comprises the steps: extracting multi-dimensional style feature information from a pre-constructed costume image data set and a fashion trend database through employing a convolutional neural network, and constructing a style vector space model; vector similarity matching is carried out, and a costume design sketch is generated by adopting a graph neural network; based on the design sketch, generating a structured process data packet for proofing; the design sketch and the structural data are input into a three-dimensional human body modeling and simulation module, and wearing effect simulation of virtual clothes is realized based on human body motion capture and physical cloth simulation technologies; and constructing a human-computer interaction interface, and quickly responding to a modification request based on the generative adversarial network model. Structured information such as the garment pattern structure, the sewing sequence, the material specification and the process route is automatically generated through the reinforcement learning algorithm, and the garment proofing efficiency and accuracy are remarkably improved.

The invention discloses a figure modeling and fitness action teaching method and system based on non-contact action capture, and the method carries out the real-time monitoring of a human body posture through a millimeter wave radar, carries out the 3D human body posture reconstruction and analysis through combining with a human body posture frame of Google image processing, and achieves the high-precision action capture. The method can be used for human body modeling, body building action scoring and action guidance, action evaluation and real-time feedback in body building teaching can be effectively supported, the millimeter wave radar is adopted for human body posture capture, external markers or wearable equipment are not needed, constraint on user activities is avoided, and use convenience and comfort are improved. The 3D posture of the human body can be accurately reconstructed in combination with a deep learning neural network, and real-time processing and analysis are carried out. The method not only can realize accurate motion capture, but also can be combined with fitness motion scoring and guidance, is widely applied to the fields of virtual fitness, exercise rehabilitation and the like, and has great application potential.

The invention provides a physiological mechanism driving and data fusion method and system for sitting posture human body modeling, and relates to the technical field of digital twinning and biomechanics crossing. The method comprises the following steps: mapping human body macroscopic parameters into biomechanical attribute parameters; generating a basic three-dimensional human body grid based on the human body macroscopic parameters; generating a deformed three-dimensional human body grid in combination with the basic three-dimensional human body grid and the human body macroscopic parameters; solving an optimal attitude based on the vehicle geometric parameters, the task scene identifier and the biomechanical attribute parameters; finally, the deformed three-dimensional human body grid and the optimal posture are integrated, the high-fidelity sitting posture digital twinborn body is generated, end-to-end automatic modeling from macroscopic parameters to the digital twinborn body is achieved, and the core problems that the form and the posture are not matched, crowd coverage is insufficient and task adaptability is poor are solved.

The invention discloses a digital human rendering method based on Gaussian splashing and multi-scale characteristic field distillation, and belongs to the field of three-dimensional human body digital reconstruction. According to the method, feature extraction is carried out through a Vision Transformer encoder, based on an SMPL model, through a cross-modal parameter estimation module and dynamic human body modeling of three-dimensional Gaussian splashing and semantic feature rendering, three-dimensional Gaussian is projected to a two-dimensional image plane to calculate a covariance matrix and color mixing, and after a rendered color image and an initial feature field image are output, a three-dimensional image is obtained. A student feature map is obtained through a convolution acceleration module, a teacher feature map is obtained after feature extraction is carried out through a two-dimensional basic model, the constructed model is trained, and optimization training is completed through comprehensive total loss function calculation; according to the method, the problems of fuzzy semantics, detail missing, low rendering efficiency and inaccurate human body-scene separation in the existing method are effectively solved, so that more efficient, fine and robust monocular or multi-view human body three-dimensional reconstruction is realized.

The invention discloses an intelligent human body modeling method and system based on a three-dimensional dot matrix, and relates to the field of intelligent modeling, and the method comprises the steps: carrying out the structural analysis of the semantic level of an original three-dimensional point cloud, and predicting a space displacement field pointing from the surface of observed clothes to the surface of an internal real human body under the semantic guidance. By applying the displacement field, double transformation of point cloud stripping and standardization is carried out on the point cloud, so that repeated fine tuning and optimization are carried out on the body type and posture parameters of the human body model in a standardized space, and finally a high-fidelity human body three-dimensional model is generated through driving. In this way, the complex clothes interference problem is deconstructed into a staged geometric mapping and parameter optimization process, and therefore the robustness and accuracy of human body three-dimensional reconstruction under the real wearing condition are effectively improved.

The invention relates to the technical field of computer vision, and particularly provides a virtual digital human generation method and electronic equipment, and the method can comprise the steps: obtaining three-dimensional human body modeling data corresponding to each frame of image in a monocular video sequence of a target object; the three-dimensional human body modeling data comprises body posture data and identity offset data; processing the three-dimensional human body modeling data by using a pre-constructed to-be-trained virtual model to generate a virtual object image of each frame of image; the to-be-trained virtual model comprises a to-be-optimized three-plane feature body and a plurality of multi-layer neural network MLP models; optimizing the to-be-trained virtual model through the loss value between the virtual object image and each corresponding frame image, and obtaining a three-dimensional digital human model corresponding to the target object; the three-dimensional digital human model is used to generate a virtual digital human based on any drive data. According to the embodiment of the invention, the generation and rendering quality of the virtual digital human can be improved.

The present invention discloses a three-dimensional human body modeling and motion acquisition method based on multi-view synchronous shooting. A tracking video of a person shot synchronously from multiple perspectives is obtained, and two-dimensional human body key points and two-dimensional hand key points are extracted from each frame; then, the arm parameters of the human body parametric model are optimized using the two-dimensional human body key points. Afterwards, the parameters of the hand model are optimized based on the two-dimensional hand key points; according to the wrist position, the arm position is corrected to obtain the arm parameters of the human body parametric model. By arranging the hand model point cloud and the human body parametric model point cloud, an index of points and triangular facets is established to obtain a fusion model, and the parameters of the human body parametric model and the hand model are imported into the fusion model to obtain the result of human body reconstruction. The present invention can use multi-view images to perform human body modeling and motion acquisition including hands, and does not require a sophisticated multi-camera configuration and motion capture clothing.

The invention provides a human body posture data set construction method based on a large model. A large language model is combined with a fine-grained attribute database to generate motion description, then the motion description is converted into 3D human skeleton motion data through a MoMask model, and quality control is carried out. And then view control and gait speed control are performed on the motion data to increase data diversity. And then radar data simulation is carried out, including human body modeling, RCS estimation, radar signal generation and processing, and micro-Doppler spectrogram generation. Meanwhile, a VQ-VAE model is adopted to generate background noise and add the background noise, shielding is simulated, and the data trueness is enhanced. And finally, constructing a data set containing a plurality of activities. The data set generated by the method has semantic and physical diversity, a real scene can be simulated with high fidelity, the performance of a human body posture recognition model is effectively improved, and powerful support is provided for application of related technologies in multiple fields.

The application discloses a 3D human body modeling method and device based on contrast learning and a medium. The method comprises the following steps: acquiring 2D image information corresponding to a user and body state information corresponding to the user; extracting original features corresponding to the 2D image information through a shared encoder; performing mask prediction and determining clothing coverage rate according to the original features; performing feature fusion according to the original features, shape prior features corresponding to the body state information and the clothing coverage rate to obtain fused features; performing adaptive feature purification on the fused features according to the clothing coverage rate to obtain pure features; and performing human body parameter prediction according to the pure features.

The present application provides a physiological mechanism driving and data fusion method and system for seated human body modeling, which relates to the cross technical field of digital twin and biomechanics. The method comprises: mapping human macroscopic parameters to biomechanical attribute parameters; generating a basic three-dimensional human body grid based on human macroscopic parameters; generating a deformed three-dimensional human body grid by combining the basic three-dimensional human body grid and the human macroscopic parameters; solving the optimal posture based on the vehicle geometric parameters, the task scene identifier and the biomechanical attribute parameters; finally integrating the deformed three-dimensional human body grid and the optimal posture to generate a high-fidelity seated digital twin, realizing end-to-end automatic modeling from macroscopic parameters to digital twin, and solving the core problems of shape and posture mismatch, insufficient population coverage and poor task adaptability.

The application relates to the technical field of medical devices and particularly discloses a pain dynamic evaluation and treatment linkage system based on three-dimensional somatosensory interaction, which comprises the following modules: a human body modeling module for constructing a three-dimensional human body dissection model; a somatosensory interaction module for receiving pain area marking instructions and pain intensity scores; an infrared sensing module for monitoring human body infrared thermal imaging data of a patient in real time; a physiological monitoring module for monitoring heart rate variability indexes and skin electric reaction indexes of the patient based on wearable devices; a region marking module for obtaining a calibrated pain area of the patient based on the pain area marking instructions and abnormal temperature zones in the human body infrared thermal imaging data; a pain prediction module for predicting a pain intensity prediction curve in a future period based on the pain intensity scores, the heart rate variability indexes, the skin electric reaction indexes and the calibrated pain area of the patient; and a treatment linkage module for generating treatment parameter control instructions based on the pain trend prediction curve and a multi-dimensional pain characteristic vector, so that precise and dynamic treatment intervention is realized.

The invention discloses a convenient three-dimensional human body reconstruction method based on a monocular video, and the method comprises the steps: constructing a parameterized human body model low-dimensional shape space, and obtaining the approximate representation of a linear model. And extracting a multi-view key frame from the input human body rotation video. And extracting a feature vector of each view key frame by using an improved ResNet-50 network fused with an attention mechanism. And defining the multi-view feature vectors as graph nodes, and constructing a graph structure. And performing cross-view depth feature fusion through the graph convolutional network to obtain global features. And mapping the global features to a parameterized human body model low-dimensional shape space. And reconstructing a complete three-dimensional human body grid by using linear model approximate representation. The method has the advantages that multi-view feature extraction and a graph structure fusion mechanism are combined, the end-to-end process from consumption-level video input to high-precision three-dimensional human body reconstruction is achieved, certain generalization ability is achieved in a real scene, and a low-cost and high-precision three-dimensional human body modeling solution can be provided for virtual fitting, digital twinning and other applications.

The invention discloses a 3D human body modeling method and device based on comparative learning and a medium. The method comprises the steps that 2D image information corresponding to a user and posture information corresponding to the user are acquired; extracting an original feature corresponding to the 2D image information through a shared encoder; according to the original features, mask prediction is carried out, and the clothing coverage rate is determined; performing feature fusion according to the original feature, a shape prior feature corresponding to the posture information and the clothing coverage rate to obtain a fused feature; according to the clothing coverage rate, performing adaptive feature purification on the fused feature to obtain a pure feature; and performing human body parameter prediction according to the pure features.

The invention discloses a complex human body modeling analysis method based on human factor engineering, and belongs to the technical field of human body modeling. According to the method, firstly, a joint DOF model is constructed, a virtual human body model is divided into a plurality of limb segments for modeling according to the joint DOF model and the membership relation between different body parts and joints, the level of the whole limb segment is regarded as a tree structure, a single limb segment is regarded as a tree node, and then a human body limb segment hierarchical model is formed; performing parametric modeling on the virtual human body based on the human body limb section hierarchical model to obtain a virtual human body DOF model; after a virtual human body DOF model is established, a virtual human body posture is analyzed, a D-H method is used for kinematics analysis, an inter-joint transformation matrix based on human kinematics is obtained, a human body reachable domain range is determined based on the inter-joint transformation matrix, and then complex human body modeling for assembling or maintaining in a narrow space is achieved.

The invention relates to the technical field of three-dimensional human body modeling, and particularly discloses a modeling and rendering method and device based on layered three-dimensional Gaussian representation and a medium, and the method comprises the steps: obtaining an image sequence of a target, and initializing a three-dimensional Gaussian point in a standard space based on an SMPL human body template vertex; taking the initialized three-dimensional Gaussian point as the first layer of the innermost side, constructing a hierarchical Gaussian structure from coarse to fine, and establishing conditional dependence among the layers through a father-child node connection mode; setting a hierarchical motion condition, and predicting rigid body and non-rigid body deformation transformation parameters of each Gaussian point by using a rigid body transformation network and a non-rigid body transformation network; and mapping the layered Gaussian points to an observation space in a unified manner according to predicted transformation parameters, and performing image synthesis by using a three-dimensional Gaussian rendering technology. Compared with the prior art, the method can naturally adapt to and express deformation characteristics of different levels in human motion, and realizes high-quality reconstruction and real-time rendering of a complex dynamic scene.

The invention discloses an intelligent fitting recommendation system based on 3D human body modeling and clothing parameter adaptation, and relates to the technical field of intelligent fitting recommendation. The system generates a high-precision dynamic body surface grid through a multi-modal data acquisition module; a human body-costume double-layer decoupling digital model construction module is utilized to realize efficient and realistic costume dynamic deformation simulation; through a dynamic pressure simulation and evaluation module, in combination with an improved Hertz contact theory and a fabric mechanical model, carrying out accurate simulation and multi-dimensional quantitative evaluation on dynamic contact pressure of clothes and a human body; and finally, the scene intelligent recommendation module provides personalized clothing recommendation according to the scene selected by the user and the dynamic evaluation result. According to the method, the problem that traditional virtual fitting lacks dynamic comfort evaluation is solved, the user experience is remarkably improved, the return rate of merchants is reduced, and the method has important market application value.

The invention discloses a shopping mall virtual fitting room implementation method and system based on the AR technology, and belongs to the technical field of e-commerce and computer vision, and the method comprises the steps: carrying out the real-time high-precision three-dimensional human body modeling based on a common camera; performing intelligent cloth physical simulation fused with a machine learning algorithm; multi-terminal cross-platform consistency rendering is supported; and carrying out personalized clothing recommendation in combination with user body type data. The virtual try-on effect of the user can be truly presented, multi-device terminal access is supported, the shopping experience is remarkably improved, and the refunding and changing rate is reduced.

The invention relates to the technical field of costume design, and discloses an intelligent interactive costume design system and method based on a data model. The system comprises an interaction module, a human body modeling module, a demand intelligent analysis module, an intelligent design generation module, a fabric matching module, a virtual fitting module and a scheme optimization module. The interaction module obtains PLY format human body data of a user and costume design requirements and receives modification feedback of the user, and the human body modeling module generates a 3D human body model, human body size parameters and posture feature tags. The demand intelligent analysis module converts a costume design demand into a structured demand document containing a style tag and a version constraint parameter in combination with a posture feature tag, the intelligent design generation module outputs an optimal costume design scheme through a VAE generation model, and the fabric matching module matches candidate fabrics based on the optimal costume design scheme. The virtual fitting module realizes dynamic fitting simulation, and the scheme optimization module iteratively optimizes the optimal costume design scheme to meet user requirements. The personalized costume design efficiency of the user is improved.

The embodiment of the invention relates to the technical field of artificial intelligence, and discloses a digital person business card generation method, electronic equipment, a medium and a program product. The method comprises the following steps: acquiring an input image of a target user in digital person business card generation, and preprocessing the input image to obtain image feature data; performing three-dimensional space coordinate alignment and mapping on the image feature data to obtain image three-dimensional data; reconstructing the image three-dimensional data into a three-dimensional Gaussian point cloud; establishing a binding relationship between the three-dimensional Gaussian point cloud and a skeleton hierarchical structure in the three-dimensional human body modeling tool; performing image rendering according to the binding relation to obtain a digital human model; generating corresponding digital human voice data according to the reply data in the digital human interaction process; and the digital human model and the digital human voice data are combined and displayed to obtain the digital human business card, so that a single-picture realistic digital human technology can be realized, and the fidelity of a digital human image is improved and the digital human image is deeply bound with a user image on the basis of reducing the data volume required for making the digital human.

The invention relates to the technical field of medical instruments, and particularly discloses a pain dynamic assessment and treatment linkage system based on three-dimensional somatosensory interaction, and the system comprises a human body modeling module which constructs a three-dimensional human body anatomical model; the somatosensory interaction module receives a pain area marking instruction and a pain intensity score; the infrared sensing module monitors human body infrared thermal imaging data of a patient in real time; the physiological monitoring module monitors a heart rate variability index and a skin electric response index of the patient based on the wearable device; the region marking module obtains a calibrated pain region of the patient based on the pain region marking instruction and an abnormal temperature region in the human body infrared thermal imaging data; the pain prediction module calibrates a pain area based on a pain intensity score, a heart rate variability index and a skin electric response index of the patient, and predicts a pain intensity prediction curve in a future period; the treatment linkage module generates a treatment parameter control instruction based on the pain trend prediction curve and the multi-dimensional pain feature vector; and accurate and dynamic treatment intervention is realized.

The embodiment of the invention provides a human body and object contact prediction method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining a target image, wherein the target image comprises an interaction scene of a human body and at least one object; performing contact prediction processing on the target image to obtain a contact vertex list; performing target detection processing on the target image to obtain detection information; carrying out human body modeling processing on the target image to obtain a three-dimensional vertex and a corresponding two-dimensional projection coordinate; semantic fusion processing is conducted on the contact vertex list, the detection information and the two-dimensional projection coordinates, a semantic contact result is obtained, and the semantic contact result is used for representing the contact relation between all the parts of the human body and different objects; the semantic contact result is visualized, a final contact result is obtained, and the final contact result is used for visually representing the contact relation between the human body and the object. According to the method, the accuracy of the human body and object contact prediction result can be improved.

The invention discloses a three-dimensional human body modeling method and system based on binocular vision and a laser radar, solves the problem of poor reconstruction effect of a three-dimensional human body in a dynamic motion scene, and belongs to the technical field of computer vision, intelligent perception and three-dimensional modeling. A binocular camera and a laser radar are used for synchronously collecting a human body, and a binocular image and a laser radar point cloud are obtained; processing and fusing the obtained binocular image and the laser radar point cloud to generate a human body initial three-dimensional model; tracking and updating the parameterized human body model in real time, and outputting a dynamic three-dimensional human body model; in the real-time tracking and updating process, a parameterized human body model is constructed according to the human body initial three-dimensional model, the human body volume, the image contour and the point cloud distance are used as constraint terms, the human body elastic deformation is used as a physical regularization term to construct an optimized energy function, and the deformation of the parameterized human body model in motion is optimized by using the optimized energy function. According to the method, the geometric fidelity and the detail reduction degree of the three-dimensional model are effectively improved.

The present application relates to the technical field of virtual fitting, and more particularly to an intelligent virtual fitting method based on three-dimensional human modeling. The method comprises the following steps: collecting multi-angle image data of a human body and constructing a three-dimensional model of the human body structure to accurately capture various dimensions and postures of the human body, thereby providing accurate basic data for virtual fitting; obtaining a garment and collecting garment physical parameters to analyze the appearance effect of the garment; using the three-dimensional model of the human body to simulate postures and combining the physical characteristics of the garment to analyze the interactive dynamic response of the human body and the garment, thereby obtaining dynamic effect data of the garment under different postures; and further optimizing the virtual fitting effect by calculating the matching degree of the garment and the human body; the present application optimizes intelligent virtual fitting to achieve more perfect virtual fitting matching degree.

The present application relates to a kind of methods for calculating the electric field distribution of human body under UHV DC transmission line, belong to high voltage transmission technical field.The method includes the following contents: a, calculation, the electric charge method is applied to calculate the electric charge density of UHV DC transmission line conductor and the electric field line method is calculated to calculate the potential of any point in space under transmission line;B, human body modeling, reference the basic data of human body modeling size, according to the relative position of human body and transmission line and the actual height of transmission line, establish the space area for calculating the electric field distribution of human body;C, region division, according to the influence of finite element region boundary condition by the presence or absence of human body, select appropriate calculation area, analyze the internal and surface field intensity distribution of human body under UHV DC transmission line.The present application can provide technical reference for electromagnetic protection of the people who move under UHV DC transmission line.

The application discloses a three-dimensional Gaussian dynamic human body modeling method based on compressed three planes, and comprises the following steps: obtaining a camera pose parameter sequence, human body SMPL shape information and a posture information sequence from a single-view video sequence, and obtaining an initialized three-dimensional Gaussian point cloud; obtaining high-dimensional features according to the three-dimensional Gaussian point cloud, and predicting information of the three-dimensional Gaussian in a standard space; distilling skin weights of each vertex of a standard SMPL model and smoothing; generating high-dimensional position coding of the three-dimensional Gaussian by splicing, combining SMPL posture information and three-plane high-dimensional features, predicting basic attribute transformation values, and correcting Gaussian attributes under different human body postures; calculating a transformation matrix by using the corrected skin weights and the SMPL posture information, and obtaining a transformed three-dimensional Gaussian point cloud by transformation; rendering the transformed three-dimensional Gaussian point cloud, combining an image loss function and attribute constraints of neighbor Gaussians, and jointly optimizing to obtain a drivable human body three-dimensional Gaussian model. The application also discloses a system for realizing the above method, and has wide application scenarios.

This invention provides an integrated clothing customization system and method based on AI technology, belonging to the field of smart retail and e-commerce technology. The system adopts a dual-space architecture: the first space enables contactless AI body measurement, 3D human body modeling, and digital interaction; the second space automatically handles the storage and retrieval of physical sample garments. It integrates modules for size extraction, virtual try-on rendering, physical try-on feedback, and order generation. AI algorithms achieve accurate body measurement, simultaneous virtual and physical try-on, and parametric pattern generation. The method includes human body image acquisition, 3D modeling and size extraction, virtual try-on, physical try-on feedback, order generation, and production integration. This invention achieves integrated measurement, try-on, customization, and production processes, improving measurement accuracy and the try-on experience while shortening the production cycle.

The invention relates to the technical field of 3D human body modeling, and discloses an AI model-based 3D digital human building method, which comprises the following steps of: acquiring image data, action data and voice data of a target person, and respectively preprocessing the acquired data; constructing and training a 3D digital human modeling model, an action generation model and a voice driving model; and establishing a 3D digital human model according to the preprocessed data and the trained models. According to the method, multi-aspect data of the target person is comprehensively collected and preprocessed, different models are constructed for targeted training, and the 3D digital person model fitting the features of the target person can be accurately and comprehensively generated.

The application relates to the technical field of three-dimensional human body modeling, and particularly discloses a modeling and rendering method and device based on layered three-dimensional Gaussian representation and a medium, method steps comprising: acquiring an image sequence of a target, initializing three-dimensional Gaussian points in a canonical space based on SMPL human body template vertices; taking the initialized three-dimensional Gaussian points as the first layer on the innermost side, constructing a layered Gaussian structure from coarse to fine, and establishing conditional dependence between layers through a parent-child node connection mode; setting layered motion conditions, and respectively predicting rigid body and non-rigid body deformation transformation parameters of each layer of Gaussian points by using a rigid body transformation network and a non-rigid body transformation network; uniformly mapping the layered Gaussian points to an observation space according to the predicted transformation parameters, and performing image synthesis by using a three-dimensional Gaussian rendering technology. Compared with the prior art, the application can naturally adapt to and express deformation characteristics of different levels in human body motion, and realizes high-quality reconstruction and real-time rendering of a complex dynamic scene.