Metacosm scene construction and information perception platform based on human body finite element model

Abstract

The invention discloses a meta universe scene construction and information perception platform based on a human body finite element model. The meta universe scene construction and information perception platform comprises a personalized modeling module, a multi-physics scene construction module and a multi-source data transmission module, the personalized modeling module is used for generating human body finite element models of different signs and comprises a basic model unit, an image acquisition unit, a grid deformation unit and a geometry generation unit; the multi-physics field scene construction module is used for constructing a complex universe scene and comprises a temperature physics field unit, a contact force physics field unit and a cloud computing unit; the multi-source data transmission module is used for transmitting multi-source data obtained through simulation in a multi-physical field scene to a human body and comprises a wearable somatosensory device and a simulation data decoupling unit. According to the invention, the method can reflect the practical multi-element perception conditions of contact force, temperature and the like to a user in the space of the element universe, and achieves the more natural and smooth experience of the element universe.

Description

Technical Field

[0001] The present invention relates to the cross-technical field of metaverse computing resource processing and human body modeling, and in particular to a metaverse scene construction and information perception platform based on a human body finite element model. Background Art

[0002] The Metaverse is a virtual world built by digital technology. It not only maps the real world, but also expands the possibilities of virtual space. In this virtual environment, users can carry out various social, work and entertainment activities through digital avatars. In order to achieve a more realistic interactive experience, the generation of personalized human digital models becomes crucial. These models must not only realistically reflect the user's appearance, but also accurately simulate the user's movements and emotional expressions.

[0003] At present, artificial intelligence modeling cannot completely replace the results of three-dimensional acquisition and manual modeling. Therefore, the generation of personalized human digital models driven by artificial intelligence needs to solve problems such as missing data and low algorithm efficiency. Multi-source perception technology for virtual-real fusion is urgently needed. In the current mainstream virtual-real fusion framework, users upload behavioral data such as interactions through the network, and the cloud server runs the corresponding calculation process and transmits the feedback results to the human body through the network. However, this framework has problems such as poor real-time performance and poor perception effect, and cannot effectively feedback to users the multi-source perception of contact force, temperature, etc. in the metaverse space-time. Summary of the invention

[0004] The purpose of this invention is to provide a metaverse scene construction and information perception platform based on the finite element model of the human body, which can respond to users' actual contact force, temperature and other multi-perception conditions in the metaverse space and time, and realize a more natural and smooth metaverse experience.

[0005] The above technical objectives of the present invention are achieved through the following technical solutions:

[0006] A metaverse scene construction and information perception platform based on a human finite element model, including a personalized modeling module, a multi-physics scene construction module, and a multi-source data transmission module;

[0007] The personalized modeling module is used to generate human finite element models with different physical signs, and includes a basic model unit, an image acquisition unit, a mesh deformation unit, and a geometry generation unit;

[0008] The multi-physics field scene construction module is used to build a complex metaverse scene, including a temperature physics field unit, a contact force physics field unit, and a cloud computing unit;

[0009] The multi-source data transmission module is used to transmit multi-source data obtained by simulation in a multi-physical field scene to a human body, and includes a wearable somatosensory device and a simulation data decoupling unit.

[0010] The present invention also provides a method for using a metaverse scene construction and information perception platform based on a human body finite element model, comprising the following steps:

[0011] Step 1: Establish a reference human finite element model in the basic model unit in the personalized modeling module, wherein the reference human finite element model is a human finite element model including a complete human body structure such as 50th THUMS and GHBMC;

[0012] Step 2, collecting the current human body two-dimensional RGB image to be uploaded to the metaverse space in the image acquisition unit;

[0013] Step 3, input the acquired two-dimensional RGB image of the human body into the geometry generation unit, obtain the corresponding human body surface SMPL model based on the pre-trained human body 3D reconstruction deep learning model such as HMR and SMPLfiy, and then input the acquired body surface SMPL model into the human body skeletal 3D reconstruction deep learning model based on OSSO to obtain the corresponding human body skeletal geometry model;

[0014] Step 4: input the body surface SMPL model and the bone geometry model into the mesh deformation unit, and deform the body surface and bone finite element models in the reference human body finite element model into the personalized human body surface and bone geometry models obtained in step 3 based on the mesh deformation algorithm, thereby generating a personalized human body finite element model;

[0015] Step 5, creating a mechanical simulation environment based on the contact force physical field unit in the multi-physics scene construction module, and creating a temperature simulation environment based on the temperature physical field unit;

[0016] Step 6: In the cloud computing unit, multi-physics field simulation is performed on the mechanical and temperature simulation environment at the current moment to obtain surface contact force and surface temperature data of the human body finite element model;

[0017] Step 7, inputting the simulation data obtained in the cloud computing unit into the data decoupling unit in the multi-source data transmission module for data decoupling, and obtaining the contact force signal and the temperature signal;

[0018] Step 8, inputting the contact force signal and the temperature signal into the wearable somatosensory device, thereby realizing the human body's perception of the metaverse scene in the real space;

[0019] Step 9, repeat steps 2-8 to realize the perception of metaverse scene information at the next moment.

[0020] In summary, the present invention has the following beneficial effects:

[0021] First, the platform uses the benchmark human finite element model (such as 50th's THUMS and GHBMC models) as a basis, combined with the current human 2D RGB image, to achieve rapid reconstruction from 2D images to 3D human models. Through pre-trained human 3D reconstruction deep learning models (such as HMR and SMPLify), it is possible to efficiently obtain a personalized human body surface SMPL model, and further obtain a human skeleton geometry model through the OSSO model. On this basis, through the mesh deformation algorithm, the benchmark model is accurately deformed into a personalized human body model, which improves the realism and dynamic performance of the human body model.

[0022] Second, by creating a mechanical simulation environment and a temperature simulation environment, the platform can perform multi-physics field simulation in the cloud computing unit and obtain the surface contact force and surface temperature data of the personalized human finite element model in real time. Through data decoupling technology, the contact force signal and the temperature signal are separated and transmitted to the wearable somatosensory device, so that users can feel the mechanical and temperature changes in the metaverse scene in real space, enhancing the user's immersion and interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a framework diagram of the present invention;

[0024] Figure 2 It is a logic flow chart of the present invention. DETAILED DESCRIPTION

[0025] In order to make those skilled in the art better understand the technical scheme of the present invention, the present invention is further described in detail below in conjunction with embodiments. It will be understood by those skilled in the art that the following embodiments are only used to illustrate the present invention and should not be regarded as limiting the scope of the present invention.

[0026] Embodiment, a metaverse scene construction and information perception platform based on human finite element model, referring to Figure 1 , including personalized modeling module, multi-physics scene construction module, and multi-source data transmission module;

[0027] The personalized modeling module is used to generate human finite element models with different physical signs, and includes a basic model unit, an image acquisition unit, a mesh deformation unit, and a geometry generation unit;

[0028] The multi-physics field scene construction module is used to build a complex metaverse scene, including a temperature physics field unit, a contact force physics field unit, and a cloud computing unit;

[0029] The multi-source data transmission module is used to transmit multi-source data obtained by simulation in a multi-physical field scene to a human body, and includes a wearable somatosensory device and a simulation data decoupling unit.

[0030] Reference Figure 2 , a method for using a metaverse scene construction and information perception platform based on a human body finite element model, comprising the following steps:

[0031] Step 1: Establish a reference human finite element model in the basic model unit in the personalized modeling module, wherein the reference human finite element model is a human finite element model including a complete human body structure such as 50th THUMS and GHBMC;

[0032] Step 2, collecting the current human body two-dimensional RGB image to be uploaded to the metaverse space in the image acquisition unit;

[0033] Step 3, input the acquired two-dimensional RGB image of the human body into the geometry generation unit, obtain the corresponding human body surface SMPL model based on the pre-trained human body 3D reconstruction deep learning model such as HMR and SMPLfiy, and then input the acquired body surface SMPL model into the human body skeletal 3D reconstruction deep learning model based on OSSO to obtain the corresponding human body skeletal geometry model;

[0034] Step 4: input the body surface SMPL model and the bone geometry model into the mesh deformation unit, and deform the body surface and bone finite element models in the reference human body finite element model into the personalized human body surface and bone geometry models obtained in step 3 based on the mesh deformation algorithm, thereby generating a personalized human body finite element model;

[0035] Step 5, creating a mechanical simulation environment based on the contact force physical field unit in the multi-physics scene construction module, and creating a temperature simulation environment based on the temperature physical field unit;

[0036] Step 6: In the cloud computing unit, multi-physics field simulation is performed on the mechanical and temperature simulation environment at the current moment to obtain surface contact force and surface temperature data of the human body finite element model;

[0037] Step 7, inputting the simulation data obtained in the cloud computing unit into the data decoupling unit in the multi-source data transmission module for data decoupling, and obtaining the contact force signal and the temperature signal;

[0038] Step 8, inputting the contact force signal and the temperature signal into the wearable somatosensory device, thereby realizing the human body's perception of the metaverse scene in the real space;

[0039] Step 9, repeat steps 2-8 to realize the perception of metaverse scene information at the next moment.

[0040] The metaverse scene construction and information perception platform based on the human body finite element model has the following significant effects:

[0041] 1. High-precision personalized modeling:

[0042] The platform uses benchmark human finite element models (such as the 50th THUMS and GHBMC models) to ensure the basic structural accuracy of the human body model.

[0043] Combined with the current two-dimensional RGB image of the human body, a personalized human body surface SMPL model can be efficiently generated through pre-trained human three-dimensional reconstruction deep learning models (such as HMR and SMPLify).

[0044] The OSSO human skeleton 3D reconstruction model is further used to obtain a detailed human skeleton geometry model, ensuring the authenticity and naturalness of human movements.

[0045] Through the mesh deformation algorithm, the body surface and bone model in the benchmark human finite element model are deformed into a personalized human body geometric model, achieving the generation of a highly personalized human finite element model.

[0046] 2. Multi-physics simulation and real-time feedback:

[0047] Based on the contact force physics unit and temperature physics unit in the multi-physics scene building module, accurate mechanical simulation environment and temperature simulation environment are created.

[0048] Multi-physics field simulation in the cloud computing unit can obtain the contact force and surface temperature data of the surface of the human body finite element model in real time, providing high-precision physical simulation results.

[0049] Through data decoupling technology, complex multi-physics field simulation data is decomposed into easy-to-process contact force signals and temperature signals to facilitate subsequent real-time feedback.

[0050] 3. Enhanced user experience and immersion:

[0051] The simulated contact force signal and temperature signal are transmitted to a wearable somatosensory device, allowing the user to feel the mechanical and temperature changes in the virtual scene in the real space.

[0052] Users can sense the contact force and temperature in the metaverse in real time, which greatly enhances the user's immersion and interactive experience.

[0053] Efficient data processing and real-time feedback mechanisms ensure that the interaction delay between users and the virtual environment is extremely low, improving the realism and naturalness of the interaction.

[0054] 4. Dynamic update and continuous perception:

[0055] By repeatedly repeating a series of processes such as image acquisition, 3D reconstruction, mesh deformation, and multi-physics field simulation, the platform can continuously update the state of the human body model and its perception information in the metaverse.

[0056] The dynamic update mechanism ensures that the user experience in the Metaverse is always kept up to date, enhancing the real-time and dynamic adaptability of the system.

[0057] 5. Wide applicability and scalability:

[0058] This platform can not only be applied to personal entertainment and social fields, but can also be expanded to multiple fields such as medical health, virtual fitting, sports analysis, etc., and has broad applicability prospects.

[0059] Through flexible modular design, new algorithms and technologies can be easily integrated to further improve the performance and functionality of the system.

[0060] In summary, this platform not only improves the generation accuracy and real-time performance of the human digital model, but also solves the problem of multi-source perception, provides users with a highly realistic metaverse interactive environment, greatly enriches the interaction mode between virtual and reality, and has important practical application value.

[0061] The above embodiments are merely explanations of the present invention and are not limitations of the present invention. After reading this specification, those skilled in the art may make modifications to the embodiments without any creative contribution as needed. However, such modifications are protected by the patent law as long as they are within the scope of the claims of the present invention.

Claims

1. A metaverse scene construction and information perception platform based on a human finite element model, characterized by: Including personalized modeling module, multi-physics scene construction module, and multi-source data transmission module; The personalized modeling module is used to generate human finite element models with different physical signs, and includes a basic model unit, an image acquisition unit, a mesh deformation unit, and a geometry generation unit; The multi-physics field scene construction module is used to build a complex metaverse scene, including a temperature physics field unit, a contact force physics field unit, and a cloud computing unit; The multi-source data transmission module is used to transmit multi-source data obtained by simulation in a multi-physical field scene to a human body, and includes a wearable somatosensory device and a simulation data decoupling unit.

2. The method for using the metaverse scene construction and information perception platform based on the human body finite element model according to claim 1 is characterized in that: The following steps are involved: Step 1: Establish a reference human finite element model in the basic model unit in the personalized modeling module, wherein the reference human finite element model is a human finite element model including a complete human body structure such as 50th THUMS and GHBMC; Step 2, collecting the current human body two-dimensional RGB image to be uploaded to the metaverse space in the image acquisition unit; Step 3, input the acquired two-dimensional RGB image of the human body into the geometry generation unit, obtain the corresponding human body surface SMPL model based on the pre-trained human body 3D reconstruction deep learning model such as HMR and SMPLfiy, and then input the acquired body surface SMPL model into the human body skeletal 3D reconstruction deep learning model based on OSSO to obtain the corresponding human body skeletal geometry model; Step 4: input the body surface SMPL model and the bone geometry model into the mesh deformation unit, and deform the body surface and bone finite element models in the reference human body finite element model into the personalized human body surface and bone geometry models obtained in step 3 based on the mesh deformation algorithm, thereby generating a personalized human body finite element model; Step 5, creating a mechanical simulation environment based on the contact force physical field unit in the multi-physics scene construction module, and creating a temperature simulation environment based on the temperature physical field unit; Step 6: In the cloud computing unit, multi-physics field simulation is performed on the mechanical and temperature simulation environment at the current moment to obtain surface contact force and surface temperature data of the human body finite element model; Step 7, inputting the simulation data obtained in the cloud computing unit into the data decoupling unit in the multi-source data transmission module for data decoupling, and obtaining the contact force signal and the temperature signal; Step 8, inputting the contact force signal and the temperature signal into the wearable somatosensory device, thereby realizing the human body's perception of the metaverse scene in the real space; Step 9, repeat steps 2-8 to realize the perception of metaverse scene information at the next moment.

Images