Clothing fabric dynamic simulation method and system based on neural network

Abstract

The invention relates to the technical field of image data processing, in particular to a garment fabric dynamic simulation method and system based on a neural network, and the garment fabric dynamic simulation system based on the neural network comprises a material texture simulation module, a physical simulation module, a cutting and sewing simulation module and a dressing effect simulation module. The material and texture simulation module simulates visual effects of real materials and textures on the virtual clothing cloth; the physical simulation module enables the virtual garment fabric to simulate a real physical effect, so that the virtual garment fabric looks real and natural; the cutting and sewing simulation module is used for cutting and sewing the virtual garment cloth into virtual garments; the dressing effect simulation module is used for trying on virtual clothes on the virtual human body model, adding animations and observing dynamic virtual clothes cloth; and the physical simulation module accurately and vividly simulates the wrinkle effect of the virtual garment fabric, so that the problem that the existing virtual garment fabric is not real enough is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of image data processing, and in particular to a method and system for dynamic simulation of clothing fabrics based on neural network. Background Art

[0002] Virtual clothing fabrics are created by simulating the material, texture, gloss, softness, drape and other characteristics of real fabrics through computer graphics, physical simulation and artificial intelligence technology, in order to create digital fabrics that can present a high sense of reality in a virtual environment.

[0003] However, real cloth is a flexible material that can easily bend and deform, producing wrinkles of varying degrees. These wrinkles can display varying degrees of detail. Existing technologies cannot accurately and realistically simulate these wrinkles on virtual clothing fabrics, causing the virtual clothing fabrics to look unrealistic. Summary of the invention

[0004] The purpose of the present invention is to provide a method and system for dynamic simulation of clothing fabrics based on neural networks, aiming to solve the problem that existing virtual clothing fabrics are not realistic enough.

[0005] To achieve the above-mentioned purpose, in a first aspect, the present invention provides a clothing fabric dynamic simulation system based on a neural network, comprising a material texture simulation module, a physical simulation module, a cutting and sewing simulation module and a dressing effect simulation module; the physical simulation module is connected to the material texture simulation module; the cutting and sewing simulation module is connected to the physical simulation module; the dressing effect simulation module is connected to the cutting and sewing simulation module;

[0006] The material texture simulation module is used to simulate the visual effects of real materials and textures on virtual clothing fabrics;

[0007] The physical simulation module is used to make the virtual clothing fabric simulate the real physical effect;

[0008] The cutting and sewing simulation module is used to cut and sew virtual clothing fabrics into virtual clothing, and send them to the dressing effect simulation module;

[0009] The dressing effect simulation module is used to try on virtual clothing on a virtual human model and add animation to make the virtual human model move.

[0010] Wherein, the material texture simulation module includes a material simulation unit and a texture mapping unit; the texture mapping unit is connected to the material simulation unit;

[0011] The material simulation unit is used to simulate the visual effects of different materials on the virtual clothing fabric;

[0012] The texture mapping unit is used to naturally map high-resolution textures onto virtual clothing fabrics.

[0013] Wherein, the physical simulation module includes a mesh generation and editing unit, a physical property simulation unit and a collision response simulation unit; the physical property simulation unit is connected to the mesh generation and editing unit; the collision response simulation unit is connected to the physical property simulation unit;

[0014] The mesh generation and editing unit is used to create a virtual clothing cloth mesh and edit and modify the topological structure of the mesh;

[0015] The physical property simulation unit is used to define the physical properties of the virtual clothing fabric;

[0016] The collision response simulation unit is used to simulate the deformation caused by the collision of virtual clothing fabric with other objects.

[0017] Wherein, the cutting and sewing simulation module comprises a cutting and sewing unit and a sewing optimization unit; the sewing optimization unit is connected to the cutting and sewing unit;

[0018] The cutting and sewing unit is used to cut and sew the virtual clothing fabric to complete the pattern design and make the virtual clothing;

[0019] The stitching optimization unit is used to optimize the stitching parts of the virtual clothing made by cutting and stitching, so as to make it closer to the real visual effect.

[0020] Wherein, the clothing fabric dynamic simulation system based on neural network also includes an advanced rendering module; the advanced rendering module is connected to the dressing effect simulation module;

[0021] The advanced rendering module is used to simulate real light and shadow to enhance the authenticity of the visual effect of virtual clothing fabrics.

[0022] Wherein, the advanced rendering module includes a global illumination unit and an optimization processing unit; the optimization processing unit is connected to the global illumination unit;

[0023] The global illumination unit is used to simulate the reflection and refraction effects of light on virtual clothing fabrics;

[0024] The optimization processing unit is used to simulate the shadow relationship between the virtual clothing fabric and the surrounding environment, so as to improve the realism and three-dimensionality of the virtual clothing fabric.

[0025] In a second aspect, the present invention further provides a method for dynamic simulation of clothing fabrics based on a neural network, comprising:

[0026] The material texture simulation module is used to simulate the visual effects of real materials and textures on virtual clothing fabrics;

[0027] The physical simulation module is used to simulate the real physical effect of virtual clothing fabrics, making the virtual clothing fabrics look real and natural;

[0028] Using a cutting and sewing simulation module to cut and sew virtual clothing fabrics into virtual clothing;

[0029] Use the dressing effect simulation module to try on virtual clothing on a virtual human model, add animation, and observe the virtual clothing fabric in motion.

[0030] The invention discloses a clothing fabric dynamic simulation method and system based on neural network. The material texture simulation module is used to simulate the visual effects of real material and texture on virtual clothing fabric respectively; the physical simulation module is used to make the virtual clothing fabric simulate the real physical effect, so that the virtual clothing fabric looks real and natural; the cutting and sewing simulation module is used to cut and sew the virtual clothing fabric into virtual clothing; the dressing effect simulation module is used to try the virtual clothing on a virtual human body model, and animation is added to observe the virtual clothing fabric in dynamic state; the physical simulation module is used to accurately and realistically simulate the wrinkle effect of the virtual clothing fabric, so as to solve the problem that the existing virtual clothing fabric is not realistic enough. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below.

[0032] Figure 1 It is a schematic structural diagram of the first embodiment of the present invention.

[0033] Figure 2 It is a structural diagram of a material texture simulation module according to the first embodiment of the present invention.

[0034] Figure 3 It is a schematic diagram of the structure of the physical simulation module of the first embodiment of the present invention.

[0035] Figure 4 4 is a schematic diagram of the structure of the cutting and sewing simulation module according to the first embodiment of the present invention.

[0036] Figure 5 It is a structural diagram of a dressing effect simulation module according to the first embodiment of the present invention.

[0037] Figure 6 It is a schematic structural diagram of the second embodiment of the present invention.

[0038] Figure 74 is a schematic diagram of the structure of an advanced rendering module according to the second embodiment of the present invention.

[0039] Figure 8 It is a schematic structural diagram of the third embodiment of the present invention.

[0040] Fig. 9 4 is a schematic diagram of the structure of the environment interaction module of the third embodiment of the present invention.

[0041] Fig.10 4 is a schematic structural diagram of a fourth embodiment of the present invention.

[0042] 101-Material texture simulation module, 102-Physical simulation module, 103-Cutting and stitching simulation module, 104-Dressing effect simulation module, 105-Material simulation unit, 106-Texture mapping unit, 107-Grid generation and editing unit, 108-Physical property simulation unit, 109-Collision response simulation unit, 110-Cutting and stitching unit, 111-Stitching optimization unit, 112-Storage unit, 113-Animation simulation unit, 201-Advanced rendering module, 202-Global illumination unit, 203-Optimization processing unit, 301-Environment interaction module, 302-Wind simulation unit, 303-Gravity simulation unit. DETAILED DESCRIPTION

[0043] The first embodiment of the present application is:

[0044] See also Figure 1-Figure 5 ,in, Figure 1 It is a schematic structural diagram of the first embodiment of the present invention. Figure 2 It is a structural diagram of a material texture simulation module according to the first embodiment of the present invention. Figure 3 It is a schematic diagram of the structure of the physical simulation module of the first embodiment of the present invention. Figure 4 4 is a schematic diagram of the structure of the cutting and sewing simulation module according to the first embodiment of the present invention. Figure 5 It is a structural diagram of a dressing effect simulation module according to the first embodiment of the present invention.

[0045] The invention provides a clothing cloth dynamic simulation system based on neural network, comprising a material texture simulation module 101, a physical simulation module 102, a cutting and sewing simulation module 103 and a dressing effect simulation module 104; the material texture simulation module 101 comprises a material simulation unit 105 and a texture mapping unit 106; the physical simulation module 102 comprises a grid generation and editing unit 107, a physical property simulation unit 108 and a collision response simulation unit 109; the cutting and sewing simulation module 103 comprises a cutting and sewing unit 110 and a sewing optimization unit 111; the dressing effect simulation module 104 comprises a storage unit 112 and an animation simulation unit 113; the above-mentioned scheme solves the problem that the existing virtual clothing cloth is not realistic enough.

[0046] According to this specific implementation, the physical simulation module 102 is connected to the material texture simulation module 101; the cutting and sewing simulation module 103 is connected to the physical simulation module 102; the dressing effect simulation module 104 is connected to the cutting and sewing simulation module 103;

[0047] The material texture simulation module 101 is used to simulate the visual effects of real materials and textures on virtual clothing fabrics;

[0048] The physical simulation module 102 is used to make the virtual clothing fabric simulate the real physical effect;

[0049] The cutting and sewing simulation module 103 is used to cut and sew virtual clothing fabrics into virtual clothing, and send them to the dressing effect simulation module 104;

[0050] The dressing effect simulation module 104 is used to try on the virtual clothing on the virtual human model and add animation to make the virtual human model move.

[0051] The material texture simulation module 101 is used to simulate the visual effects of real materials and textures on virtual clothing fabrics; the physical simulation module 102 is used to simulate the real physical effects of virtual clothing fabrics, so that the virtual clothing fabrics look real and natural; the cutting and sewing simulation module 103 is used to cut and sew the virtual clothing fabrics into virtual clothing; the dressing effect simulation module 104 is used to try the virtual clothing on a virtual human body model, and animation is added to observe the virtual clothing fabrics in dynamic conditions; the physical simulation module 102 is used to accurately and realistically simulate the wrinkle effect of virtual clothing fabrics, thereby solving the problem that the existing virtual clothing fabrics are not realistic enough.

[0052] Wherein, the texture mapping unit 106 is connected to the material simulation unit 105;

[0053] The material simulation unit 105 is used to simulate the visual effects of different materials on the virtual clothing fabric;

[0054] The texture mapping unit 106 is used to naturally map high-resolution textures onto virtual clothing fabrics.

[0055] The material simulation unit 105 is used to define the basic properties of the virtual clothing fabric, including color, glossiness, transparency, refractive index, etc. The texture mapping unit 106 is used to map the high-resolution texture image to the virtual clothing fabric to avoid increasing the details and realism of the virtual clothing fabric.

[0056] Secondly, the physical property simulation unit 108 is connected to the mesh generation and editing unit 107; the collision response simulation unit 109 is connected to the physical property simulation unit 108;

[0057] The mesh generation and editing unit 107 is used to create a virtual clothing cloth mesh and edit and modify the topological structure of the mesh;

[0058] The physical property simulation unit 108 is used to define the physical properties of the virtual clothing fabric;

[0059] The collision response simulation unit 109 is used to simulate the deformation caused by the collision of virtual clothing fabric with other objects.

[0060] The mesh generation and editing unit 107 is used to create a mesh for simulating virtual clothing fabrics, using neural network mesh division, generally using triangular meshes, to complete the deformation simulation of virtual clothing fabrics, making the wrinkles more realistic; the physical property simulation unit 108 is used to define the physical properties of virtual clothing fabrics, including elastic modulus, Poisson's ratio, etc.; the collision response simulation unit 109 is used to detect the collision between virtual clothing fabrics and other fabrics, calculate force transmission and deformation, and make the overall look more realistic.

[0061] At the same time, the stitching optimization unit 111 is connected to the cutting and stitching unit 110;

[0062] The cutting and sewing unit 110 is used to cut and sew virtual clothing fabrics to complete the pattern design and make virtual clothing;

[0063] The stitching optimization unit 111 is used to optimize the stitching parts of the virtual clothing made by cutting and stitching to make it closer to the real visual effect.

[0064] The cutting and sewing unit 110 is used to design the pattern of virtual clothing fabric to make virtual clothing, and the sewing optimization unit 111 is used to optimize some sewing parts of the virtual clothing, such as simulating the sewing lines to make it look closer to reality.

[0065] In addition, the animation simulation unit 113 is connected to the storage unit 112;

[0066] The storage unit 112 is used to store the virtual human body model;

[0067] The animation simulation unit 113 is used to enable the virtual human body model to perform some basic movements of a normal human body.

[0068] The storage unit 112 is used to store the virtual human body model, and the animation simulation unit 113 is used to bind the virtual clothing to the virtual human body model, and follow the virtual human body model to perform some daily actions, so as to observe the authenticity of the visual effect of the virtual clothing fabric.

[0069] The neural network-based clothing fabric dynamic simulation system described in this embodiment utilizes the material texture simulation module 101 to simulate the visual effects of real materials and textures on virtual clothing fabrics; utilizes the physical simulation module 102 to make the virtual clothing fabric simulate real physical effects, so that the virtual clothing fabric looks real and natural; utilizes the cutting and sewing simulation module 103 to cut and sew the virtual clothing fabric into virtual clothing; utilizes the dressing effect simulation module 104 to try on the virtual clothing on a virtual human body model, and adds animation to observe the virtual clothing fabric in dynamic state; utilizes the physical simulation module 102 to accurately and realistically simulate the wrinkle effect of the virtual clothing fabric, thereby solving the problem that the existing virtual clothing fabric is not realistic enough.

[0070] The second embodiment of the present application is:

[0071] Based on the first embodiment, please refer to Figure 6-Figure 7 ,in, Figure 6 It is a schematic structural diagram of the second embodiment of the present invention. Figure 7 4 is a schematic diagram of the structure of an advanced rendering module according to the second embodiment of the present invention.

[0072] The neural network-based clothing fabric dynamic simulation system provided by the present invention further includes an advanced rendering module 201 ; the advanced rendering module 201 includes a global illumination unit 202 and an optimization processing unit 203 .

[0073] For this specific implementation, the advanced rendering module 201 is connected to the dressing effect simulation module 104;

[0074] The advanced rendering module 201 is used to simulate real light and shadow to enhance the authenticity of the visual effect of virtual clothing fabrics.

[0075] The advanced rendering module 201 is used to simulate real light and shadow to improve the authenticity of virtual clothing fabric simulation.

[0076] Wherein, the optimization processing unit 203 is connected to the global illumination unit 202;

[0077] The global illumination unit 202 is used to simulate the reflection and refraction effects of light on virtual clothing fabrics;

[0078] The optimization processing unit 203 is used to simulate the shadow relationship between the virtual clothing fabric and the surrounding environment, so as to improve the realism and three-dimensionality of the virtual clothing fabric.

[0079] The global illumination unit 202 adopts global illumination technology, which is divided into direct illumination, indirect illumination and ambient illumination, to enhance the realism of rendering. The optimization processing unit 203 simulates the shadow relationship between the virtual clothing fabric and the surrounding environment, enhances the realism and three-dimensional sense of the virtual clothing fabric, and applies anti-aliasing technology to make the edge of the virtual clothing fabric smoother.

[0080] In the neural network-based clothing fabric dynamic simulation system described in this embodiment, the global illumination unit 202 adopts global illumination technology, which is divided into direct illumination, indirect illumination and ambient illumination to enhance the realism of rendering; the optimization processing unit 203 simulates the shadow relationship between the virtual clothing fabric and the surrounding environment to enhance the realism and stereoscopic sense of the virtual clothing fabric, and applies anti-aliasing technology to make the edge of the virtual clothing fabric smoother.

[0081] The third embodiment of the present application is:

[0082] Based on the second embodiment, please refer to Figure 8-Figure 9 ,in, Figure 8 It is a schematic structural diagram of the third embodiment of the present invention. Fig. 9 4 is a schematic diagram of the structure of the environment interaction module of the third embodiment of the present invention.

[0083] The neural network-based clothing fabric dynamic simulation system provided by the present invention further includes an environment interaction module 301 ; the environment interaction module 301 includes a wind simulation unit 302 and a gravity simulation unit 303 .

[0084] According to this specific implementation, the environment interaction module 301 is connected to the dressing effect simulation module 104 .

[0085] The environment interaction module 301 is used to simulate the influence of wind and gravity on virtual clothing fabrics.

[0086] The environment interaction module 301 uses a dynamic model to simulate the effects of wind and gravity on virtual clothing fabrics.

[0087] Wherein, the gravity simulation unit 303 is connected to the wind simulation unit 302;

[0088] The wind simulation unit 302 is used to simulate the movement state of the virtual clothing under the action of wind;

[0089] The gravity simulation unit 303 is used to simulate the wrinkles and shapes formed when the virtual clothing droops naturally.

[0090] The wind simulation unit 302 simulates the movement state of the virtual clothing under the action of wind; the gravity simulation unit 303 simulates the wrinkles and shapes formed when the virtual clothing droops naturally, which is used to observe the movement state of the virtual clothing fabric in the natural environment.

[0091] In the neural network-based clothing fabric dynamic simulation system described in this embodiment, the wind simulation unit 302 simulates the movement state of the virtual clothing under the action of wind; the gravity simulation unit 303 simulates the wrinkles and shapes formed when the virtual clothing droops naturally, which is used to observe the movement state of the virtual clothing fabric in the natural environment.

[0092] The fourth embodiment of the present application is:

[0093] See also Fig.10 ,in, Fig.10 4 is a schematic structural diagram of a fourth embodiment of the present invention.

[0094] The invention provides a neural network-based clothing fabric dynamic simulation method, comprising:

[0095] S1 uses the material texture simulation module 101 to simulate the visual effects of real materials and textures on virtual clothing fabrics;

[0096] S2 uses the physical simulation module 102 to make the virtual clothing fabric simulate the real physical effect, so that the virtual clothing fabric looks real and natural;

[0097] S3 uses the cutting and sewing simulation module 103 to cut and sew the virtual clothing fabric into the virtual clothing;

[0098] S4 utilizes the dressing effect simulation module 104 to try on the virtual clothing on the virtual human body model, and adds animation to observe the virtual clothing fabric in dynamic state.

[0099] What is disclosed above is only one or more preferred embodiments of the present application, and cannot be used to limit the scope of rights of the present application. Ordinary technicians in this field can understand that all or part of the processes of implementing the above embodiments and equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A clothing fabric dynamic simulation system based on neural network, characterized in that: It includes a material texture simulation module, a physical simulation module, a cutting and sewing simulation module and a dressing effect simulation module; the physical simulation module is connected to the material texture simulation module; the cutting and sewing simulation module is connected to the physical simulation module; the dressing effect simulation module is connected to the cutting and sewing simulation module; The material texture simulation module is used to simulate the visual effects of real materials and textures on virtual clothing fabrics; The physical simulation module is used to make the virtual clothing fabric simulate the real physical effect; The cutting and sewing simulation module is used to cut and sew virtual clothing fabrics into virtual clothing, and send them to the dressing effect simulation module; The dressing effect simulation module is used to try on virtual clothing on a virtual human model and add animation to make the virtual human model move.

2. A clothing fabric dynamic simulation system based on neural network as claimed in claim 1, characterized in that: The material texture simulation module includes a material simulation unit and a texture mapping unit; the texture mapping unit is connected to the material simulation unit; The material simulation unit is used to simulate the visual effects of different materials on the virtual clothing fabric; The texture mapping unit is used to naturally map high-resolution textures onto virtual clothing fabrics.

3. A clothing fabric dynamic simulation system based on neural network as claimed in claim 2, characterized in that: The physical simulation module includes a mesh generation and editing unit, a physical property simulation unit and a collision response simulation unit; the physical property simulation unit is connected to the mesh generation and editing unit; the collision response simulation unit is connected to the physical property simulation unit; The mesh generation and editing unit is used to create a virtual clothing cloth mesh and edit and modify the topological structure of the mesh; The physical property simulation unit is used to define the physical properties of the virtual clothing fabric; The collision response simulation unit is used to simulate the deformation caused by the collision of virtual clothing fabric with other objects.

4. A clothing fabric dynamic simulation system based on neural network as claimed in claim 3, characterized in that: The cutting and sewing simulation module includes a cutting and sewing unit and a sewing optimization unit; the sewing optimization unit is connected to the cutting and sewing unit; The cutting and sewing unit is used to cut and sew the virtual clothing fabric to complete the pattern design and make the virtual clothing; The stitching optimization unit is used to optimize the stitching parts of the virtual clothing made by cutting and stitching, so as to make it closer to the real visual effect.

5. A clothing fabric dynamic simulation system based on neural network as claimed in claim 4, characterized in that: The neural network-based clothing cloth dynamic simulation system further includes an advanced rendering module; the advanced rendering module is connected to the dressing effect simulation module; The advanced rendering module is used to simulate real light and shadow to enhance the authenticity of the visual effect of virtual clothing fabrics.

6. A clothing fabric dynamic simulation system based on neural network as claimed in claim 5, characterized in that: The advanced rendering module includes a global illumination unit and an optimization processing unit; the optimization processing unit is connected to the global illumination unit; The global illumination unit is used to simulate the reflection and refraction effects of light on virtual clothing fabrics; The optimization processing unit is used to simulate the shadow relationship between the virtual clothing fabric and the surrounding environment, so as to improve the realism and three-dimensionality of the virtual clothing fabric.

7. A method for dynamic simulation of clothing fabrics based on neural network, applied to a dynamic simulation system for clothing fabrics based on neural network as claimed in any one of claims 1 to 6, characterized in that: include: The material texture simulation module is used to simulate the visual effects of real materials and textures on virtual clothing fabrics; The physical simulation module is used to simulate the real physical effect of virtual clothing fabrics, making the virtual clothing fabrics look real and natural; Using a cutting and sewing simulation module to cut and sew virtual clothing fabrics into virtual clothing; Use the dressing effect simulation module to try on virtual clothing on a virtual human model, add animation, and observe the virtual clothing fabric in motion.

Images