Artificial intelligence Yao-nationality clothing fitting effect simulation equipment

Abstract

The invention relates to the technical field of minority costume digitization, in particular to artificial intelligence Yao-nationality costume fitting effect simulation equipment, which comprises a multi-modal data acquisition module, an intelligent rendering engine module and an immersive interactive terminal module, and the simulation module is used for simulating the draping dynamic state, the silver ornament collision sound effect and the feather fluttering track of the multi-layer structure of the costume, verifying the integrity of culture symbols, generating a virtual fitting model containing physical reality and culture accuracy, and transmitting the virtual fitting model to the immersive interaction terminal module. According to the method, the problems of insufficient dynamic simulation of special materials of Yao nationality clothes and lack of cultural symbol fidelity in the prior art are solved based on virtual try-on model generation of a multi-physics coupling algorithm and a cultural semantic constraint model and in combination with multi-sensory try-on experience of equipment such as VR helmets and the like.

Description

Technical Field

[0001] The present invention relates to the technical field of digitalization of ethnic minority clothing, and in particular to an artificial intelligence Yao ethnic clothing fitting effect simulation device. Background Art

[0002] Yao clothing is a vital component of China's intangible cultural heritage. Characterized by multi-layered construction, intricate embellishments like silver embroidery, specialized fabrics like tie-dye, and unique cultural symbols, its traditional craftsmanship embodies the Yao people's historical memory and ethnic identity. With the acceleration of modernization, traditional clothing faces a critical hurdle in its inheritance. Virtual try-on technology has become a crucial avenue for stimulating cultural communication and innovation. By digitally recreating clothing details and enhancing the user experience, it transcends the temporal and spatial limitations of physical displays while attracting young people to participate in cultural heritage.

[0003] The paper "Application of Virtual Reality and Artificial Intelligence Technology in the Virtual Display and Design Innovation of Liannan Yao Ethnic Clothing" proposes a Liannan Yao Ethnic Clothing VR virtual display system built on the 3DREAL cloud design service platform. The system consists primarily of a VR display module, an interaction module, and a data management module. The VR display module is responsible for realistic scene construction and rendering; the interaction module supports human-computer interaction through voice and gestures; and the data management module stores and accesses data such as 3D models and multimedia resources.

[0004] However, conventional virtual fitting equipment and this fitting system struggle to address the unique characteristics of Yao ethnic costumes: The simulation of dynamic effects, such as the drape of brocade, the weight and collision sound of silver jewelry, and the fluttering trajectory of feathers with movement, is crude. Traditional physics engines can only achieve static rendering of a single material and cannot couple the complex physical fields of multi-material interactions. This makes it difficult to restore the connection between clothing and cultural scenes, and users are unable to perceive the cultural connotations of clothing through multiple senses such as touch and smell. Therefore, an artificial intelligence Yao ethnic costume fitting effect simulation device is proposed to address the core issues of existing technologies: insufficient dynamic simulation of special materials and lack of fidelity of cultural symbols, providing technical support for the digital inheritance and innovation of ethnic minority costumes. Summary of the Invention

[0005] To solve the above problems, the present invention provides an artificial intelligence Yao clothing try-on effect simulation device, which generates a virtual try-on model based on a multi-physical field coupling algorithm and a cultural semantic constraint model, and combines a multi-sensory try-on experience with devices such as VR helmets to solve the problems of insufficient dynamic simulation of the special materials of Yao clothing and lack of fidelity of cultural symbols in the existing technology.

[0006] In order to achieve the above-mentioned purpose, the technical solution of the present invention is as follows: an artificial intelligence Yao ethnic clothing try-on effect simulation device, comprising a multimodal data acquisition module, an intelligent rendering engine module and an immersive interactive terminal module, wherein:

[0007] The multimodal data acquisition module is used to collect the physical attribute data and cultural symbol data of Yao ethnic clothing. It uses a scanner, pressure sensor and cultural feature annotation system to obtain multidimensional data including material physical parameter tables and cultural semantic labels, and transmits the multidimensional data to the intelligent rendering engine module;

[0008] The intelligent rendering engine module receives multi-dimensional data and, based on a multi-physics field coupling algorithm and a cultural semantic constraint model, simulates the draping dynamics of the multi-layered structure of clothing, the sound effects of silver jewelry colliding, and the trajectory of feathers fluttering. It also verifies the integrity of cultural symbols and generates a virtual fitting model that combines physical realism with cultural accuracy. The virtual fitting model is then transmitted to the immersive interactive terminal module.

[0009] The immersive interactive terminal module is signal-connected to a VR helmet, tactile feedback gloves, and a fragrance generator. The immersive interactive terminal module is used to receive a virtual try-on model, and combined with the VR helmet, tactile feedback gloves, and fragrance generator, presents a multi-sensory try-on experience. It also collects user motion data, uses a motion capture algorithm to generate real-time interaction instructions, and transmits the real-time interaction instructions to the intelligent rendering engine module to dynamically update the model.

[0010] Furthermore, the multimodal data acquisition module includes a material physical parameter acquisition unit and a cultural symbol annotation unit, wherein:

[0011] A material physical parameter acquisition unit is used to collect physical property data such as weight, density, and elastic modulus of materials such as silver jewelry, brocade, and feathers. The unit uses an electronic scale, a laser thickness gauge, and a material mechanics testing machine to obtain a material physical parameter table, which is then transmitted to the intelligent rendering engine module.

[0012] The cultural symbol annotation unit is used to mark the symbolic meaning of clothing totems and the key proportions of traditional patterns. It combines an expert knowledge base with an image recognition algorithm to semantically annotate scanned clothing images, generate cultural semantic tags, and transmit the cultural semantic tags to the intelligent rendering engine module.

[0013] Furthermore, the material physical parameter acquisition unit includes:

[0014] The silver jewelry weight distribution subunit is used to collect weight and hanging position data of silver jewelry components such as necklaces, breastplates, and anklets. It uses three-dimensional scanning and a pressure sensor array to obtain the silver jewelry gravity distribution matrix and uploads the silver jewelry gravity distribution matrix to the material physical parameter collection unit.

[0015] The feather dynamic parameter subunit is used to collect data on the feather shaft hardness, feather vane density and natural fluttering trajectory. It uses a camera and a breeze simulation device to obtain the feather aerodynamic parameters, and transmits the feather aerodynamic parameters to the material physical parameter acquisition unit.

[0016] Furthermore, the intelligent rendering engine module includes a multi-physics field coupling calculation unit, a cultural semantic constraint unit, and a model generation unit, wherein:

[0017] The multi-physics coupling calculation unit receives multi-dimensional data and extracts a material physical parameter table. Based on Newtonian mechanics and acoustic models, it simulates the sound effects of silver jewelry colliding with brocade and the trajectory of feathers fluttering in airflow, generates dynamic physical feedback data, and transmits the dynamic physical feedback data to the model generation unit.

[0018] The cultural semantic constraint unit is used to receive multidimensional data and extract cultural semantic labels, establish deformation thresholds and pattern ratio constraint rules that allow ±5% scaling but prohibit totem rotation, perform real-time verification of the virtual try-on model, generate compliance verification results, and transmit the compliance verification results to the model generation unit;

[0019] The model generation unit is used to receive dynamic physical feedback data, compliance verification results and multi-dimensional data. Based on the graphics rendering pipeline of the Unity3D engine and the deep learning generative adversarial network, it integrates the physical simulation results with the cultural compliance constraints to generate a virtual try-on model with real-time dynamic effects. When the "totem proportion abnormality" signal output by the cultural semantic constraint unit is detected, the model correction mechanism is automatically triggered, and the preset traditional pattern template is called to perform geometric correction on the totem area to ensure the cultural symbol integrity of the virtual try-on model. The generated virtual try-on model is synchronously output to the immersive interactive terminal module.

[0020] Furthermore, the multi-physics coupling calculation unit includes a gravity-collision simulation subunit and a fluid-feather simulation subunit, wherein:

[0021] The gravity-collision simulation subunit calculates the gravitational pull of silver jewelry on the main garment body based on the silver jewelry's gravity matrix in the material physical parameter table. When the user's movements cause the silver jewelry to sway, a spring-mass model is used to simulate the deformation data of the brocade. The acoustic engine then generates sound effects of silver bells colliding at the corresponding frequency. These deformation and sound effects are then uploaded to the dynamic physics feedback data for integration.

[0022] The fluid-feather simulation subunit is used to generate a virtual airflow field based on the user's movement speed. Based on the feather aerodynamic parameters in the material physical parameter table, the NS equation is used to calculate the feather fluttering angle and frequency. When the user raises their hand by more than 45 degrees, the dynamic effect of the feather rising is automatically enhanced, and the generated upward dynamic data is uploaded to the dynamic physical feedback data for integration.

[0023] Furthermore, the immersive interactive terminal module includes a multi-sensory feedback unit and a motion interaction processing unit, wherein:

[0024] A multi-sensory feedback unit is configured to receive a virtual try-on model, render a three-dimensional visual effect of the embroidery microstructure through a VR headset, simulate the weight of silver jewelry and the texture of brocade through tactile feedback gloves, and release an odor corresponding to the clothing dye through a fragrance generator, thereby synchronously presenting the multi-sensory data to the user;

[0025] The motion interaction processing unit is used to collect user joint motion data, use an inertial measurement unit and computer vision algorithms to identify walking or turning motion patterns, generate motion feature vectors, and transmit the motion feature vectors to the intelligent rendering engine module to trigger corresponding dynamic simulations.

[0026] Furthermore, the multisensory feedback unit includes a visual rendering subunit and a feedback subunit:

[0027] The visual rendering sub-unit receives fiber structure data on the warp and weft density of apparel fabrics and uses physically based rendering technology to simulate the diffuse reflection of embroidery stitches and the specular reflection of silver jewelry to generate visual data. When the light angle changes, the unit automatically adjusts the fineness of the embroidery shadows and transmits the visual data to the VR headset.

[0028] The feedback sub-unit is used to receive the gravity distribution matrix of the silver jewelry and simulate the weight of different parts through the vibration motor array of the tactile feedback gloves. When the user remains stationary for more than 10 seconds, it automatically switches to "static display mode" to reduce power consumption.

[0029] Furthermore, it also includes a pattern adaptation optimization module for receiving user body shape data and a traditional pattern gene library. The traditional pattern gene library includes the shoulder width-length ratio parameters of Yao ethnic clothing, and uses a genetic algorithm to generate an improved pattern that adapts to modern body shapes, and transmits the improved pattern data to the intelligent rendering engine module.

[0030] Furthermore, the pattern adaptation optimization module includes a body shape data analysis unit and a cultural pattern mapping unit, wherein:

[0031] The body shape data analysis unit is connected to a depth camera. The body shape data analysis unit is used to collect the user's body shape parameters such as shoulder width, waist circumference and leg length through the depth camera, generate a personalized body shape vector using an anthropometric algorithm, and upload the body shape vector to the pattern adaptation optimization module;

[0032] The cultural pattern mapping unit is used to store the key proportion parameters of the traditional pattern of Yao clothing. When the personalized body shape conflicts with the traditional proportion, the non-core parts are adjusted within the allowable range to retain the core elements of the belt position, generate a pattern adjustment plan, and upload the pattern adjustment plan to the pattern adaptation optimization module.

[0033] Furthermore, a data verification interface is set between the intelligent rendering engine module and the multimodal data acquisition module. The data verification interface is used to detect the correlation between the physical parameters of the material and the cultural semantic labels. When contradictory data is detected, it automatically triggers data correction to the multimodal data acquisition module. According to the contradictory data type and specific field of the data correction, combined with the originally collected multidimensional data, the source node of the conflicting data in the acquisition process is located, and the located node is transmitted to the interactive interface for the operator to select "correct parameters", "update cultural labels" or "mark abnormal data".

[0034] The above scheme has the following beneficial effects:

[0035] 1. This solution systematically collects physical parameters of Yao ethnic clothing, such as the weight of silver jewelry and the fiber structure of brocade, using scanners and pressure sensors. It also combines expert knowledge bases with image recognition algorithms to annotate cultural symbols such as totemic meaning and pattern proportions. This addresses the issue of traditional displays prioritizing form over substance, ensuring the material and cultural authenticity of the virtual try-on model. For example, the silver jewelry weight distribution subunit uses 3D scanning to obtain a gravity matrix, providing a data foundation for subsequent physical simulations and avoiding distortion of dynamic effects caused by missing parameters.

[0036] 2. This solution uses a multi-physics coupling algorithm to simulate dynamic effects such as the collision of silver jewelry and the fluttering of feathers. It also incorporates a cultural semantic constraint model (totem deformation thresholds and pattern proportion rules) to ensure the integrity of cultural symbols, achieving a dual breakthrough in both "physical realism" and "cultural accuracy." For example, the gravity-collision simulation subunit calculates the brocade deformation using a spring-mass model and simultaneously generates a silver bell sound effect, making the virtual try-on experience closer to the real experience. The cultural semantic constraint unit verifies totem proportions in real time to avoid the misuse of cultural symbols due to technical processing.

[0037] 3. This solution, using VR headsets, haptic feedback gloves, and fragrance generators, transforms the virtual try-on model into a multi-dimensional "see-touch-smell" experience. Motion capture algorithms enable real-time interaction between users and the garments, addressing the shortcomings of traditional virtual displays, which suffer from limited interaction and insufficient immersion. For example, the visual rendering sub-unit simulates the light and shadow changes of embroidery using physical rendering technology, and the feedback sub-unit simulates the weight of silver jewelry using a vibration motor, allowing users to intuitively experience the craftsmanship and cultural atmosphere of Yao ethnic clothing.

[0038] 4. This solution uses a depth camera to collect user body data, combined with a genetic algorithm and a "culture-first" strategy. While maintaining core elements like the belt position, it adjusts non-essential features like waistband width and cuff width. This approach not only meets modern ergonomic requirements but also avoids the cultural distortion caused by mechanical scaling of traditional silhouettes. For example, if a modern waistline is 20% smaller than the traditional one, the waistband width is increased rather than adjusted, ensuring that cultural symbols of ethnic identity are preserved.

[0039] 5. This solution, by presetting rules for associating material grades with cultural symbols, detects data inconsistencies in real time (e.g., labeling low-grade clothing with high-purity silver jewelry). It also traces and locates the source of collection errors (either manual labeling errors or algorithmic misjudgments) through the link. This allows operators to modify parameters, update labels, or perform additional collections to avoid cultural misinterpretations caused by data errors. This mechanism transforms the Yao ethnic clothing hierarchy into executable algorithmic constraints, enabling the upgrade of cultural logic from manual experience to technical enforcement, ensuring the accuracy of digital heritage.

[0040] 6. In this solution, each module forms a complete technical chain through data transmission and algorithm linkage: multimodal data provides the foundation for intelligent rendering, immersive interaction feeds back into data optimization, and pattern adaptation and data verification ensure the continuity of cultural logic. This model of "technological innovation serving cultural heritage" not only solves the core issues of physical simulation, cultural fidelity, and interactive immersion in the virtual try-on of Yao ethnic clothing, but also provides a reusable technical path for the digital preservation and innovation of other ethnic minority intangible cultural heritage.

[0041] Additional aspects and advantages of the present invention will be set forth in part in the description which follows and, in part, will be obvious from the description which follows, or may be learned by practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 This is a schematic diagram of the system framework of an embodiment of the artificial intelligence Yao ethnic clothing try-on effect simulation device of the present invention;

[0043] Figure 2 This is a schematic diagram of the multimodal data acquisition module system framework of an embodiment of the artificial intelligence Yao ethnic clothing try-on effect simulation device of the present invention;

[0044] Figure 3 This is a schematic diagram of the intelligent rendering engine module system framework of an embodiment of the artificial intelligence Yao ethnic clothing try-on effect simulation device of the present invention;

[0045] Figure 4 This is a schematic diagram of the immersive interactive terminal module system framework of an embodiment of the artificial intelligence Yao clothing try-on effect simulation device of the present invention. DETAILED DESCRIPTION

[0046] The technical solution of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0047] In the description of the present invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings and are intended solely to facilitate and simplify the description of the present invention. They are not intended to indicate or imply that the devices or components referred to must have, be constructed, or operate in a specific orientation, and therefore should not be construed as limitations on the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0048] In the description of the present invention, it should be noted that, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "connected" should be understood in a broad sense. For example, they may refer to fixed, detachable, or integral connections; mechanical or electrical connections; direct or indirect connections through an intermediate medium; and internal communication between two components. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on the specific circumstances.

[0049] The following is further described in detail through specific implementation methods:

[0050] Example 1:

[0051] As attached Figure 1 、 Figure 2 、 Figure 3 and Figure 4 Shown: An artificial intelligence Yao ethnic clothing try-on effect simulation device, including a multimodal data acquisition module, an intelligent rendering engine module and an immersive interactive terminal module, wherein:

[0052] The multimodal data acquisition module is used to collect the physical attribute data and cultural symbol data of Yao ethnic clothing. It uses a scanner, pressure sensor and cultural feature annotation system to obtain multidimensional data including material physical parameter tables and cultural semantic labels, and transmits the multidimensional data to the intelligent rendering engine module;

[0053] The multimodal data acquisition module includes a material physical parameter acquisition unit and a cultural symbol annotation unit, where:

[0054] The material physical parameter acquisition unit is used to collect physical property data such as weight, density, and elastic modulus of materials such as silver jewelry, brocade, and feathers. It uses an electronic scale, laser thickness gauge, and material mechanics testing machine to obtain a material physical parameter table, which is then transmitted to the intelligent rendering engine module. The material physical parameter acquisition unit includes:

[0055] The silver jewelry weight distribution subunit is used to collect weight and hanging position data of silver jewelry components such as necklaces, breastplates, and anklets. It uses three-dimensional scanning and a pressure sensor array to obtain the silver jewelry gravity distribution matrix and uploads the silver jewelry gravity distribution matrix to the material physical parameter collection unit.

[0056] The feather dynamic parameter subunit is used to collect data on the feather rachis hardness, vane density, and natural flutter trajectory. It uses a camera and a breeze simulation device to obtain the feather aerodynamic parameters, and transmits the feather aerodynamic parameters to the material physical parameter acquisition unit.

[0057] The cultural symbol annotation unit is used to annotate the symbolic meaning of clothing totems and key proportions of traditional styles, such as the ratio of shoulder width to length. It uses a combination of expert knowledge base and image recognition algorithm to semantically annotate scanned clothing images, generate cultural semantic tags, and transmit the cultural semantic tags to the intelligent rendering engine module.

[0058] The intelligent rendering engine module receives multi-dimensional data and, based on a multi-physics field coupling algorithm and a cultural semantic constraint model, simulates the draping dynamics of the multi-layered structure of clothing, the sound effects of silver jewelry colliding, and the trajectory of feathers fluttering. It also verifies the integrity of cultural symbols and generates a virtual fitting model that combines physical realism with cultural accuracy. The virtual fitting model is then transmitted to the immersive interactive terminal module.

[0059] The intelligent rendering engine module includes a multi-physics field coupling calculation unit, a cultural semantic constraint unit, and a model generation unit, among which:

[0060] The multi-physics coupling calculation unit is used to receive multi-dimensional data and extract a material physical parameter table. Based on Newtonian mechanics and acoustic models, it simulates the sound effects of the collision between silver jewelry and brocade and the fluttering trajectory of feathers in the airflow, generates dynamic physical feedback data, and transmits the dynamic physical feedback data to the model generation unit. The multi-physics coupling calculation unit includes a gravity-collision simulation subunit and a fluid-feather simulation subunit, in which:

[0061] The gravity-collision simulation subunit calculates the gravitational pull of silver jewelry on the main garment body based on the silver jewelry's gravity matrix in the material physical parameter table. When the user's movements cause the silver jewelry to sway, a spring-mass model is used to simulate the deformation data of the brocade. The acoustic engine then generates sound effects of silver bells colliding at the corresponding frequency. These deformation and sound effects are then uploaded to the dynamic physics feedback data for integration.

[0062] The fluid-feather simulation subunit is used to generate a virtual airflow field based on the user's movement speed. Based on the feather aerodynamic parameters in the material physical parameter table, the NS equation is used to calculate the feather's fluttering angle and frequency. When the user raises their hand by more than 45 degrees, the upward dynamic effect of the feather is automatically enhanced, and the generated upward dynamic data is uploaded to the dynamic physical feedback data for integration;

[0063] The cultural semantic constraint unit is used to receive multidimensional data and extract cultural semantic tags, establish deformation thresholds and pattern proportion constraint rules that allow ±5% scaling but prohibit totem rotation. For example, the belt position must be within ±10% of the waistline. The virtual fitting model is verified in real time, and compliance verification results are generated and transmitted to the model generation unit.

[0064] The model generation unit is used to receive dynamic physical feedback data, compliance verification results and multi-dimensional data. Based on the graphics rendering pipeline of the Unity3D engine and the deep learning generative adversarial network, it integrates the physical simulation results with the cultural compliance constraints to generate a virtual try-on model with real-time dynamic effects. When the "totem proportion abnormality" signal output by the cultural semantic constraint unit is detected, the model correction mechanism is automatically triggered, and the preset traditional pattern template is called to perform geometric correction on the totem area to ensure the cultural symbol integrity of the virtual try-on model. The generated virtual try-on model is synchronously output to the immersive interactive terminal module.

[0065] The immersive interactive terminal module is connected to the VR helmet, tactile feedback gloves, and fragrance generator. The immersive interactive terminal module is used to receive the virtual try-on model, combine the VR helmet, tactile feedback gloves, and fragrance generator to present a multi-sensory try-on experience, collect user motion data, use motion capture algorithms to generate real-time interaction instructions, and transmit the real-time interaction instructions to the intelligent rendering engine module to dynamically update the model.

[0066] The immersive interactive terminal module includes a multi-sensory feedback unit and a motion interaction processing unit, where:

[0067] The multi-sensory feedback unit is used to receive the virtual try-on model, render the three-dimensional visual effect of the embroidery microstructure through the VR helmet, simulate the weight of the silver jewelry and the touch of the brocade texture through the tactile feedback gloves, release the scent corresponding to the clothing dye through the fragrance generator, and synchronously present the multi-sensory data to the user. The multi-sensory feedback unit includes a visual rendering subunit and a feedback subunit:

[0068] The visual rendering sub-unit receives fiber structure data on the warp and weft density of apparel fabrics and uses physically based rendering technology to simulate the diffuse reflection of embroidery stitches and the specular reflection of silver jewelry to generate visual data. When the light angle changes, the unit automatically adjusts the fineness of the embroidery shadows and transmits the visual data to the VR headset.

[0069] The feedback sub-unit receives the silver jewelry's gravity distribution matrix and simulates the weight of different parts of the body through the glove's vibration motor array. When the user remains stationary for more than 10 seconds, the glove automatically switches to "static display mode" to reduce power consumption.

[0070] The motion interaction processing unit is used to collect user joint motion data, use an inertial measurement unit and computer vision algorithms to identify walking or turning motion patterns, generate motion feature vectors, and transmit the motion feature vectors to the intelligent rendering engine module to trigger corresponding dynamic simulations.

[0071] The specific implementation process is as follows: This embodiment takes the "Shuagetang" festival costumes in Liannan Yao Autonomous County as an example, and selects Yao women's formal attire with a typical multi-layer structure, including brocade outer garments, silver necklaces and feather headdresses as test objects. Traditional virtual fitting equipment only collects the geometric dimensions of clothing, ignores the weight distribution of silver jewelry (such as the gravity difference between the collar and the breastplate), the dynamic properties of feathers (such as the fluttering pattern of feathers in the air flow) and the totem cultural semantics (such as the rotation taboo of the totem "Panhu"), resulting in distorted simulation effects and misuse of cultural symbols.

[0072] This example uses an electronic scale to measure the weight of a silver necklace (weighing 320g), a breastplate (weighing 180g), and an anklet (weighing 25g each). Three-dimensional scanning and a pressure sensor array are used to obtain the hanging position of each component. For example, the center point of the necklace is determined to be 15cm from the shoulder. The gravity distribution matrix of the silver jewelry is generated:

[0073] G={(x i ,y i ,z i ,m i )i=1,2,...,n}

[0074] Among them, x i ,y i ,z i are the three-dimensional coordinates of the silver jewelry, m i The weight of silver jewelry.

[0075] A camera was used to capture the feather's trajectory in a 3m / s breeze. The material mechanics testing machine was used to measure the feather shaft elastic modulus of 200MPa and the feather density of 0.3g / cm. 3 , establish the feather aerodynamic parameter set:

[0076] F={k,ρ,v(θ)}

[0077] Where k is the rachis stiffness, ρ is the vane density, and v(θ) is the flutter velocity function at different angles.

[0078] The cultural symbol annotation unit performs image recognition on the "Dragon and Dog Pattern" totem on the clothing. Combined with the expert knowledge base, it is annotated as a symbol of ancestor worship. A deformation threshold is set: scaling is allowed to be ±5% (area change ≤ 10%), and rotation is prohibited (angle deviation ≤ 2°). Traditional pattern parameters are extracted: shoulder width 40cm: length 80cm = 1:2, and the belt is located within ±8cm of the waistline. Cultural semantic labels are generated:

[0079] L = {totem ID, taboo rules, pattern ratio}

[0080] Through the integrated collection of "material physical properties-cultural semantics", multi-dimensional data support is provided for subsequent simulations, avoiding the distortion of physical effects and misinterpretation of cultural symbols due to missing data.

[0081] Since the existing fitting system uses a common physics engine, it can only simulate the static light and shadow of a single material and cannot couple the dynamic interaction of the gravity of silver jewelry, the aerodynamics of feathers, and the deformation of brocade. In addition, it lacks a cultural constraint mechanism, and totems often exceed the limit of scaling or the proportion of the pattern is unbalanced, such as a 20cm offset in the belt position.

[0082] The gravity-collision simulation subunit uses a spring-mass model based on the silver jewelry gravity distribution matrix:

[0083] F=-kΔx-cΔv

[0084] Here, k is the elastic coefficient and c is the damping coefficient, which simulates the deformation of the brocade under the action of external force. When the user raises his hand to trigger the silver jewelry to swing, the acoustic engine calculates the collision frequency and generates the corresponding sound effect:

[0085]

[0086] The fluid-feather simulation subunit generates a virtual airflow field according to the user's movement speed (such as a hand-raising speed of 1.5m / s) and calculates the feather fluttering angle based on the NS equation. When the hand-raising amplitude exceeds 45°, the lift coefficient is automatically increased to enhance the upward dynamic effect.

[0087] The cultural semantic constraint unit is used to verify the totem scaling ratio in the virtual model in real time (for example, when a dragon and dog pattern is detected to be scaled to 110%), the geometric correction algorithm is triggered to force it to be scaled to the allowable range; if the pattern belt position is offset to the waistline + 15cm (exceeding the ±10% threshold), the traditional pattern template is called for automatic adjustment to adjust the waistline data to within the range of ±8cm of the historical data.

[0088] The model generation unit, based on Unity3D's URP rendering pipeline and the StyleGAN generative adversarial network, fuses physical simulation results (such as the dynamics of brocade folds and the swinging trajectory of silver ornaments) with cultural constraints to generate a real-time virtual model. When abnormal totem proportions are detected, local deformations are corrected using TPS thin plate spline transformations to ensure a 95% or higher similarity between the totem and the original pattern.

[0089] Because ordinary VR try-ons only provide visual images and lack tactile feedback (such as the lack of a sense of weight in silver jewelry) and cultural scene interaction (such as the lack of interactive "Shuagetang" collective dance), users find it difficult to perceive the connection between clothing and cultural rituals. Therefore, the visual rendering sub-unit uses PBR material rendering technology based on the warp and weft density of the brocade (60 threads / cm×40 threads / cm) to simulate the diffuse reflection of embroidery stitches (roughness 0.3) and the specular reflection of silver jewelry (metallicity 0.9). When the ambient light switches from 4500K (daylight) to 3000K (bonfire), the shadow softness is automatically adjusted from 10px to 20px, enhancing the realism of the microstructure. The feedback sub-unit simulates the weight of silver jewelry through the vibration motor array of the tactile glove. The collar corresponds to the neck vibration intensity of 3N with an error of ±5%. At the same time, it releases a plant fragrance with a concentration of 20ppm of indigo dye, creating a "sight-touch-smell" trinity experience.

[0090] The motion interaction processing unit uses the IMU inertial sensor and the Open Pose computer vision algorithm to recognize the user's "long drum" movements (such as turning 90 degrees and stepping) in real time and generate the motion feature vector A = {θ1, θ2, ..., θ 18}, where θ1~θ 18 Represented as 18 joint angles, it triggers the intelligent rendering engine to update the silver jewelry swing trajectory and feather fluttering posture, realizing the real-time linkage of "action-clothing dynamics".

[0091] Example 2:

[0092] As attached Figure 1 As shown, the difference from Example 1 is that it also includes a pattern adaptation optimization module for receiving user body shape data and a traditional pattern gene library, the traditional pattern gene library including the shoulder width-length ratio parameters of Yao ethnic clothing, and using a genetic algorithm to generate an improved pattern adapted to modern body shapes, such as adjusting the waist range while maintaining the traditional belt position, and transmitting the improved pattern data to the intelligent rendering engine module;

[0093] The pattern adaptation optimization module includes a body shape data analysis unit and a cultural pattern mapping unit, where:

[0094] The body shape data analysis unit is connected to a depth camera. The body shape data analysis unit is used to collect the user's body shape parameters such as shoulder width, waist circumference and leg length through the depth camera, generate a personalized body shape vector using an anthropometric algorithm, and upload the body shape vector to the pattern adaptation optimization module;

[0095] The cultural pattern mapping unit is used to store the key proportion parameters of the traditional pattern of Yao clothing. When the personalized body shape conflicts with the traditional proportion, such as the modern waist circumference is 20% smaller than the traditional size, the "cultural priority" strategy is automatically activated, and non-core parts are adjusted within the allowable range to retain the core elements of the belt position. A pattern adjustment plan is generated and uploaded to the pattern adaptation optimization module.

[0096] The specific implementation process is as follows: In a virtual try-on scenario of the Liannan Yao ethnic group's "Shuagetang" festival costumes, a traditional women's formal attire (shoulder width 40cm, length 80cm, shoulder width to length ratio 1:2, belt position fixed within the waistline within ±8cm) was selected as the pattern benchmark. For a modern user's body shape (shoulder width 38cm, waist circumference 68cm, 20% smaller than the traditional waist circumference of 85cm), the pattern adaptation optimization module achieves a balance between preserving cultural elements and wearing adaptability through the following process:

[0097] The body shape analysis unit uses a depth camera to collect the user's three-dimensional body shape data, extracting parameters such as shoulder width (38cm), waist circumference (68cm), and leg length (92cm). Using an anthropometric algorithm, it generates a personalized body shape vector (shoulder width to waist circumference ratio of 0.56:1). This is compared with the traditional shoulder width to length ratio (1:2) and waist circumference to length ratio (0.53:1). Significant differences in waist size are found (modern waist sizes are 17cm smaller than traditional waist sizes), triggering the pattern conflict detection mechanism.

[0098] The cultural pattern mapping unit locks immutable parameters such as the belt position (±8cm from the waistline) and the shoulder width-length ratio (1:2) to ensure the cultural identity of "Shuagetang" clothing; and defines adjustable non-core parts: cuff width (±10%), skirt opening (±15%), and waist reduction (±20% relative to the traditional waist circumference).

[0099] Waist Fit: The modern waistline of 68cm is 20% smaller than the traditional 85cm. If the belt were scaled proportionally, it would exceed the culturally acceptable range of ±8cm. Therefore, keeping the belt fixed at the waistline +5cm, by increasing the waistband width, a natural fold is formed at the waist, which not only fits the modern body shape but also avoids disrupting the belt's cultural identity.

[0100] Shoulder width and length are adapted: the shoulder width is increased from 40cm to 38cm, and the length is adjusted to 76cm at the same time in a ratio of 1:2 to ensure that the shoulder width-length ratio remains unchanged; the leg length corresponds to the hem length adjusted from the traditional 80cm to 76cm, and the Unity3D physics engine is used to enhance the draping dynamics of the skirt to maintain visual coordination.

[0101] Compensation design for non-core parts: The cuff width is reduced from the traditional 25cm to 22cm to avoid the cuff being too wide due to the reduction of shoulder width;

[0102] The opening of the skirt has been expanded from the traditional 40cm to 45cm, improving flexibility when walking. At the same time, traditional geometric patterns are added to the edge of the skirt through the AI-assisted design module to shift the visual focus and balance the proportion changes after the version adjustment.

[0103] Verified by the inheritors of Liannan Yao culture, the improved version completely retains the ritual sense and ethnic identity of the "Shuagetang" costumes, and the adjustments to non-core parts have not touched the cultural core.

[0104] Example 3:

[0105] The difference from Example 2 is that a data verification interface is provided between the intelligent rendering engine module and the multimodal data acquisition module. The data verification interface is used to detect the correlation between the physical parameters of the material and the cultural semantic labels, such as whether the weight of the silver jewelry matches the cultural level of the corresponding totem. When contradictory data is detected, such as low-level clothing marked with high-purity silver jewelry parameters, the data correction is automatically triggered to the multimodal data acquisition module. According to the contradictory data type and specific field of the data correction, combined with the originally collected multidimensional data, the source node of the conflicting data in the acquisition process is located, and the located node is transmitted to the interactive interface for the operator to select "correct parameters", "update cultural labels" or "mark abnormal data".

[0106] The specific implementation process is as follows: During the digital collection of Liannan Yao clothing, a set of daily clothing (non-ceremonial attire) was selected as the test object. Its traditional craft archive records it as "cotton and linen brocade with bronze and silver-plated ornaments" (low-level decoration), but the multimodal data collection module initially labeled it as "pure silver ornaments + dragon and dog totems" (high-level cultural symbols). This triggered the conflict detection mechanism of the data verification interface. The data verification interface uses a preset rule engine to compare the correlation between the physical parameters of the material and the cultural semantic labels: When it detects that "bronze and silver-plated ornaments" (low-level material) correspond to "dragon and dog totems" (high-level symbols), violating the cultural rule that "high-level symbols are only used for materials such as pure silver / brocade", a conflict alert is automatically generated, marking the conflict type as "material level-symbol level mismatch" and the specific fields as "silver ornament material type" and "totem ID". The interface combines the original collected multidimensional data to trace the source of the conflict and verify that:

[0107] Material parameter link: Tracing to the "Material Physical Parameter Acquisition Unit" of the multimodal data acquisition module, it was discovered that the operator mistakenly selected "sterling silver" instead of "silver-plated" when marking silver jewelry, which was a manual marking error;

[0108] Cultural label link: Tracing back to the "Cultural Symbol Labeling Unit," it was identified that the image recognition algorithm misclassified "ordinary dog ​​patterns" as "dragon dog totems," which was an algorithm classification error.

[0109] Positioning output: The conflict source node is transmitted to the interactive interface in a visual manner, prompting the operator that the conflict type is "mixed error".

[0110] The operator selects the correction path through the interactive interface:

[0111] 1. By triggering the manual review process of the material physical parameter collection unit, it is confirmed that the silver jewelry is made of silver-plated material. The parameters are updated to "bronze base + 30% silver plating". The parameters are synchronized to the intelligent rendering engine module to adjust the weight simulation and lighting effects of the virtual model;

[0112] 2. The expert knowledge base of the cultural symbol annotation unit was used to manually confirm that the pattern was a "common dog pattern" (a low-level symbol), and the label was updated to "a symbol of ethnic protection, suitable for everyday clothing." This information was then transferred to the cultural semantic constraint unit of the intelligent rendering engine, removing the strict restrictions on the totem deformation threshold.

[0113] 3. If the cause of the conflict cannot be confirmed for the time being, mark the data as "pending verification" and isolate it, and initiate a supplementary collection process, such as retrieving historical photos of the clothing or interview records of the inheritor, until an authoritative data source is obtained.

[0114] After the correction is completed, the data verification interface automatically performs a second verification.

[0115] 1. Experimental purpose:

[0116] The Liannan Yao "Shuagetang" women's formal attire (including brocade outer garments, silver necklaces, and feather headdresses) was used as the test object, the existing ordinary VR clothing fitting equipment was used as the control group, and the proposed artificial intelligence fitting simulation equipment based on multimodal data acquisition, multi-physical field coupling algorithm and cultural semantic constraints was used as the experimental group.

[0117] 2. Test indicators:

[0118] Physical simulation accuracy: silver jewelry swing trajectory error, feather fluttering angle deviation;

[0119] Cultural fidelity: totem deformation rate, pattern core parameter error;

[0120] User experience: immersion score (1-5 points, modified based on NASA TLX scale), interaction delay (ms).

[0121] 3. Experimental steps:

[0122] 1. Data collection:

[0123] The multimodal data acquisition module of this scheme is used to obtain the gravity distribution matrix of silver jewelry (320g for collar and 180g for breastplate), aerodynamic parameters of feathers (feather shaft stiffness 200MPa) and cultural semantic labels of “dragon-dog totem” (rotation prohibited, scaling ±5%).

[0124] Existing systems only collect the geometric dimensions of clothing, ignoring the physical properties of materials and cultural symbols.

[0125] 2. Virtual model generation:

[0126] Existing system: Rendered using Unity Standard Shader, silver jewelry and brocade are single rigid body models, without gravity coupling; totem scaling is random.

[0127] This system uses a multi-physics field coupling algorithm to simulate the swing of silver jewelry and the fluttering of feathers, and the cultural semantic constraint unit forces the totem scaling error to be ≤5%.

[0128] 3. Interactive experience test:

[0129] The user wears a VR helmet and tactile gloves and completes the "raise hand - turn - walk" action sequence, recording the synchronization delay between the action and the dynamics of the clothing;

[0130] Fill out the immersion questionnaire, focusing on evaluating visual realism, tactile feedback accuracy, and sense of immersion in cultural scenes.

[0131] 4. Comparison of experimental data

[0132] Test indicators control group Experimental group Improvement Silver jewelry swing trajectory error 15~20cm ≤3cm 80％～85％ Feather fluttering angle deviation ±15° ±3° 80％ Totem Transformation Rate 20％～30％ ≤5％ 75％～83％ Belt position error +12cm -0.2cm 98％ Immersion score (average) 3.2 / 5.0 4.8 / 5.0 50％ Interaction Delay 200-300ms ≤50ms 75％～83％

[0133] V. Summary and Discussion: This solution significantly improves the dynamic simulation accuracy of complex ornaments such as silver jewelry and feathers by coupling the spring-mass model with the NS equations. For example, the swing error of silver jewelry was reduced from 15 cm to 3 cm, approaching real-world human motion data (error ≤ 5%), resolving the disconnect between movement and clothing that often exists in existing systems. The cultural semantic constraint unit, through pre-set deformation thresholds and pattern ratio rules, limits the totem scaling error to within 5%, and the belt positioning error to only 4%, avoiding the distortion of cultural symbols caused by mechanical scaling in existing systems. In experiments, user recognition of totem integrity increased from 60% with the existing system to 98% with this solution. Multisensory feedback (tactile gloves simulating the weight of silver jewelry and fragrances reproducing the scent of dyes) and low-latency interaction (≤ 50ms) increased immersion ratings by 50%. User feedback included "the tactile feedback makes the silver jewelry feel real," and "the scene interaction (e.g., raising a hand to trigger the feather's fluttering) enhances the sense of cultural ritual." Through the three-dimensional technological breakthrough of "physical simulation-cultural constraints-multi-sensory interaction", the core defects of the existing Yao clothing try-on simulation have been systematically solved, providing a quantifiable and verifiable technical path for the digital inheritance of ethnic minority intangible cultural heritage. Its improved accuracy and immersion have significant application value for cultural protection and innovative design.

[0134] Obviously, the above embodiments are merely examples for clarity of explanation and are not intended to limit the implementation methods. Those skilled in the art will readily appreciate that other variations or modifications based on the above descriptions are possible. It is not necessary and impossible to enumerate all implementation methods here. Obvious variations or modifications arising therefrom remain within the scope of protection of the present invention.

Claims

1. An artificial intelligence Yao ethnic clothing try-on effect simulation device, characterized in that: It includes a multimodal data acquisition module, an intelligent rendering engine module, and an immersive interactive terminal module, among which: The multimodal data acquisition module is used to collect the physical attribute data and cultural symbol data of Yao ethnic clothing. It uses a scanner, pressure sensor and cultural feature annotation system to obtain multidimensional data including material physical parameter tables and cultural semantic labels, and transmits the multidimensional data to the intelligent rendering engine module; The intelligent rendering engine module receives multi-dimensional data and, based on a multi-physics field coupling algorithm and a cultural semantic constraint model, simulates the draping dynamics of the multi-layered structure of clothing, the sound effects of silver jewelry colliding, and the trajectory of feathers fluttering. It also verifies the integrity of cultural symbols and generates a virtual fitting model that combines physical realism with cultural accuracy. The virtual fitting model is then transmitted to the immersive interactive terminal module. The immersive interactive terminal module is signal-connected to a VR helmet, tactile feedback gloves, and a fragrance generator. The immersive interactive terminal module is used to receive a virtual try-on model, and combined with the VR helmet, tactile feedback gloves, and fragrance generator, presents a multi-sensory try-on experience. It also collects user motion data, uses a motion capture algorithm to generate real-time interaction instructions, and transmits the real-time interaction instructions to the intelligent rendering engine module to dynamically update the model.

2. The artificial intelligence Yao ethnic clothing try-on effect simulation device according to claim 1 is characterized in that: The multimodal data acquisition module includes a material physical parameter acquisition unit and a cultural symbol annotation unit, where: A material physical parameter acquisition unit is used to collect physical property data such as weight, density, and elastic modulus of materials such as silver jewelry, brocade, and feathers. The unit uses an electronic scale, a laser thickness gauge, and a material mechanics testing machine to obtain a material physical parameter table, which is then transmitted to the intelligent rendering engine module. The cultural symbol annotation unit is used to mark the symbolic meaning of clothing totems and the key proportions of traditional patterns. It combines an expert knowledge base with an image recognition algorithm to semantically annotate scanned clothing images, generate cultural semantic tags, and transmit the cultural semantic tags to the intelligent rendering engine module.

3. The artificial intelligence Yao ethnic clothing try-on effect simulation device according to claim 2 is characterized in that: The material physical parameter acquisition unit includes: The silver jewelry weight distribution subunit is used to collect weight and hanging position data of silver jewelry components such as necklaces, breastplates, and anklets. It uses three-dimensional scanning and a pressure sensor array to obtain the silver jewelry gravity distribution matrix and uploads the silver jewelry gravity distribution matrix to the material physical parameter collection unit. The feather dynamic parameter subunit is used to collect data on the feather shaft hardness, feather vane density and natural fluttering trajectory. It uses a camera and a breeze simulation device to obtain the feather aerodynamic parameters, and transmits the feather aerodynamic parameters to the material physical parameter acquisition unit.

4. The artificial intelligence Yao ethnic clothing try-on effect simulation device according to claim 3 is characterized in that: The intelligent rendering engine module includes a multi-physics field coupling calculation unit, a cultural semantic constraint unit, and a model generation unit, among which: The multi-physics coupling calculation unit receives multi-dimensional data and extracts a material physical parameter table. Based on Newtonian mechanics and acoustic models, it simulates the sound effects of silver jewelry colliding with brocade and the trajectory of feathers fluttering in airflow, generates dynamic physical feedback data, and transmits the dynamic physical feedback data to the model generation unit. The cultural semantic constraint unit is used to receive multidimensional data and extract cultural semantic labels, establish deformation thresholds and pattern ratio constraint rules that allow ±5% scaling but prohibit totem rotation, perform real-time verification of the virtual try-on model, generate compliance verification results, and transmit the compliance verification results to the model generation unit; The model generation unit is used to receive dynamic physical feedback data, compliance verification results and multi-dimensional data. Based on the Unity3D engine's graphics rendering pipeline and deep learning generative adversarial network, it integrates physical simulation results with cultural compliance constraints to generate a virtual try-on model with real-time dynamic effects. When the "totem proportion abnormality" signal output by the cultural semantic constraint unit is detected, the model correction mechanism is automatically triggered, and the preset traditional pattern template is called to perform geometric correction on the totem area to ensure the cultural symbol integrity of the virtual try-on model. The generated virtual try-on model is synchronously output to the immersive interactive terminal module.

5. The artificial intelligence Yao ethnic clothing try-on effect simulation device according to claim 4 is characterized in that: The multi-physics coupling calculation unit includes a gravity-collision simulation subunit and a fluid-feather simulation subunit, where: The gravity-collision simulation subunit calculates the gravitational pull of silver jewelry on the main garment body based on the silver jewelry's gravity matrix in the material physical parameter table. When the user's movements cause the silver jewelry to sway, a spring-mass model is used to simulate the deformation data of the brocade. The acoustic engine then generates sound effects of silver bells colliding at the corresponding frequency. These deformation and sound effects are then uploaded to the dynamic physics feedback data for integration. The fluid-feather simulation subunit is used to generate a virtual airflow field based on the user's movement speed. Based on the feather aerodynamic parameters in the material physical parameter table, the NS equation is used to calculate the feather fluttering angle and frequency. When the user raises their hand by more than 45 degrees, the dynamic effect of the feather rising is automatically enhanced, and the generated upward dynamic data is uploaded to the dynamic physical feedback data for integration.

6. The artificial intelligence Yao ethnic clothing try-on effect simulation device according to claim 5 is characterized in that: The immersive interactive terminal module includes a multi-sensory feedback unit and a motion interaction processing unit, where: A multi-sensory feedback unit is configured to receive a virtual try-on model, render a three-dimensional visual effect of the embroidery microstructure through a VR headset, simulate the weight of silver jewelry and the texture of brocade through tactile feedback gloves, and release an odor corresponding to the clothing dye through a fragrance generator, thereby synchronously presenting the multi-sensory data to the user; The motion interaction processing unit is used to collect user joint motion data, use an inertial measurement unit and computer vision algorithms to identify walking or turning motion patterns, generate motion feature vectors, and transmit the motion feature vectors to the intelligent rendering engine module to trigger corresponding dynamic simulations.

7. The artificial intelligence Yao ethnic clothing try-on effect simulation device according to claim 6 is characterized in that: The multisensory feedback unit consists of a visual rendering subunit and a feedback subunit: The visual rendering sub-unit receives fiber structure data on the warp and weft density of apparel fabrics and uses physically based rendering technology to simulate the diffuse reflection of embroidery stitches and the specular reflection of silver jewelry to generate visual data. When the light angle changes, the unit automatically adjusts the fineness of the embroidery shadows and transmits the visual data to the VR headset. The feedback sub-unit is used to receive the gravity distribution matrix of the silver jewelry and simulate the weight of different parts of the body through the vibration motor array of the tactile feedback gloves. When the user remains stationary for more than 10 seconds, it automatically switches to "static display mode" to reduce power consumption.

8. The artificial intelligence Yao ethnic clothing try-on effect simulation device according to claim 7 is characterized in that: It also includes a pattern adaptation optimization module for receiving user body shape data and a traditional pattern gene library. The traditional pattern gene library includes the shoulder width-length ratio parameters of Yao ethnic clothing. A genetic algorithm is used to generate an improved pattern that adapts to modern body shapes, and the improved pattern data is transmitted to the intelligent rendering engine module.

9. The artificial intelligence Yao ethnic clothing try-on effect simulation device according to claim 8 is characterized in that: The pattern adaptation optimization module includes a body shape data analysis unit and a cultural pattern mapping unit, where: The body shape data analysis unit is connected to a depth camera. The body shape data analysis unit is used to collect the user's body shape parameters such as shoulder width, waist circumference and leg length through the depth camera, generate a personalized body shape vector using an anthropometric algorithm, and upload the body shape vector to the pattern adaptation optimization module; The cultural pattern mapping unit is used to store the key proportion parameters of the traditional pattern of Yao clothing. When the personalized body shape conflicts with the traditional proportion, the non-core parts are adjusted within the allowable range to retain the core elements of the belt position, generate a pattern adjustment plan, and upload the pattern adjustment plan to the pattern adaptation optimization module.

10. The artificial intelligence Yao ethnic clothing try-on effect simulation device according to claim 9 is characterized in that: A data verification interface is set up between the intelligent rendering engine module and the multimodal data acquisition module. The data verification interface is used to detect the correlation between the physical parameters of the material and the cultural semantic labels. When conflicting data is detected, it automatically triggers data correction to the multimodal data acquisition module. Based on the conflicting data type and specific fields of the data correction, combined with the originally collected multidimensional data, the source node of the conflicting data in the acquisition process is located, and the located node is transmitted to the interactive interface for the operator to choose "correct parameters", "update cultural labels" or "mark abnormal data".

Images