A meta-universe digital twin skipping system and method based on a non-wearable motion capture technology

Abstract

The application discloses a kind of based on without wearing body sense motion capture technology's meta-universe digital twinborn system of playing water and method, it is related to computer vision technical field, the system includes module: without wearing action capture module, key point data processing and transmission module, multidimensional physical parameter engine, digital twinborn water area module, competitive rules and scoring module, digital person fitness ecosystem, virtual asset and economic system, LBS geographic anchoring system, environmental protection and cultural inheritance system, cross-chain intercommunication and security system.This based on without wearing body sense motion capture technology's meta-universe digital twinborn system of playing water and method, without wearing any equipment, greatly reduce user participation threshold, and through high-precision motion capture and physical simulation, provide close to real playing water experience, while multidimensional physical parameter engine realizes the accurate simulation of real fluid dynamics and rigid body dynamics, supports 12 kinds of hydrological environment.

Description

Technical Field

[0001] This invention relates to the field of computer vision technology, specifically to a metaverse digital twin skipping water system and method based on wearable motion capture technology. Background Technology

[0002] Skipping stones, an ancient recreational activity, boasts a rich cultural heritage and a broad popular appeal. With the rise of the metaverse concept, digitizing this traditional activity has become possible. Market research indicates that the global metaverse market is projected to reach $2.5 trillion by 2030, with sports-related metaverse users experiencing an annual growth rate exceeding 40%, demonstrating enormous development potential.

[0003] However, existing digital simulation technology for skipping stones has the following problems:

[0004] 1. The physical simulation is not accurate enough to realistically reproduce the complex interaction between the stone and the water surface;

[0005] 2. The interaction methods are simplistic and lack an immersive experience;

[0006] 3. The lack of standardized competition rules and scoring systems makes it difficult to support formal competitions;

[0007] 4. High barrier to entry for users, requiring specialized equipment;

[0008] 5. Insufficient integration of virtual and real elements, lacking connection with the actual geographical environment;

[0009] 6. Lack of a complete ecosystem to support long-term operation and the realization of social value.

[0010] Therefore, there is an urgent need for a metaverse skipping solution based on wearable motion capture technology, high-precision physical simulation, and a complete ecosystem to meet the multiple social needs of national fitness, digital sports, environmental protection, and cultural heritage. Summary of the Invention

[0011] The purpose of this invention is to provide a metaverse digital twin skipping water system and method based on wearable motion capture technology, so as to solve the problems mentioned in the background technology, and realize an immersive ecosystem integrating "virtual exercise - real fitness - environmental protection and public welfare - cultural inheritance".

[0012] To achieve the above objectives, the present invention provides the following technical solution:

[0013] On the one hand, a metaverse digital twin skipping water system based on wearable motion capture technology is provided, including the following modules:

[0014] Wearable motion capture module: It uses a TOF depth camera to capture user movements, and uses the MediaPipe framework and NPU-accelerated and optimized deep learning algorithm to identify and track the user's throwing motion, and convert it into three-dimensional motion parameters;

[0015] Key data processing and transmission module: It adopts an asynchronous processing mechanism and dynamic data interpolation technology to increase the actual frame detection rate to a high frame rate transmission frequency;

[0016] Multi-dimensional physics parameter engine: Based on the UE5 physics engine, it realizes a dynamic water body stratification system and rock dynamic model, accurately simulates the physical characteristics of water drift, and supports 12 kinds of hydrological environments such as turbulence, eddies, and tides.

[0017] Digital Twin Water Module: Constructs a digital twin environment of real water using panoramic holographic oblique photography technology and fluid dynamics models, including water surface physical properties and environmental factors;

[0018] Competition Rules and Scoring Module: Implements standardized competition rules, scoring systems, and competition mechanisms;

[0019] Digital Human Fitness Ecosystem: Enabling a character growth system, health data linkage, and social fitness scenarios;

[0020] Virtual Assets and Economic System: Realizing a dual-token economic model and an NFT asset matrix;

[0021] LBS geo-anchoring system: Enables the mapping of real-world waterways and the linkage between offline experiences;

[0022] Environmental Protection and Cultural Heritage System: Realizing the public welfare functions of water resource protection and the inheritance of traditional culture;

[0023] Cross-chain interoperability and security system: Enables cross-platform data interoperability and anti-fraud protection.

[0024] Furthermore, the wearable motion capture technology:

[0025] A TOF depth camera is used to collect the user's 3D motion data;

[0026] Data is processed using the MediaPipe motion capture and recognition framework, and performance is optimized using NPU acceleration technology.

[0027] The overall inference speed has been improved from 8fps to 22fps, an increase of 175%.

[0028] After model quantization, the size is reduced by 40% and memory usage is reduced by 35%;

[0029] Achieve high-precision motion recognition with an error of s2cm.

[0030] Furthermore, the key data processing and transmission technology:

[0031] An asynchronous processing mechanism is adopted to separate the data acquisition and transmission processes;

[0032] By using dynamic data interpolation technology, the actual detection frame rate can be increased to a transmission frame rate of 60-90fps;

[0033] A predictive interpolation algorithm is used to ensure the smoothness and accuracy of the padded frame data;

[0034] Implement sending queue management, dynamically adjust sending frequency, and avoid network congestion.

[0035] Furthermore, the multi-dimensional physics parameter engine:

[0036] 1. Dynamic water stratification system:

[0037] The water surface is divided into a "calm zone" (jump efficiency +20%), a "turbulent zone" (angle error ±5°), and a "whirlpool zone" (direct sinking to the bottom);

[0038] A fluid dynamics model was developed based on the Navier-Stokes equations to calculate water wave drag (F_d = 0.5pv) in real time. 2 C_dA), the dynamic changes of density (p) and drag coefficient (C_d) in different regions;

[0039] It supports 12 hydrological environments, such as dynamic adjustment of water surface slope caused by tidal changes, and a stone jumping error of 0.5 times.

[0040] 2. Rock dynamics model:

[0041] It supports customizable three-axis inertia tensors (I_xx, 1_yy, 1_zz), allowing users to adjust the stone's center of gravity.

[0042] Rotational angular velocity (w) affects jump attitude (in Euler angles);

[0043] The Magnus effect (F = S·wxv) is introduced to simulate the trajectory deviation caused by lateral rotation, with an error accuracy of ±1°.

[0044] Furthermore, the method for constructing the digital twin water area:

[0045] High-precision, multi-angle image data of real water bodies were acquired using panoramic holographic oblique photography technology.

[0046] Using the principles of photogrammetry, three-dimensional reconstruction can achieve centimeter-level accuracy.

[0047] Water flow characteristics are constructed using computational fluid dynamics (CFD) models;

[0048] Real-time weather factors are accessed via meteorological data API to influence water surface conditions;

[0049] Support the "XXXX Water Area Digital Twin Project" to replicate important water areas such as the Yellow River and the Yangtze River.

[0050] Furthermore, the competition rules and scoring system:

[0051] 1. Standard Competition Rules:

[0052] Base score = number of jumps x jump distance x difficulty level;

[0053] Bonus points include special trajectories (such as zigzag +20%), perfect entry angle (within ±2° +15%), etc.

[0054] It supports multiple competition modes such as single-player racing, multiplayer battles, and team relays.

[0055] 2. Global Ranking System:

[0056] Player levels are calculated based on a revised version of the ELO algorithm;

[0057] The ranking score weights are dynamically adjusted based on the difficulty of the water area and weather conditions.

[0058] Supports a multi-tiered competition system including regional leagues and global championships.

[0059] Furthermore, the aforementioned digital human fitness ecosystem:

[0060] 1. Character progression system:

[0061] Job specialization: Three major professions are set up: "Watercraft Craftsman", "Water Ranger" and "Athletic Fighter", corresponding to the crafting, exploration and combat skill trees;

[0062] Health data linkage: Connect to devices such as Apple Watch and Huawei Health to synchronize calorie consumption and heart rate changes to the digital human's "fitness value";

[0063] Reaching fitness goals unlocks rare equipment, such as the "calorie-to-water-coin" system.

[0064] 2. Social fitness scenarios:

[0065] Team Challenge: 3-5 players cooperate to complete story-driven dungeons such as "Yellow River Dredging" and "West Lake Treasure Hunt";

[0066] Live-streamed tutorials: Champions and amateur water skipping experts are invited to become digital human instructors, demonstrating throwing techniques through real-time motion capture.

[0067] Furthermore, the virtual assets and economic system:

[0068] 1. Dual-token economic model:

[0069] Splash Coins (SHB): Functional tokens earned through exercise time and challenge results, used to purchase equipment or redeem offline fitness classes (100 SHB = 1 yoga class);

[0070] Ripple Coin (SWT): A governance token used for developing new scenarios for voting and decision-making. Its holdings are linked to the social influence of digital humans, with a total supply of 10 million tokens.

[0071] 2. NFT Asset Matrix:

[0072] Stone NFT: From ordinary skipping stones (3-5 jumps) to the legendary "Quantum Flying Fish" (15 jumps + terrain destruction effect);

[0073] Land NFT: Users can purchase "digital waters" plots, customize rules, and charge an entry fee;

[0074] Intangible Cultural Heritage Water-Floating Stone Series: Combining traditional cultural elements such as Jingdezhen ceramic textures and Dunhuang mural patterns.

[0075] Furthermore, the LBS geographic anchoring system:

[0076] 1. Real-world water mapping:

[0077] Digital twin waterways are generated using satellite imagery and user-uploaded videos;

[0078] AI algorithms analyze water flow characteristics to reconstruct real hydrological parameters;

[0079] To achieve a 1:1 replica of important waterways around the world.

[0080] 2. Offline experience integration:

[0081] Set up AR water skipping challenge platforms in real scenic areas;

[0082] The physical throwing motion is captured by a camera and synchronized to the virtual world;

[0083] Performance can be redeemed for real-world rewards, such as discounts on scenic spot tickets.

[0084] Furthermore, the aforementioned environmental protection and cultural heritage system:

[0085] 1. Public interest in water resource protection:

[0086] For every 100 square meters of virtual water area purified by a user, the platform, in conjunction with environmental organizations, will adopt 1 square meter of wetland in reality.

[0087] Digital humans unlock the title of "environmental guardian," forming a positive cycle of "virtual action - real-world impact."

[0088] Open the "Yellow River / Yangtze River Digital Twin Basin" to popularize knowledge about water resource protection.

[0089] 2. Inheritance of Traditional Culture:

[0090] Replicating historical waterway scenes such as the Zhaozhou Bridge and Dujiangyan Irrigation System;

[0091] The throwing trajectory generates calligraphy / traditional Chinese painting effects (such as "writing characters with water" and "splashing ink to create paintings");

[0092] The "Twenty-Four Solar Terms Water Floating Race" was held, combining traditional solar term culture.

[0093] Furthermore, the aforementioned cross-chain interoperability and security system:

[0094] Supports data interoperability with other metaverse platforms;

[0095] The core physical computing module is protected through quantum encryption authentication.

[0096] AI-powered behavioral auditing identifies cheating behavior with an accuracy rate of ≥99.7%.

[0097] On the other hand, a metaverse digital twin skipping method based on wearable motion capture technology is provided, applied to the aforementioned metaverse digital twin skipping system based on wearable motion capture technology, including the following steps:

[0098] S1. Acquire user images using a TOF depth camera;

[0099] S2. Use the MediaPipe motion capture recognition framework and NPU acceleration technology to recognize throwing actions;

[0100] S3. Key point data is processed using an asynchronous processing mechanism and dynamic data interpolation technology.

[0101] S4. Analyze the action sequence to calculate the throwing parameters, including the direction angle, initial velocity, and rotational angular velocity;

[0102] S5. Calculates stone trajectory and water surface interaction effects based on a multi-dimensional physical parameter engine;

[0103] S6. Calculate the score based on parameters such as the number of jumps and the distance, and update the ranking;

[0104] S7. Update user role attributes and achievements in the digital human fitness ecosystem;

[0105] S8. Handling transactions and value transfers between virtual assets and the economic system;

[0106] S9. Implement the virtual-real linkage function in the LBS geographic anchoring system;

[0107] S10. Implement public welfare and cultural dissemination activities within the environmental protection and cultural heritage system.

[0108] Furthermore, in step S5, a high-precision physical simulation is achieved through a dynamic water stratification system based on the Navier-Stokes equations and a rock dynamics model, supporting 12 hydrological environments, with an error of ≤0.5 times for the number of rock jumps.

[0109] Furthermore, the method includes the step of acquiring real water area data using panoramic holographic oblique photography technology and constructing a digital twin water area model, the steps of which include:

[0110] I. Use drones equipped with multi-angle cameras to collect water area image data;

[0111] II. Feature point matching using the Structure from Motion algorithm;

[0112] III. A high-precision point cloud model is generated using a dense matching algorithm;

[0113] IV. Assigning physical properties to water bodies through computational fluid dynamics models.

[0114] Furthermore, the following steps are included to realize the fitness value:

[0115] Ⅰ. Record user exercise parameters and generate health reports;

[0116] II. Enhance the fun of sports through gamification mechanisms;

[0117] III. Establish social interaction mechanisms to enhance fitness engagement;

[0118] IV. Achieve linkage between health data and real-world fitness services.

[0119] This invention provides a metaverse digital twin skipping water system and method based on wearable motion capture technology, which has the following beneficial effects:

[0120] 1. No wearing of any devices is required, significantly lowering the barrier to user participation and covering remote areas and people with mobility difficulties;

[0121] 2. High-precision motion capture and physics simulation provide a near-realistic skipping experience, with an error of ≤0.5 skips per stone;

[0122] 3. The multi-dimensional physical parameter engine enables accurate simulation of realistic fluid dynamics and rigid body dynamics, supporting 12 types of hydrological environments;

[0123] 4. Standardized competition rules and scoring system, supporting official esports events, and capable of hosting regional leagues and global championships;

[0124] 5. The digital human fitness ecosystem, combined with gamification mechanisms, transforms "passive fitness" into "active exploration," and users' average weekly exercise time is expected to increase by 2-3 hours.

[0125] 6. A dual-token economic model and NFT asset matrix are used to build a sustainable system of "user creation - economic cycle - real-world feedback".

[0126] 7. LBS geolocation systems enable the integration of virtual and real-world data, driving online traffic to support the offline fitness economy;

[0127] 8. The environmental protection and cultural heritage system combines sports with public welfare and culture to enhance social value. Attached Figure Description

[0128] Figure 1 This is an architecture diagram of a metaverse digital twin skipping water system based on wearable motion capture technology according to the present invention.

[0129] Figure 2 This is a flowchart of the motion capture process of a metaverse digital twin skipping water system based on wearable motion capture technology and a TOF depth camera and MediaPipe framework, according to the present invention.

[0130] Figure 3 This is a schematic diagram of the multi-dimensional physical parameter engine calculation model of a metaverse digital twin skipping water system based on wearable motion capture technology according to the present invention.

[0131] Figure 4 This is a schematic diagram of the physical model of a dynamic water stratification system of a metaverse digital twin skipping water system based on wearable body motion capture technology according to the present invention.

[0132] Figure 5 This is a schematic diagram of the stone shape and main axis of a metaverse digital twin skipping system based on wearable motion capture technology, according to the present invention.

[0133] Figure 6 This is a schematic diagram of the stone dynamics model of a metaverse digital twin skipping water system based on wearable body motion capture technology according to the present invention—water surface collision and energy transfer.

[0134] Figure 7 This is a flowchart of a panoramic holographic oblique photography data acquisition and digital twin water area construction method for a metaverse digital twin skipping system based on wearable body motion capture technology according to the present invention.

[0135] Figure 8 This is a logical framework diagram of the water skipping competition rules and scoring system of the metaverse digital twin water skipping system based on wearable motion capture technology of the present invention;

[0136] Figure 9 This is a functional structure diagram of a digital human fitness ecosystem based on a metaverse digital twin skipping water system using wearable motion capture technology, as described in this invention.

[0137] Figure 10 This is a schematic diagram of the operation mechanism of the virtual asset and economic system of the metaverse digital twin skipping water system based on wearable motion capture technology of the present invention.

[0138] Figure 11 This is a schematic diagram of the real water area mapping module of the metaverse digital twin skipping system based on wearable motion capture technology according to the present invention.

[0139] Figure 12 This is a diagram illustrating the operational mode of an environmental protection and cultural heritage system based on wearable motion capture technology using a metaverse digital twin system for skipping stones.

[0140] Figure 13 This is a schematic diagram illustrating the multi-scenario application of the Metaverse Digital Twin Skipping System based on wearable motion capture technology, as described in this invention. Detailed Implementation

[0141] The embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and examples. The following examples are for illustrative purposes only and should not be construed as limiting the scope of the invention.

[0142] Example 1: Basic System Architecture

[0143] like Figure 1 As shown, the skipping water system of this invention is developed based on the UE5 engine and mainly consists of a server and a client. The server is responsible for motion data processing, physics calculation, multi-user synchronization, and data storage; the client is responsible for image acquisition, scene rendering, and user interaction.

[0144] The system workflow is as follows:

[0145] 1. Users access the system via a TOF depth camera;

[0146] 2. The system automatically calibrates the camera position and user posture;

[0147] 3. The system captures and analyzes the user's throwing motion in real time;

[0148] 4. The physics engine calculates the stone's trajectory and water surface interaction based on captured data;

[0149] 5. The system renders the stone's flight process and its interaction with the water surface;

[0150] 6. Calculate parameters such as number of jumps and distance, and update the score and ranking;

[0151] 7. Update user digital person attributes and economic system data based on user performance.

[0152] Example 2: Implementation of wearable motion capture technology

[0153] like Figure 2 As shown, this invention uses a TOF depth camera and the MediaPipe framework to achieve wearable motion capture, specifically including:

[0154] 1. Hardware settings:

[0155] -Equipped with a TOF depth camera, supporting 640x480 resolution and 30Hz frame rate;

[0156] - Depth accuracy ±1cm (within 2m distance);

[0157] - Field of view (FOV) 75° x 65°;

[0158] 2. MediaPipe motion capture and recognition framework:

[0159] - The MediaPipe framework was used to identify 21 hand keypoints and 33 body keypoints;

[0160] - Optimize performance using NPU acceleration technology:

[0161] * The overall inference speed has been improved from 8fps to 22fps, an improvement of 175%.

[0162] *After model quantization, the size is reduced by 40% and memory usage is reduced by 35%;

[0163] - Key point detection accuracy ≥ 97%;

[0164] 3. Key data processing and transmission:

[0165] - An asynchronous processing mechanism is adopted to separate the data acquisition and transmission processes;

[0166] - By using dynamic data interpolation technology, the actual detection frame rate (22fps) is increased to a transmission frame rate of 60-90fps;

[0167] - A predictive interpolation algorithm is used to ensure the smoothness and accuracy of the padded frame data;

[0168] - Implement send queue management, dynamically adjust the send frequency, and avoid network congestion;

[0169] 4. Throwing parameter calculation:

[0170] - Calculate the throwing direction angle by analyzing the motion trajectory of key points;

[0171] - Calculate the throwing force using the hand acceleration curve;

[0172] - Calculate the stone's rotation state by measuring the wrist's rotational angular velocity;

[0173] 5. AI for predicting throwing trajectories:

[0174] - Analyze the user's historical 20 throws data using an LSTM neural network;

[0175] - Generate personalized parabolic prediction lines (error < 2°);

[0176] - Guide lines are displayed in beginner mode and automatically hidden in hardcore mode;

[0177] Example 3: Implementation of a Multi-Dimensional Physics Parameter Engine

[0178] like Figure 3 , Figure 4 and Figure 5 As shown, the multi-dimensional physics parameter engine of this invention is developed based on UE5 to achieve accurate physical simulation of skipping stones:

[0179] 1. Dynamic water stratification system:

[0180] -The water surface is divided into three types of zones:

[0181] * Calm zone: Water wave amplitude < 5cm, jumping efficiency +20%;

[0182] *Turbulent region: water wave amplitude 5-20cm, angle error ±5°;

[0183] *Whirlpool zone: Water rotation speed > 0.5m / s, sinks directly to the bottom;

[0184] - The calculation of water wave resistance is based on the Navier-Stokes equation: F_d=0.5pvC_dA, where p is the water density (which varies with temperature and salinity), v is the velocity of the stone relative to the water surface, C_d is the resistance coefficient (which changes dynamically with the water surface state), and A is the effective contact area of ​​the stone.

[0185] - Simulation of special aquatic environments:

[0186] *Tidal changes: The water surface slope changes every 15 minutes, affecting the optimal throwing angle; *Wind influence: Real-time wind direction and speed affect water ripples and the trajectory of the stone;

[0187] *Supports 12 types of hydrological environments, including turbulence, eddies, tides, etc.;

[0188] 2. Rock dynamics model:

[0189] - Calculation of triaxial inertia tensor:

[0190] *l_xx=∫(y 2 +z 2 )dm;

[0191] *l_yy=∫(x 2 +z 2 )dm;

[0192] *l_zz=∫(x+y)dm;

[0193] - Equation of rotational dynamics:

[0194] *T_x=I_xx(dw_x / dt)+(l_zz-l_yy)w_yw_z;

[0195] *T_y=I_yy(dw_y / dt)+(l_xx-l_zz)w_zw_x;

[0196] *T_z=I_zz(dw_z / dt)+(l_yy-l_xx)w_xw_y;

[0197] - Magnus effect simulation:

[0198] *F=S·wxv, where S is a proportionality coefficient, related to the shape and surface properties of the stone; - Water surface collision and energy transfer:

[0199] *Calculate the rebound coefficient (e) based on the water entry angle (a);

[0200] *The optimal rebound angle is approximately 20°; rebound efficiency decreases as the angle deviates from this angle.

[0201] *Energy loss per collision is approximately 15-30%, depending on the shape of the rock and the state of the water surface; 3. Rock-water interaction simulation:

[0202] -Water splash generation algorithm:

[0203] * Simulates water splash effects using a particle system;

[0204] *The height of the splash is directly proportional to the speed of entry into the water and inversely proportional to the angle of entry into the water;

[0205] The number of water droplets is directly proportional to their kinetic energy upon entering the water.

[0206] -Water ripple propagation:

[0207] *Water wave propagation is simulated using the wave equation;

[0208] *Consider water wave reflection and interference effects;

[0209] *The amplitude of water waves decays over time, and the decay coefficient is related to the viscosity of the water surface;

[0210] Example 4: Construction of Digital Twin Water Areas

[0211] like Figure 6 As shown, the digital twin water area construction method of the present invention includes:

[0212] 1. Data Acquisition:

[0213] - Data acquisition using panoramic holographic oblique photography technology:

[0214] *Use a drone equipped with a multi-angle camera (vertical + four-way tilt);

[0215] * Collect high-resolution image data of the water area and its surrounding environment;

[0216] *The overlap rate of the images is ≥80% to ensure the accuracy of 3D reconstruction;

[0217] -Supplementary data source:

[0218] *Analyze satellite imagery to determine water surface characteristics and current direction;

[0219] * Obtain real-time environmental parameters via hydrological and meteorological data API;

[0220] 2. Model Building:

[0221] -Photogrammetric processing:

[0222] Feature point matching is performed using the StructurefromMotion (SfM) algorithm.

[0223] * Calculate camera extrinsic parameters and control point coordinates using aerial triangulation;

[0224] High-precision point cloud models (density ≥ 100 points / m²) are generated using a dense matching algorithm. 2 );

[0225] - Fluid dynamics simulation: Simulates water flow characteristics using computational fluid dynamics (CFD) models; - Environmental factor integration: Integrates environmental factor data such as weather, tides, and temperature;

[0226] 3. Assignment of physical properties to water bodies:

[0227] - Water surface tension parameter (o=0.072N / m@20℃);

[0228] -Water flow velocity vector field (direction and velocity distribution);

[0229] - Factors affecting water flow based on underwater topography;

[0230] 4. Unique waterway design:

[0231] - Classic waterways: Replicas of famous lakes and rivers from around the world (such as West Lake and the Nile);

[0232] -Historical waterways: Recreating historical waterway scenes such as the Zhaozhou Bridge and Dujiangyan Irrigation System;

[0233] - Fantasy waters: Creative scenes such as "lava lake" (high viscosity, surface tension +50%);

[0234] - Seasonal variations: such as the "winter ice surface pattern" (rebound coefficient +30%, friction -50%);

[0235] Example 5: Competition Rules and Scoring System

[0236] like Figure 7 As shown, this invention implements standardized competition rules and a scoring system:

[0237] 1. Basic scoring formula:

[0238] -Total score = Base score x Difficulty coefficient x Skill bonus;

[0239] -Base score = number of jumps x 50 + total distance (meters) x 10;

[0240] - Difficulty coefficient = Base difficulty (1.0) + Water area difficulty adjustment (0-0.5) + Weather influence (0-0.3);

[0241] -Skill bonus = 1.0 + Special trajectory (0-0.3) + Perfect angle (0-0.2) + Continuous bounce (0-0.5);

[0242] 2. Standard match format:

[0243] -Individual ranking competition: 5 throwing opportunities, the highest score is counted in the ranking;

[0244] - Timed Challenge: Complete as many effective throws as possible within 60 seconds;

[0245] -Multiplayer battles: take turns throwing, point-based or elimination system;

[0246] - Team relay: Team members take turns throwing, and the team's total score determines the winner;

[0247] 3. Ranking System:

[0248] - Revised ELO algorithm: New players start with 1000 points;

[0249] -Ranking score change: △R=Kx(SE); where K is the weighting factor (related to the importance of the match), S is the actual score (win=1, draw=0.5, loss=0), and E is the expected score, calculated based on the difference in points between the two sides;

[0250] -Regional ranking: The world is divided into four major regions: Asia, Europe, America and Oceania;

[0251] -Season Update: Each season lasts three months. At the end of the season, your rank is maintained, but your ranking points will decrease slightly.

[0252] Example 6: Digital Human Fitness Ecosystem

[0253] like Figure 8 As shown, this invention realizes a complete digital human fitness ecosystem:

[0254] 1. Character progression system:

[0255] - Career differentiation:

[0256] * "Water Skimmer": Focus on stone crafting and adjustment, unlocking special materials and shapes; * "Water Ranger": Proficient in exploring different waters, gaining terrain adaptability bonuses; * "Competitive Fighter": Specialize in competition skills, improving performance in crucial moments;

[0257] -Skill Tree System:

[0258] *Angle control branch: From fixed angles to precise micro-management;

[0259] *Power Control Branch: From basic power to wind compensation and water flow prediction;

[0260] *Special skill branches: From basic jumps to advanced combination jumps and zigzag jumps;

[0261] 2. Health data linkage:

[0262] - Connecting sports equipment:

[0263] *Supports connection to devices such as Apple Watch and Huawei Health;

[0264] *Records health data such as heart rate changes and calorie consumption;

[0265] *Sports data is synchronized with digital human attributes: 100 calories = 1 point of physical fitness;

[0266] - Fitness Analysis System:

[0267] *Automatically generates motion reports (throwing angle, force distribution, reaction speed);

[0268] *Provides personalized training suggestions;

[0269] *Set fitness goals and achievements to unlock;

[0270] 3. Social fitness scenarios:

[0271] -Team Dungeon Mode:

[0272] *“Yellow River Dredging”: A collaborative effort of 3-5 people to complete a specific watershed management task;

[0273] *“Treasure Hunt in West Lake”: Team members divide tasks and cooperate based on their throwing skills;

[0274] *“Ancient Bridge Restoration”: An intergenerational collaborative model suitable for family participation;

[0275] -Live teaching system:

[0276] *A professional athlete's digital model demonstrates the best throwing posture;

[0277] AI analyzes user actions in real time and provides corrective suggestions;

[0278] *A community discussion and skills sharing platform;

[0279] 4. Gamified fitness mechanics:

[0280] -Achievement System:

[0281] *“100 Successful Jumps”: 100 consecutive successful jumps;

[0282] *“Water Splash Artist”: A single trajectory forms a specified pattern;

[0283] *“Dimensional Conqueror”: Achieve records in 10 different terrains;

[0284] -Daily Task System:

[0285] *Daily Mission: Complete 3 throwing challenges to earn basic stamina;

[0286] *Weekly Task: Complete a specified number of jumps to unlock special effects;

[0287] *Seasonal Challenge: Compete against players worldwide for leaderboard positions and exclusive equipment;

[0288] - Fitness companion system:

[0289] *The digital human coach provides voice encouragement and guidance;

[0290] * The difficulty and objectives are dynamically adjusted based on user performance;

[0291] * Generate personalized fitness reports and shareable cards;

[0292] Example 7: Virtual Assets and Economic Systems

[0293] like Figure 9 As shown, the virtual asset and economic system of the present invention includes:

[0294] 1. Dual-token economic model:

[0295] -Splash Coin (SHB):

[0296] *Utility tokens, used for in-game purchases;

[0297] *Acquisition methods: Complete sports challenges, daily tasks, and event rewards;

[0298] *Use cases: Purchasing basic equipment, paying venue usage fees, and upgrading skills;

[0299] *Offline value: 100 SHB can be redeemed for 1 real-world yoga class or other fitness services; *No upper limit on total amount, inflation rate 5% / year;

[0300] -Srip Coin (SWT):

[0301] *Governance tokens used for ecosystem decision-making;

[0302] *Acquisition methods: Staking NFTs, participating in DAO voting, hosting events;

[0303] *Decision-making authority: Voting to decide on new scenario development, rule revision, and economic parameter adjustment;

[0304] *Social Influence: Ownership is linked to the digital person's influence within the community;

[0305] *Total supply of 10 million tokens, using the PoS consensus mechanism;

[0306] 2. NFT Asset Matrix:

[0307] -Stone NFT:

[0308] *Standard quality: 3-5 basic jumps, 80% market share;

[0309] *Rare quality: Base jump count 6-8 times, water splash color-changing effect, market share 15%;

[0310] *Epic quality: Base jump count 9-12, trajectory outline effect, market share 4%;

[0311] *Legendary quality: 13+ base jumps, terrain destruction effects, 1% market share;

[0312] Land NFT:

[0313] * The "Water Area Plot" NFT allows for customizable scene rules;

[0314] *Supports charging players a 5% entry fee;

[0315] *Land leasing is supported (daily rental 10 SHB / m²) 2 );

[0316] -Cultural Theme NFTs:

[0317] *Intangible Cultural Heritage Water-Floating Stone Series: Jingdezhen ceramic textures, Dunhuang mural patterns, etc.;

[0318] *Limited-time series based on the 24 solar terms: Equipment and effects themed around the 24 solar terms;

[0319] *Historical Sites Series: Special stones that match historical water scenes;

[0320] 3. Dynamic pricing algorithm:

[0321] - NFT automatic pricing model: P = kx(T + SxR) / U; where P is the price, k is the base coefficient, T is the holding time, S is the scarcity, R is the historical performance, and U is the market circulation.

[0322] - An automatic adjustment mechanism based on supply and demand;

[0323] - Inflation prevention measures: When the circulation of SHB exceeds the threshold, the "water purification and destruction mechanism" will be activated;

[0324] 4. Conversion of virtual and real value:

[0325] - Redeem online achievements for offline rewards:

[0326] *Winnings in virtual competitions can be redeemed for physical sports equipment;

[0327] *Environmental achievements can be redeemed for opportunities to participate in public welfare activities;

[0328] *Cultural collections may include admission tickets to relevant physical museums;

[0329] -Digital incentives for offline activities:

[0330] *Participate in physical waterway conservation activities to receive exclusive digital equipment;

[0331] *Unlock special throwing skills by visiting historical waterways;

[0332] *Real-world motion data can simultaneously enhance the attributes of a digital human;

[0333] Example 8: LBS Geographic Anchoring System

[0334] like Figure 10 As shown, the LBS geographic anchoring system of the present invention includes: 1. Real-world water area mapping:

[0335] - Geographic Information System (GIS) Integration Based on Satellite Imagery:

[0336] *Automatically identifies global water features;

[0337] * Extract parameters such as water flow direction and velocity;

[0338] * Generate 3D terrain models;

[0339] -Analysis of user-uploaded videos:

[0340] *AI algorithms analyze the water wave characteristics in videos;

[0341] *Reconstruct the local hydrological environment;

[0342] *Generate player-exclusive waterways;

[0343] - Digital twins of key water areas:

[0344] * Participate in the "XXXX Water Area Digital Twin Project";

[0345] *Replicas of major national river basins such as the Yellow River and the Yangtze River;

[0346] *Provides a 1:1 virtual water experience;

[0347] 2. Offline experience integration:

[0348] -AR Skipping Water Challenge Platform:

[0349] *A dedicated experience area will be set up within the scenic area;

[0350] *The camera captures the actual throwing motion;

[0351] *Combining virtual stones with AR projection;

[0352] *Real-time ratings and rankings;

[0353] -Special geographical location bonus:

[0354] *Unlock exclusive achievements by fulfilling certain conditions at specific geographic coordinates;

[0355] * Earn unique badges by checking in at different locations;

[0356] *Connecting real-world attractions with virtual waterway stories;

[0357] -City Skipping League:

[0358] *Offline city leagues will be held at designated locations;

[0359] *Virtual grades can be redeemed for real-world prizes;

[0360] *Drives the development of the offline fitness economy;

[0361] Example 9: Environmental Protection and Cultural Heritage System

[0362] like Figure 11 As shown, the environmental protection and cultural heritage system of the present invention includes:

[0363] 1. Public interest in water resource protection:

[0364] - "Clean Water Action" Mechanism:

[0365] For every 100 meters of virtual water cleaned by a user, the platform, in conjunction with environmental organizations, will sponsor 1 meter of that water. 2 Real-world wetlands; *Unlock the "Environmental Guardian" title and exclusive skin in-game;

[0366] *Real-time synchronization of water quality monitoring data, visualizing environmental protection achievements;

[0367] -Water Conservancy Science Popularization Content:

[0368] *A copy of the "Yellow River / Yangtze River Digital Twin Basin" science popularization book is now available;

[0369] *The principle of sediment management is simulated by skipping stones on water;

[0370] * Popularizing water resource protection knowledge, expected to reach over 5 million environmental education users annually; - Environmental community governance:

[0371] *Let users vote to decide where environmental funds are allocated;

[0372] *Organize online and offline joint water cleanup activities;

[0373] *Publish environmental achievements reports to enhance social influence;

[0374] 2. Inheritance of Traditional Culture:

[0375] -Historical waterway scene:

[0376] *Replicating historical waterway scenes such as the Zhaozhou Bridge and Dujiangyan Irrigation System;

[0377] *Special challenge missions are designed incorporating historical events;

[0378] *Learn about the history of water conservancy projects through gamification;

[0379] - Combining art with water skipping:

[0380] * The throwing trajectory generates calligraphy / traditional Chinese painting effects (such as "writing characters with water" and "splashing ink to create paintings"); * Collect intangible cultural heritage themed stone NFTs, which include traditional craft textures and patterns;

[0381] *Special effects design follows traditional Chinese aesthetic principles;

[0382] - Integration of solar term culture:

[0383] * Organize a "24 Solar Terms Water Floating Competition";

[0384] *Limited-time gameplay designed incorporating customs such as Dragon Boat Festival and Mid-Autumn Festival moon viewing;

[0385] * Traditional cultural content was disseminated over 1 billion times annually;

[0386] Example 10: Cross-chain Interoperability and Security System

[0387] The cross-chain interoperability and security system of this invention includes:

[0388] 1. Cross-chain interoperability protocol:

[0389] -Supports data interoperability with multiple metaverse platforms:

[0390] * Asset recognition between platforms such as Decentraland and Sandbox;

[0391] *Players can bring NFT stones to participate in cross-platform tournaments;

[0392] *Performance is simultaneously included in multiple ecosystem leaderboards;

[0393] - Cross-chain asset standards:

[0394] *Adopts ERC-721 and ERC-1155 standards;

[0395] Smart contracts automatically verify the validity of assets;

[0396] *Security guarantees for cross-chain transactions;

[0397] 2. Security Mechanism:

[0398] - Quantum encryption authentication:

[0399] * Quantum hash encryption is applied to the core physical computing module;

[0400] *Prevent external tampering with physical parameters;

[0401] Ensure fairness in the competition

[0402] -AI Behavioral Auditing:

[0403] * Analyze throwing patterns using an LSTM neural network;

[0404] * Monitor indicators such as throwing frequency and angle stability;

[0405] * Identifies script cheats (accuracy ≥ 99.7%);

[0406] * Accounts found to have violated regulations will have their NFT assets frozen and auctioned off to a charitable foundation.

[0407] 3. Data privacy protection:

[0408] -Multi-layered encryption for storing sensitive user data;

[0409] -Decentralized identity verification system;

[0410] - Complies with global data protection standards such as GDPR;

[0411] Example 11: Application Scenarios and Social Benefits

[0412] like Figure 12 As shown, this invention supports multiple application scenarios and social benefits: 1. Esports scenario:

[0413] -Professional competition system:

[0414] *International-level standardized competition rules;

[0415] *Pro player rankings and prize pool;

[0416] *Event live streaming and commentary system;

[0417] -Training and Analysis Platform:

[0418] *Data analysis of professional athletes;

[0419] *Technical action breakdown and optimization suggestions;

[0420] *AI-assisted training system;

[0421] 2. Scenario for nationwide fitness:

[0422] - Open to all, regardless of barriers:

[0423] *No age, gender, or geographical restrictions;

[0424] *Suitable for people with disabilities (via alternative input methods);

[0425] *Low-intensity, highly enjoyable fitness methods;

[0426] -Health data analysis:

[0427] *Records users' exercise habits and health indicators;

[0428] * Generate personalized fitness reports;

[0429] *Provides scientific fitness advice;

[0430] 3. Educational and science popularization scenarios:

[0431] - Applications in physics education:

[0432] * Visually demonstrates physical phenomena such as fluid mechanics and projective motion through skipping stones; * Visualizes parameters to show the actual effects of physical formulas.

[0433] *Supports teachers in creating their own teaching scenarios;

[0434] -Hydrological and Environmental Science Popularization:

[0435] * Showcasing the characteristics and ecosystems of different aquatic areas;

[0436] *Cultivating awareness of water resource protection;

[0437] * Collaborate with educational institutions to develop curriculum content;

[0438] 4. Cultural Heritage Scenarios:

[0439] -Digital preservation of intangible cultural heritage:

[0440] *Integrating traditional craft elements into game equipment;

[0441] *Create a virtual intangible cultural heritage museum;

[0442] *Attracting the younger generation to learn about traditional culture;

[0443] -Experience the culture of the solar terms:

[0444] *Experience traditional solar term activities through gamification;

[0445] *Recreating traditional folk customs in a virtual environment;

[0446] *Enhance cultural identity and sense of belonging;

[0447] 5. Business and Marketing Scenarios:

[0448] -Brand cooperation model:

[0449] *Customized brand-themed scenes and events;

[0450] Digital advertising integration;

[0451] Sponsorship of professional competitions;

[0452] -Offline traffic generation applications:

[0453] *Integrate with tourist attractions;

[0454] *Interactive installations in the business center;

[0455] * Tools for attracting customers to restaurants and entertainment venues;

[0456] Example 12: Implementation Plan and Business Model

[0457] The implementation plan and business model of this invention include:

[0458] 1. Phased implementation path:

[0459] - Development Phase (Q3 2025): Complete physics engine version 1.0, basic digital human modeling, and the first demo development;

[0460] -Pilot period (Q1 2026): Launch internal testing with 100,000 users and integrate with the health device ecosystem;

[0461] - Promotion period (Q3 2026): Launch the "XXXX Water Area Digital Twin Plan" in conjunction with relevant departments;

[0462] - Maturity stage (Q1 2027): Launch a decentralized economic system and open a UGC editor;

[0463] 2. Business Model:

[0464] - User-paid services: purchase of virtual equipment, membership subscription (19.9 yuan / month), NFT trading;

[0465] -Corporate partnerships: Brand sponsorship, cultural tourism promotion, and collaboration with health equipment companies;

[0466] - Data services: Providing user action data (anonymized) to sports brands;

[0467] -Public welfare cooperation: Environmental organization adoption program, science education project;

[0468] 3. Quantitative indicators of social benefits:

[0469] -Health Promotion: Encourage 100 million people to participate in light exercise, with an average annual exercise time of +50 hours per person;

[0470] -Environmental protection and public welfare: Adopting 100,000 square meters of real wetlands, reaching 100 million people with science popularization;

[0471] -Cultural Heritage: Developed 50+ intangible cultural heritage-themed NFTs, with traditional culture reaching over 10 billion views;

[0472] -Economic value: It has driven digital sports consumption to exceed 5 billion yuan and created 20,000 jobs;

[0473] Through the above implementation methods, the present invention realizes a metaverse digital twin skipping water system based on wearable motion capture technology. It has high-precision physical simulation, immersive user experience, complete economic ecosystem and virtual-real linkage capabilities. It can be widely used in many fields such as e-sports, national fitness, education and popular science, cultural heritage and commercial marketing, and makes positive contributions to promoting the development of the digital economy.

[0474] The embodiments of the present invention are given for illustrative and descriptive purposes only, and are not intended to be exhaustive or to limit the invention to the forms disclosed. Many modifications and variations will be apparent to those skilled in the art. The embodiments were chosen and described in order to better illustrate the principles and practical application of the invention, and to enable those skilled in the art to understand the invention and to design various embodiments with various modifications suitable for a particular purpose.

Claims

1. A metaverse digital twin skipping water system based on wearable motion capture technology, characterized in that, Includes the following modules: Wearable motion capture module: It uses a TOF depth camera and MediaPipe motion capture recognition framework, and is accelerated and optimized by NPU to capture the user's throwing action and convert it into three-dimensional motion parameters; Key point data processing and transmission module: adopts asynchronous processing mechanism and dynamic data interpolation technology to increase the actual detection frame rate to a high frame rate transmission frequency; Multi-dimensional physical parameter engine: used to simulate dynamic water stratification systems and rock dynamics models; Digital Twin Water Module: Used to construct a digital twin environment of real water using panoramic holographic oblique photography technology; Competition Rules and Scoring Module: Used to implement standardized competition rules and scoring systems; Digital Human Fitness Ecosystem: Used to realize a character growth system, health data linkage, and social fitness scenarios; Virtual Assets and Economic System: Used to implement a dual-token economic model and an NFT asset matrix; LBS geolocation system: used to realize the mapping of real-world water areas and the linkage of offline experiences; Environmental Protection and Cultural Heritage System: Used to achieve public welfare in water resource protection and the inheritance of traditional culture; Cross-chain interoperability and security system: used to achieve cross-platform data interoperability and anti-fraud protection; The multi-dimensional physics parameter engine includes: Dynamic water stratification system: Based on the Navier-Stokes equations, a fluid dynamics model is developed to divide the water surface into calm, turbulent and vortex zones, supporting 12 hydrological environments; Rock dynamics model: Supports custom three-axis inertial tensor, simulates the effect of rotational angular velocity on jumping posture, introduces Magnus effect to simulate trajectory deviation caused by side rotation, with an error accuracy of ±1°; The key data processing and transmission module adopts an asynchronous processing mechanism, and the specific operation process is as follows: By using dynamic data interpolation technology, the actual detection frame rate can be increased to a transmission frame rate of 60-90fps; A predictive interpolation algorithm is used to ensure the smoothness and accuracy of the padded frame data; Implement send queue management, dynamically adjust the send frequency, and avoid network congestion; The digital twin water area module acquires multi-angle high-precision image data through panoramic holographic oblique photography technology, and performs three-dimensional reconstruction based on the principles of photogrammetry, with an accuracy of up to the centimeter level. At the same time, it combines computational fluid dynamics model to construct water flow characteristics. The workflow of the Metaverse digital twin skipping water system is as follows: S1. Acquire user images using a TOF depth camera; S2. Use the MediaPipe motion capture recognition framework and NPU acceleration technology to recognize throwing actions; S3. Key point data is processed using an asynchronous processing mechanism and dynamic data interpolation technology. S4. Analyze the action sequence to calculate the throwing parameters, including the direction angle, initial velocity, and rotational angular velocity; S5. Calculates stone trajectory and water surface interaction effects based on a multi-dimensional physical parameter engine; S6. Calculate the score based on parameters such as the number of jumps and the distance, and update the ranking.

2. The metaverse digital twin skipping water system based on wearable motion capture technology according to claim 1, characterized in that, The MediaPipe motion capture and recognition framework is accelerated and optimized by NPU, which increases the inference speed of the entire process from 8fps to 22fps, an improvement of 175%; after model quantization, the size is reduced by 40% and the memory usage is reduced by 35%.

3. The metaverse digital twin skipping system based on wearable motion capture technology according to claim 1, characterized in that, The scoring formula implemented by the competition rules and scoring module is: Total score = Base score × Difficulty coefficient × Skill bonus, where Base score = Number of jumps × 50 + Total distance (meters) × 10.

4. The metaverse digital twin skipping system based on wearable motion capture technology according to claim 1, characterized in that, The digital human fitness ecosystem, virtual asset and economic system, LBS geo-anchoring system, and environmental protection and cultural heritage system are detailed below: 1) The digital human fitness ecosystem includes: Character progression system: Includes three major professions: "Water Skimmer", "Water Ranger", and "Competitive Fighter"; Health data linkage: Integrate wearable device data and synchronize exercise data to digital human attributes; Social fitness scenarios: Supports team-based dungeons, live tutorials, and gamified fitness mechanics; 2) Virtual assets and economic systems include: Dual-token economic model: Splash Coin and Ripple Coin; NFT asset matrix: Stone NFTs, Land NFTs, and Cultural Theme NFTs; Dynamic pricing algorithm: P=kx(T+SxR) / U, where P is the price, k is the base coefficient, T is the holding time, S is the scarcity, R is the historical performance, and U is the market circulation. Mechanism for converting virtual and real value; 3) The LBS geolocation system generates digital twin water areas through satellite images and user-uploaded videos, supporting the setting up of AR water skipping challenge platforms in real scenic spots to achieve online and offline interaction; 4) The environmental protection and cultural heritage system includes: A public welfare mechanism for water resource protection: for every 100m of virtual water area purified by a user, the platform, in conjunction with environmental organizations, will adopt 1m of real wetland. The traditional cultural heritage function includes the reproduction of historical water scenes, the combination of art and water floatation, and the integration of seasonal culture.

5. The metaverse digital twin skipping system based on wearable motion capture technology according to claim 1, characterized in that, The cross-chain interoperability and security system includes: Cross-chain interoperability protocol: Supports data interoperability with multiple metaverse platforms; Quantum encryption authentication: Quantum hash encryption is applied to the core physical computing module; AI-powered behavioral auditing: Identifies cheating behavior using LSTM neural networks with an accuracy rate of ≥99.7%.

6. A metaverse digital twin skipping method based on wearable motion capture technology, applied to the metaverse digital twin skipping system based on wearable motion capture technology as described in claims 1-5, characterized in that... Includes the following steps: S1. Acquire user images using a TOF depth camera; S2. Use the MediaPipe motion capture recognition framework and NPU acceleration technology to recognize throwing actions; S3. Key point data is processed using an asynchronous processing mechanism and dynamic data interpolation technology. S4. Analyze the action sequence to calculate the throwing parameters, including the direction angle, initial velocity, and rotational angular velocity; S5. Calculates stone trajectory and water surface interaction effects based on a multi-dimensional physical parameter engine; S6. Calculate the score based on parameters such as the number of jumps and the distance, and update the ranking; S7. Update user role attributes and achievements in the digital human fitness ecosystem; S8. Handling transactions and value transfers between virtual assets and the economic system; S9. Implement the virtual-real linkage function in the LBS geographic anchoring system; S10. Carry out public welfare and cultural dissemination activities within the environmental protection and cultural heritage system; In step S5, a high-precision physical simulation is achieved through a dynamic water stratification system based on the Navier-Stokes equations and a rock dynamics model, supporting 12 hydrological environments with a rock jumping error of ≤0.5 times.

7. The method for skipping stones using a metaverse digital twin based on wearable motion capture technology according to claim 6, characterized in that, The steps include acquiring real water area data using panoramic holographic oblique photography technology and constructing a digital twin water area model, the steps of which include: I. Use drones equipped with multi-angle cameras to collect water area image data; II. Feature point matching using the Structure from Motion algorithm; III. A high-precision point cloud model is generated using a dense matching algorithm; IV. Assigning physical properties to water bodies through computational fluid dynamics models.

8. The method for skipping stones using a metaverse digital twin based on wearable motion capture technology according to claim 6, characterized in that, The following steps are included in realizing the value of fitness: Ⅰ. Record user exercise parameters and generate health reports; II. Enhance the fun of sports through gamification mechanisms; III. Establish social interaction mechanisms to enhance fitness engagement; IV. Achieve linkage between health data and real-world fitness services.

Images