A full - process protection method for embroidery digitization that integrates deep learning and blockchain evidence storage

Abstract

The present invention provides a full - process protection method for embroidery digitization integrating deep learning and blockchain evidence storage, including: Step 1, using multi - modal data acquisition technology to obtain multi - modal data of embroidery works; Step 2, eliminating environmental noise from the multi - modal data collected in Step 1 through an improved adaptive Kalman filtering algorithm, and compressing redundant temporal information through key - frame extraction technology to obtain a standardized process data set; Step 3, using deep learning to drive stitch recognition, and realizing the reproduction of embroidery methods through convolutional neural networks, generative adversarial networks, and edge detection algorithms; Step 4, uploading to the blockchain protocol to clarify digital ownership and batch - manage resources; Step 5, mobile application deployment: constructing a mobile application through a lightweight cross - platform framework to achieve digital protection of embroidery. The present invention greatly improves the data foundation and provides rich and systematic data resources for embroidery digitization research and application.

Description

Technical Field

[0001] The present invention relates to the technical field of digital protection of intangible cultural heritage, and specifically relates to a full-process protection method for digital embroidery that integrates deep learning and blockchain evidence storage. Background Art

[0002] Embroidery, as an important part of Chinese intangible cultural heritage, carries rich historical and cultural values and artistic connotations. However, with the rapid development of modern technology and the gradual decline of traditional handicrafts, the inheritance and protection of embroidery techniques face severe challenges. Currently, the digital protection of embroidery mainly relies on image acquisition and flat scanning technologies, specifically manifested as three methods: manual recording of stitch methods, static image archiving, and simple blockchain applications. Although these traditional methods have achieved digital preservation of embroidery works to a certain extent, they have obvious deficiencies in terms of efficiency, accuracy, restoration ability, and the depth of blockchain application, and are difficult to meet the needs of modern intangible cultural heritage protection.

[0003] The present invention proposes a full-process protection method for digital embroidery that integrates deep learning and blockchain evidence storage. By introducing deep learning technology, accurate identification of embroidery stitch methods and dynamic reproduction of embroidery techniques are achieved; through the in-depth application of blockchain technology, transparent management and effective protection of digital resources are ensured. Specifically, the present invention first obtains the three-dimensional structure, stitch trajectories, and material information of embroidery works through multi-dimensional data acquisition technologies (such as 3D laser scanning, nine-axis inertial measurement unit, and hyperspectral imaging); secondly, uses an improved adaptive Kalman filtering algorithm and a deep learning model to process and analyze the data to achieve accurate identification of stitch methods and dynamic restoration of embroidery techniques; finally, through blockchain technology, the digital information of embroidery works is deeply bound to the information of inheritors to ensure the immutability and transparent management of digital assets. The present invention can not only improve the efficiency and accuracy of digital embroidery, but also provide a new technical support for the protection and inheritance of embroidery intangible cultural heritage. Summary of the Invention

[0004] Object of the Invention: To solve the problems in traditional digital embroidery technologies, such as low efficiency of manual recording of stitch methods, inability to restore the three-dimensional structure by static image archiving, record distortion, low inheritance efficiency, and property right confusion caused by superficial blockchain applications, the present invention realizes multi-dimensional data acquisition, intelligent analysis, dynamic modeling, and blockchain evidence storage of embroidery works by constructing a full-process protection method for digital embroidery that integrates deep learning and blockchain evidence storage, ensuring accurate recording, efficient inheritance, and transparent management of embroidery intangible cultural heritage. The present invention aims to break through the limitations of traditional technologies in time and space, provide an efficient, accurate, and secure digital protection solution for embroidery, and provide a new technical support for the protection and inheritance of embroidery intangible cultural heritage.

[0005] Technical solution: A full-process protection method for embroidery digitization that integrates deep learning and blockchain evidence storage of the present invention is generally divided into five layers: data acquisition layer, data processing layer, deep learning layer, blockchain evidence storage layer, and mobile application layer, and specifically includes the following steps:

[0006] Step 1, collect multi-modal data: Use multi-modal data acquisition technology to obtain multi-modal data of embroidery works, including three-dimensional point cloud data, needle tip movement trajectories, and material characteristics, providing high-quality raw data for subsequent process data analysis and deep learning modeling;

[0007] Step 2, perform data preprocessing and feature extraction: Eliminate environmental noise from the multi-modal data collected in Step 1 through an improved adaptive Kalman filtering algorithm, and compress redundant temporal information through key frame extraction technology to finally obtain a standardized process data set, which is stored in a database;

[0008] Step 3, perform stitch recognition and embroidery method reproduction driven by deep learning: Use deep learning to drive stitch recognition, and through 3D convolutional neural network, generative adversarial network, and Canny edge detection algorithm, realize the reproduction of embroidery methods;

[0009] Step 4, blockchain evidence storage and digital ownership management: Upload to the blockchain RC721 protocol to clarify digital ownership and manage resources in batches;

[0010] Step 5, deploy mobile applications: Build mobile applications through a lightweight cross-platform framework to achieve digital protection of embroidery.

[0011] Step 1 includes the following steps:

[0012] Step 1.1, use a 3D laser scanner (resolution ≥ 1600 dpi) to perform non-contact scanning on the surface of the embroidery work to generate three-dimensional point cloud data with millimeter-level accuracy, and perform denoising processing through the neighborhood average filtering algorithm. The formula is:

[0013] ,

[0014] where, represents the th original three-dimensional point cloud coordinate within the preset neighborhood radius centered on the target point, that is, each point represents the three-dimensional coordinates of a small area on the embroidery surface captured by the scanner ; is the number of valid points within the neighborhood, (it is necessary to satisfy to exclude isolated noise points); is the smoothed three-dimensional point cloud coordinate output after denoising;

[0015] Step 1.2, the motion data of the needle tip is collected in real time by a nine-axis IMU sensor (model MPU-9250, sampling frequency 200Hz) deployed on the embroidery needle tool, and the motion data of the needle tip is smoothed by the following formula:

[0016] ,

[0017] where, is the motion speed of the needle tip at time t, calculated by the nine-axis IMU sensor deployed on the embroidery needle tool, and the unit can be m / s or mm / s; is the motion speed of the needle tip at time t after smoothing, that is, a more stable speed value after filtering, used to reduce instantaneous noise and make the motion trajectory smoother; is the smoothing coefficient, and the value range is , used to control the smoothing degree. If is larger (close to 1), the newly collected speed data plays a dominant role, the speed is updated faster, and the filtering effect is weaker. If is smaller (close to 0), the smoothed speed data depends more on the historical data , and the trajectory is more stable, but it may cause a lag effect;

[0018] Step 1.3, analyze the spectral reflection characteristics of the embroidery thread material through a hyperspectral imaging system (wavelength range 400~2500nm) to generate a material spectral fingerprint, and normalize the spectral data by the following formula:

[0019] ,

[0020] This formula is used to normalize the hyperspectral data and map the spectral data to the range [0,1] for subsequent analysis and machine learning modeling. Among them, is the original spectral data at wavelength , that is, the spectral reflectance or intensity value corresponding to a certain wavelength measured by the hyperspectral imaging system, and the unit is usually reflectance (0~100%) or radiance (W / m²·sr·nm); and are the minimum and maximum values of the original spectral data respectively; is the normalized spectral data, which linearly transforms to between [0,1], removing the influence of illumination conditions or equipment differences on the data, and making it suitable for machine learning models or pattern recognition tasks;

[0021] Step 1.4, identify the material composition and aging state, including the following steps:

[0022] Step 1.4.1: Analyze the composition of the embroidery material using the Wiley General Spectral Database;

[0023] Step 1.4.2: Train a classification model using Support Vector Machine (SVM). Input the spectral fingerprint of the material and output the predicted material category (such as 100% silk, cotton-linen blend, etc.);

[0024] Step 1.4.3: Calculate the spectral offset rate of the material :

[0025] ,

[0026] where is the standard spectral data of the measured material; reflects the spectral offset and is used to evaluate the degree of aging.

[0027] Step 2 includes the following steps:

[0028] Step 2.1: Execute the improved adaptive Kalman filtering algorithm. The formula for the improved state transition matrix is:

[0029] ,

[0030] where is the state transition matrix, is the control input matrix, is the control input vector, is the process noise; is the system state vector at time k, representing the key parameters of the needle tip movement:

[0031] ,

[0032] where represents the three-dimensional coordinate position of the needle tip, measured by a 3D laser scanner, is the velocity of the needle tip in the direction calculated by a nine-axis IMU sensor;

[0033] The state transition matrix reflects the change in the movement state of the needle tip and adopts a discrete motion model:

[0034] ,

[0035] where is the sampling time interval, and the first three rows of the state transition matrix reflect the change in position over time: , and the last three rows reflect that the velocity remains unchanged: ;

[0036] In some cases, the movement of the tip is affected by external control inputs, such as the force applied by the operator's hand, and the control input matrix is:

[0037] ,

[0038] The control input vector includes the accelerations of the tip in the x, y, and z directions measured by a nine-axis IMU sensor :

[0039] ,

[0040] The influence on the tip movement is obtained, including position change and speed change:

[0041] Position change: ;

[0042] Speed change: ;

[0043] where represents the speed in the x-axis direction at the current moment, represents the speed in the x-axis direction at the previous moment;

[0044] Process noise represents the dynamic error of the system (such as hand vibration) and follows a Gaussian distribution : ;

[0045] The covariance matrix is calculated from the tip acceleration noise and the time interval :

[0046] ,

[0047] where is the variance of the tip movement acceleration noise and can be obtained from the data manual provided by the IMU sensor;

[0048] Finally, the smoothed tip trajectory after adaptive Kalman filtering is output ;

[0049] Step 2.2, extract key frames: Calculate the compression ratio through the following formula :

[0050] ,

[0051] where is the multi-modal data collected in Step 1, is the amount of data after compression.

[0052] Step 3 includes the following steps:

[0053] In step 3.1, a 3D convolutional neural network (3D-CNN) is used to extract the spatial topological structure information of the stitches and capture the features of different stitching methods. An improved 3D convolutional neural network is used to extract the spatial topological features of the stitches, and the formula is:

[0054] ,

[0055] where is the input feature map, and the parameters of the input feature map include , where is the number of input channels (such as feature channels for color, texture, etc.), respectively represent the depth, height, and width of the stitch structure; is the convolutional kernel weight, is the bias term, is the activation function, is the output feature map;

[0056] In step 3.2, a generative adversarial network GAN is used to generate the vector field of the stitch trajectory to improve the continuity and rationality of the trajectory;

[0057] In step 3.3, edge detection and optimization are performed on the generated stitch path to ensure the accuracy of the reproduced embroidery method.

[0058] Step 3.2 includes: The loss function of the generator of the generative adversarial network GAN is:

[0059] ,

[0060] where the input of the generator is , and the output is the stitch trajectory vector field; the discriminator is used to judge whether the generated stitch path conforms to the real embroidery method; is the physical constraint loss to ensure that the generated path conforms to the physical rules of embroidery; is the input random noise of the generator, which follows the Gaussian distribution ; represents the expected value of the result obtained by sampling the random variable ; the hyperparameter is used to control 's influence degree in the overall loss.

[0061] Step 3.3 includes: improving the Canny edge detection algorithm, and the formula is:

[0062] ,

[0063] wherein represents the gradient magnitude, are the gradients in the horizontal and vertical directions respectively, calculated using the Sobel operator:

[0064] ,

[0065] wherein is the pin path image generated in step 3.2, represents the convolution operation.

[0066] Perform edge detection and optimization on the gradient magnitude For each pixel point , calculate the gradient direction ; According to the gradient direction, compare the current pixel with its neighboring pixels. If the gradient magnitude of the current pixel is not the local maximum, set it to 0, so as to remove edge noise and only retain the most obvious edges.

[0067] Step 4 includes the following steps:

[0068] Step 4.1, combine the needle tip trajectory extracted in step 2, the compressed data volume,

[0069] and the pin path image I in step 3 to generate a digital twin, that is, combine the virtual representation of the physical embroidery with the process characteristics to obtain a unique digital representation;

[0070] Calculate the hash value of the digital twin through the hash algorithm and bind it to the biometric information of the inheritor (such as identity, fingerprint or facial features, etc.) to form a standardized metadata packet to ensure the uniqueness and authenticity of the digital embroidery. The metadata packet is stored in a decentralized manner through IPFS (InterPlanetary File System) to ensure that the data content of the digital embroidery cannot be tampered with and has the function of permanent evidence preservation;

[0071] Step 5 includes: deploying the pruned and optimized deep learning model using the integrated TensorFlow Lite engine to support real-time low-latency recognition of at least 20 basic stitch types in an offline state; in addition, realizing augmented reality interaction through ARCore technology, enabling users to view and interact with virtual displayed embroidery works through a mobile device, enhancing the user experience; users can encapsulate the parameters of each embroidery work into a unique non-fungible token NFT in ERC-1155 format with one key. Each unique non-fungible token NFT will contain its unique digital certificate and copyright information and conduct on-chain transactions through a built-in smart wallet; this process automatically executes copyright rules through a smart contract to ensure the ownership, transaction, and copyright management of each digital embroidery work. In addition, the generated NFTs will be synchronized on the cultural and museum platform to promote the digital inheritance of embroidery works and the protection of cultural assets.

[0072] The present invention also provides an electronic device, including a processor and a memory. The memory stores program code, and when the program code is executed by the processor, the processor is caused to execute the steps of the method.

[0073] The present invention also provides a storage medium storing a computer program or instruction, and when the computer program or instruction runs on a computer, the steps of the method are executed.

[0074] Compared with the prior art, the present invention has the following beneficial effects: 1. Efficiency of data collection and processing: Traditional embroidery digitization technologies mainly rely on manual records and static image archiving. Manual records are inefficient and prone to distortion, and static image archiving cannot restore the three-dimensional structure and material texture of embroidery works, resulting in insufficient integrity and accuracy of data collection. The present invention realizes the omnidirectional capture and structured processing of embroidery process data through the integration of multi-dimensional sensing devices, greatly improving the data foundation and providing rich and systematic data resources for embroidery digitization research and applications.

[0075] 2. Precision of stitch recognition and embroidery method reproduction: Existing stitch recognition technologies mostly rely on manual records or simple image analysis and are difficult to accurately recognize complex stitch structures, especially the stacking order and stitch distance distribution of multiple layers of embroidery threads. The deep learning-driven method of the present invention can more accurately recognize complex stitch structures and restore the three-dimensional structure and process of embroidery works through dynamic reproduction technology, significantly improving the accuracy and restoration ability of embroidery digitization.

[0076] 3. Security of blockchain evidence storage: Most existing blockchain applications in the digital protection of embroidery stay at the simple stage of uploading images to the blockchain, failing to be deeply bound with the craft data of embroidery works, information of inheritors, etc., resulting in unclear ownership of digital resources and making it difficult to achieve effective intellectual property protection. The blockchain evidence storage technology of the present invention can not only clarify digital ownership, but also realize the transparent management and effective protection of digital resources, completely solving the core problems of data islands, ambiguous ownership and high rights protection costs in traditional evidence storage.

[0077] 4. Convenience of mobile applications: Traditional embroidery digitalization technologies lack convenient mobile application support, and users cannot access and manage digital embroidery works anytime and anywhere, resulting in a poor user experience. The mobile application of the present invention not only provides a more convenient user experience, but also expands the application scenarios of embroidery digitalization through augmented reality technology and blockchain evidence storage function, significantly improving the operation convenience and interaction experience of users. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] Figure 1 It is a hierarchical diagram of the method of the present invention.

[0079] Figure 2 It is a flowchart of the method of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0080] As Figure 1 shown, the embodiment of the present invention provides a full-process protection method for embroidery digitalization integrating deep learning and blockchain evidence storage, which is generally divided into five layers from the bottom layer to the top layer, namely:

[0081] Data acquisition layer: Used to acquire multi-modal data of embroidery craft data, including 3D laser scanning, IMU motion trajectory acquisition and hyperspectral imaging.

[0082] Data processing layer: Used for data preprocessing and feature extraction, including adaptive Kalman filtering algorithm and key frame extraction technology.

[0083] Deep learning layer: Used for stitch recognition and embroidery method reproduction, including 3D convolutional neural network and generative adversarial network.

[0084] Blockchain evidence storage layer: Used for digital ownership management and NFT minting, including blockchain RC721 protocol and IPFS distributed storage.

[0085] Mobile application layer: Used for mobile application deployment, including React Native framework and TensorFlow Lite engine.

[0086] As Figure 2 shown, the method includes the following steps:

[0087] Step 1, Data Acquisition and Preprocessing;

[0088] Step 1.1, Before building the system, the embroidery work to be digitized needs to be placed within the scanning area of the 3D laser scanner, ensuring that the surface of the embroidery is flat to avoid wrinkles or obstructions. The operator wears or fixes a nine-axis inertial measurement unit device on the embroidery tool or the operator's limb to ensure that the device can accurately capture the movement trajectory of the needle tip.

[0089] Step 1.2, Start the 3D laser scanner, IMU device, and hyperspectral imaging system through the mobile application or console to begin collecting multimodal data of the embroidery work. The 3D laser scanner generates three-dimensional point cloud data with millimeter-level accuracy, the IMU device real-time collects the movement trajectory data of the needle tip, and the hyperspectral imaging system analyzes the spectral reflection characteristics of the embroidery thread material.

[0090] Step 1.3, Eliminate environmental noise from the collected raw data through an improved adaptive Kalman filtering algorithm, and compress redundant temporal information through key frame extraction technology. The preprocessed data can be viewed through the mobile application to ensure that the data quality meets the requirements of subsequent analysis.

[0091] Step 2, Stitch Recognition and Embroidery Method Reproduction;

[0092] Step 2.1, Select the stitch recognition function through the mobile application, and the system automatically calls an improved 3D convolutional neural network to extract the spatial topological features of the stitches. The results of stitch recognition can be viewed in the application, and the system will generate a stitch path vector field and the physical properties of the embroidery thread.

[0093] Step 2.2, Select the embroidery method reproduction function, and the system generates a high-fidelity digital twin in real time through the physics engine, including a 4K / 60fps process restoration animation, a physical simulation model based on PBR materials, and a lightweight AR / VR compatible format. The three-dimensional effect of the embroidery method reproduction can be viewed through AR / VR devices or the mobile application to experience the dynamic process of the embroidery work.

[0094] Step 3, Blockchain Evidence Preservation and Digital Ownership Management;

[0095] Step 3.1, Select the blockchain evidence preservation function through the mobile application, and the system automatically binds the three-dimensional geometric model, the process parameters of the deep learning analysis module, the hash value (SHA-3-512) of the digital twin generated by the dynamic modeling module, and the biometric characteristics of the inheritor (such as finger vein recognition, FAR < 0.0001%) to form a standardized metadata package (JSON-LD format). After confirming the content of the metadata package, the system ensures data traceability and censorship resistance through distributed storage in the InterPlanetary File System (IPFS).

[0096] Step 3.2: Select the NFT minting function. The system uses the ERC-721 protocol to mint unique NFTs for each digital embroidery, supports multi-level ownership nesting, and the smart contract automatically enforces copyright rules. The NFT can be traded on the blockchain through the built-in smart wallet and is synchronized to the cultural and museum platform in real time to ensure the transparent management and effective protection of digital embroideries.

[0097] Step 4: User mobile application operations;

[0098] Step 4.1: The user downloads and installs the "Embroidery Intelligence Connect" mobile application and logs in to the system through identity verification. The user can view their personal data space in the application and manage their digitized embroidery works and related metadata.

[0099] Step 4.2: The user selects the stitch recognition function through the application. The system calls the deep learning model in real time to recognize the stitches and generates a stitch path vector field and the physical properties of the embroidery thread. The stitch path guiding line and force feedback prompt can be viewed through the AR function to adjust the embroidery operation in real time.

[0100] Step 4.3: The user selects the blockchain deposit function through the application. The system automatically uploads the metadata package of the digital embroidery to the blockchain and mints a unique NFT. The NFT can be traded on the blockchain through the built-in smart wallet, and the transaction records and ownership information can be viewed to ensure the transparent management and effective protection of digital embroideries.

[0101] Step 4.4: After the user completes the experiment, the system automatically releases the virtual machine resources and clears the experimental data and environment. The user can view the score and feedback of the experimental results in the application and obtain learning suggestions and improvement opinions.

[0102] In this embodiment, the intangible cultural heritage embroidery work "Peony Picture of Suzhou Embroidery" (size approximately 120cm × 60cm) is used as the specific implementation object, and the digital protection and application of this work are carried out in combination with the method of this embodiment:

[0103] 1. Use the FARO Focus S350 3D laser scanner with a point cloud accuracy of ±1mm and support for collecting millions of point clouds to obtain high-precision three-dimensional texture data of the "Peony Picture of Suzhou Embroidery". Use the Xsens MVN IMU inertial measurement system with an error less than 0.5° to achieve high-fidelity restoration of texture details and stitch features. The total amount of three-dimensional texture data generated by collecting a single work is approximately 2.3GB, including approximately 31 million vertices and approximately 250 million pixels of texture maps, containing complete texture and geometric information. Compared with traditional two-dimensional picture archiving, this method completely retains the three-dimensional structure and material information of the embroidery, providing a data basis for subsequent recognition and display.

[0104] 2. Feature extraction and stitch recognition are performed on the collected data using deep learning algorithms. A self-built stitch image library of 12,000 images is created, including flat stitches, random stitches, satin stitches, joining stitches, braid stitches, etc. Stitch feature extraction is carried out based on a deep convolutional network, and the recognition accuracy reaches 93.6%. The system dynamically demonstrates the stitch structure, and the average response time for dynamically demonstrating the construction path of a single stitch is less than 0.5 s. It supports users to gradually view the stitch structure and combination logic, assisting in the inheritance and learning of embroidery techniques, and reflecting the advantages of technology-assisted teaching.

[0105] 3. The recognized embroidery stitch data and core information such as the process parameters of the work are packaged to generate a digital copyright information package, which is stored distributedly through IPFS and stored on the chain to achieve data immutability and trustworthy traceability. The node redundancy backup is greater than or equal to three copies, and the single-file storage limit is 5 GB. Further using NFT technology, a digital collection with a unique identifier is generated for the "Peony Picture Embroidered in Suzhou Style" (TokenID: 0xF3A9D3...E0B2). The data size of the digital copyright information package is approximately 180 MB, including core data such as process flow videos, stitch structure files, and 3D model files, supporting online display and copyright trading.

[0106] 4. Users can scan physical objects or view the embroidery digital model through the mobile App to experience the interactive display with high definition, multi-angle, and multi-stitch details. They can view the copyright information, production process, and cultural background of the work, enhancing the immersive experience of digital display.

[0107] 5. Experimental effects and superiority are demonstrated;

[0108] Experiments show that the method of this embodiment has the following advantages in practical applications:

[0109] High data integrity: 3D high-precision modeling plus stitch recognition, with a realistic restoration effect;

[0110] Strong ownership security: Blockchain storage and NFT issuance ensure the security of digital assets;

[0111] Good interactive experience: Supports AR dynamic display and user independent interaction;

[0112] Wide application expansion: It can serve multiple scenarios such as digital cultural relics, cultural and creative product development, intangible cultural heritage education, and copyright protection.

[0113] The present invention provides a full-process protection method for embroidery digitization that integrates deep learning and blockchain evidence storage. There are many methods and ways to specifically implement this technical solution. The above description is only the preferred embodiment of the present invention. It should be noted that for those of ordinary skill in the art in this technical field, without departing from the principle of the present invention, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of the present invention. Each component not clearly defined in this embodiment can be implemented using existing technologies.

Claims

1. A full - process protection method for embroidery digitization that integrates deep learning and blockchain evidence storage, characterized in that, It includes the following steps: Step 1, collect multimodal data: Use multimodal data acquisition technology to obtain multimodal data of embroidery works, including three-dimensional point cloud data, needle tip movement trajectories, and material characteristics; Step 2, perform data preprocessing and feature extraction: Eliminate environmental noise from the multimodal data collected in Step 1 using an improved adaptive Kalman filtering algorithm, and compress redundant temporal information through key frame extraction technology to finally obtain a standardized process dataset, which is stored in a database; Step 3, perform stitch recognition and embroidery method reproduction driven by deep learning: Use deep learning to drive stitch recognition, and through 3D convolutional neural network, generative adversarial network, and Canny edge detection algorithm, realize the reproduction of embroidery methods; Step 4, blockchain evidence storage and digital ownership management: Upload to the blockchain RC721 protocol to clarify digital ownership and manage resources in batches; Step 5, mobile application deployment: Build a mobile application through a lightweight cross-platform framework to achieve digital protection of embroidery; Step 1 includes the following steps: Step 1.1, Use a 3D laser scanner to perform non-contact scanning on the surface of the embroidery work to generate three-dimensional point cloud data with millimeter-level accuracy, and perform denoising processing through the neighborhood average filtering algorithm. The formula is: Among them, P i (x, y, z) represents the coordinate of the i-th original three-dimensional point cloud within the preset neighborhood radius centered at the target point, that is, each point P i represents the three-dimensional coordinates (x, y, z) of a region on the embroidery surface captured by the scanner; N is the number of valid points within the neighborhood, N≥5; P filtered (x, y, z) is the smoothed three-dimensional point cloud coordinate output after denoising; Step 1.2, Real-time collect needle tip movement data through a nine-axis IMU sensor deployed on the embroidery needle, and smooth the needle tip movement data through the following formula: v smoothed v(t) = α·v(t) + (1 - α)·v smoothed (t - 1), where v(t) is the movement speed of the tip at time t; v smoothed (t) is the movement speed of the tip at time t after smoothing; α is the smoothing coefficient, and its value range is 0 < α < 1; Step 1.3, Analyze the spectral reflection characteristics of the embroidery thread material through a hyperspectral imaging system to generate a material spectral fingerprint, and normalize the spectral data through the following formula: Among them, S(λ) is the original spectral data at wavelength λ; S min and S max are the minimum and maximum values of the original spectral data respectively; S normalized (λ) is the normalized spectral data; Step 1.4, Identify material composition and aging status, including the following steps: Step 1.4.1, Use the Wiley General Spectral Database to perform component analysis on embroidery materials; Step 1.4.2, Adopt a support vector machine SVM to train a classification model, input the material spectral fingerprint, and output the predicted material category; Step 1.4.3, calculate the spectral shift rate D of the material shift : Among which S new (λ) is the standard spectral data of the material to be measured.

2. The method according to claim 1, wherein Step 2 includes the following steps: Step 2.1, Execute an improved adaptive Kalman filtering algorithm. The formula for the improved state transition matrix is: x k = A k x k-1 + B k u k + w k , Among them, A k is the state transition matrix, B k is the control input matrix, u k is the control input vector, w k is the process noise; x k is the system state vector at time k: Among them, x, y, z represent the three-dimensional coordinate positions of the needle tip, and v1, v2, v3 are the speeds of the needle tip in the x, y, z directions calculated by the nine-axis IMU sensor; State transition matrix A k To reflect the change in the movement state of the tip, a discrete motion model is adopted: where Δt is the sampling time interval, and the state transition matrix A k The first three rows of which reflect the change of position over time: x k = x k-1 + v x Δt, and the last three rows reflect that the velocity remains unchanged: v k = v k-1 ; Control input matrix B k is as follows: Control input vector u k including the accelerations a of the needle tip in the x, y, and z directions measured by a nine-axis IMU sensor x , a y , a z : Obtain the influences on the needle tip movement, including position changes and speed changes: Position change: Change in speed: v x,k = v x,k-1 + a x Δt; where v x,k represents the velocity in the x-axis direction at the current moment, and v x,k-1 represents the velocity in the x-axis direction at the previous moment; Process noise w k represents the dynamic error of the system and follows a Gaussian distribution The covariance matrix Q is calculated from the needle tip acceleration noise and the time interval Δt k : Among them is the variance of the acceleration noise of the tip movement; Finally, output the smoothed tip trajectory x after adaptive Kalman filtering processing k ; Step 2.2, Extract key frames: Calculate the compression ratio X1 through the following formula: Among them, N original is the multimodal data collected in step 1, and N compressed is the amount of data after compression.

3. The method according to claim 2, characterized in that, Step 3 includes the following steps: Step 3.1, Adopt an improved 3D convolutional neural network to extract the spatial topological features of stitches. The formula is: F out = σ(M * F in + b), Among them, F in is the input feature map, and the parameters of the input feature map include C in , D, H, W, where C in is the number of input channels, and D, H, W respectively represent the depth, height, and width of the pin structure; M is the convolution kernel weight, b is the bias term, σ is the activation function, and F out is the output feature map; Step 3.2, Use a generative adversarial network GAN to generate a vector field of the stitch trajectory; Step 3.3, Perform edge detection and optimization on the generated stitch path to ensure the accuracy of the reproduced embroidery method.

4. The method according to claim 3, wherein Step 3.2 includes: the loss function of the generator of the generative adversarial network GAN which is Among them, the input of the generator G(z) is F out , and the output is the stitch trajectory vector field; the discriminator D(G(z)) is used to judge whether the generated stitch path conforms to the real embroidery method; is the physical constraint loss; p z (z) is the input random noise of the generator, which follows the Gaussian distribution N~(0,1); represents the expected value of the result obtained by sampling the random variable z; the hyperparameter λ1 is used to control the influence degree in the overall loss.

5. The method according to claim 4, characterized in that, Step 3.3 includes: Improve the Canny edge detection algorithm. The formula is: where G(x,y) represents the gradient magnitude, and G x , G y are the gradients in the horizontal and vertical directions respectively, and are calculated using the Sobel operator: Among them, I is the stitch path image generated in Step 3.2, and * represents the convolution operation; Perform edge detection and optimization on the gradient magnitude G(x, y). For each pixel point (x, y), calculate the gradient direction According to the gradient direction, compare the current pixel with its neighboring pixels. If the gradient magnitude of the current pixel is not a local maximum, set it to 0.

6. The method according to claim 5, characterized in that, Step 4 includes the following steps: Step 4.1, combine the tip trajectory x extracted in Step 2 k , the compressed data volume N compressed with the stitch path image I in Step 3 to generate a digital twin and obtain a unique digital representation; The hash value of the digital twin is calculated by a hash algorithm and bound to the inheritor's biometric information to form a standardized metadata package to ensure the uniqueness and authenticity of the digital embroidery. The metadata package is decentralized and stored through the Interstellar File System IPFS. Step 4.2: Use the ERC-721 non-fungible token NFT standard to mint a unique non-fungible token NFT for each digital embroidery and give it an on-chain identity.

7. The method according to claim 6, characterized in that Step 5 includes: using the integrated TensorFlow Lite engine to deploy a pruned and optimized deep learning model that supports real-time recognition of at least 20 basic stitches in an offline state; using ARCore technology to achieve augmented reality interaction, users can view and interact with virtually displayed embroidery through mobile devices; users can encapsulate the parameters of each embroidery into a unique non-fungible token NFT in the ERC-1155 format. Each unique non-fungible token NFT will contain a unique digital certificate and copyright information, and can be traded on the chain through a built-in smart wallet.

8. An electronic device, characterized in that, The method comprises a processor and a memory, wherein the memory stores program codes, and when the program codes are executed by the processor, the processor executes the steps of the method according to any one of claims 1 to 7.

9. A storage medium, characterized in that, A computer program or instruction is stored, and when the computer program or instruction is run on a computer, the steps of the method according to any one of claims 1 to 7 are executed.

Images