A method and system for digitizing intangible cultural heritage

Abstract

The present invention discloses a method and system for digitizing intangible cultural heritage, which relates to the field of intangible cultural heritage digitization. The method includes: extracting spatial audio and behavioral trajectory features from intangible cultural heritage to establish an intangible cultural heritage feature standard library; constructing a dynamic three-dimensional display model of intangible cultural heritage that integrates multimodal data using three-dimensional modeling software; dynamically capturing the spatial audio information and behavioral trajectories of viewers; quantitatively assessing the consistency of intangible cultural heritage imitation behaviors through data comparison and analysis; dynamically adjusting the progress of the dynamic demonstration of intangible cultural heritage based on the consistency quantitative assessment results; and comprehensively assessing the audience's acceptance of the intangible cultural heritage imitation behaviors based on the dynamic demonstration results. The method utilizes three-dimensional dynamic modeling and real-time interactive technology to construct a digital model of intangible cultural heritage, and achieves a multi-sensory integrated dynamic imitation experience through human-computer interaction, breaking through the interactive limitations of traditional static displays.

Description

Technical Field

[0001] The present invention relates to the field of intangible cultural heritage digitization, and in particular to a method and system for digitizing intangible cultural heritage. Background Art

[0002] Intangible cultural heritage is the carrier of national cultural genes, such as traditional music, dance, and handicrafts. Its inheritance relies on oral transmission by skill holders, but is limited by the aging of inheritors, audience gaps and geographical restrictions, and faces the risk of skill loss. Traditional text records, static image archiving and other protection methods are difficult to fully preserve the dynamic characteristics of intangible cultural heritage such as spatial audio rhythm and behavioral trajectories, and lack interactivity, making it difficult to stimulate the interest of the younger generation.

[0003] The digitization of intangible cultural heritage refers to the process of recording, preserving, disseminating, innovating and inheriting intangible cultural heritage projects using digital technology. With the development of digital technology, digital technology has provided new opportunities for the protection of intangible cultural heritage. Through three-dimensional modeling, multimodal data collection and analysis, three-dimensional recording, standardized inheritance and multi-sensory fusion dissemination of intangible cultural heritage can be achieved. At present, the research on the digitization of intangible cultural heritage has gradually shifted from single-modal recording to multimodal fusion. However, existing technologies mostly focus on static display (such as 3D scanning of cultural relics) and lack interactive presentation of the dynamic process of intangible cultural heritage, which means that users can only receive information in one direction, which is not conducive to the dissemination and inheritance of intangible cultural heritage.

[0004] Existing intangible cultural heritage digitization technologies mainly use static displays and one-touch interactions. However, such technologies lack multimodal interaction mechanisms that capture spatial audio feedback and behavioral trajectory feedback, as well as dynamic content adaptability that adjusts the presentation rhythm according to the viewer's behavior. As a result, users can only receive information in a one-way manner, making it difficult to form cultural resonance and deep cognition through active participation, thereby weakening the attractiveness and educational effectiveness of intangible cultural heritage displays. Summary of the Invention

[0005] In order to solve the above technical problems, a method and system for digitizing intangible cultural heritage are provided. This technical solution solves the problems proposed in the above background technology, such as the lack of a multimodal interaction mechanism for spatial audio capture feedback and behavioral trajectory capture feedback, and the dynamic content adaptability for adjusting the presentation rhythm according to the viewer's behavior, which results in users being able to receive information only in one direction and finding it difficult to form cultural resonance and deep cognition through active participation, thereby weakening the attractiveness and educational effectiveness of intangible cultural heritage displays.

[0006] In order to achieve the above objects, the technical solution adopted by the present invention is:

[0007] A method for digitizing intangible cultural heritage, comprising:

[0008] Based on the standard data of intangible cultural heritage projects, extract the spatial audio and behavioral trajectory features of intangible cultural heritage and establish a standard library of intangible cultural heritage features;

[0009] Based on the intangible cultural heritage feature standard library, a dynamic 3D display model of intangible cultural heritage integrating multimodal data was constructed using Autodesk Maya 3D modeling software.

[0010] Using spatial audio acquisition devices and multi-view camera arrays to collect simultaneous data, the dynamic capture of the viewer's spatial audio information and behavior trajectory is achieved;

[0011] Based on the intangible cultural heritage feature standard library and the audience's spatial audio and behavioral trajectory data, through data comparison and analysis, a quantitative assessment of the consistency of intangible cultural heritage imitation behavior is achieved;

[0012] Dynamically adjust the process of dynamic demonstration of intangible cultural heritage based on the quantitative evaluation results of the consistency of intangible cultural heritage imitation behavior;

[0013] Based on the results of the dynamic demonstration of intangible cultural heritage, a comprehensive assessment is made of the audience's acceptance level of the imitation behavior of intangible cultural heritage.

[0014] Preferably, the method of achieving a quantitative evaluation of the consistency of intangible cultural heritage imitation behavior by comparing and analyzing the intangible cultural heritage feature standard library with the viewer's spatial audio and behavior trajectory data specifically includes:

[0015] Compare each sample in the test dataset with the sample before and after the same sequence point in the target dataset. The historical samples constitute the input pair, and the target data window length is controlled by adjusting the sliding window;

[0016] Adopt FIFO queue to dynamically adjust the target data window length, maintain the time continuity of the data in the window, and always keep the most recent Standard time series data;

[0017] According to the target data window length, based on the DTW algorithm, the DTW distance between the current observation value and each standard value in the window is calculated;

[0018] The DTW distance between each current observation value and each standard value in the window is used as input, and the quantitative evaluation value of the consistency of the intangible cultural heritage imitation behavior is used as output;

[0019] Based on the attention mechanism, the contribution of the DTW distance value between the spatial audio and behavioral trajectory features of each intangible cultural heritage is dynamically weighted;

[0020] Based on the LSTM neural network algorithm, a quantitative evaluation model for the consistency of intangible cultural heritage imitation behavior is established to dynamically evaluate the consistency of intangible cultural heritage imitation behavior.

[0021] Preferably, the process of dynamically adjusting the dynamic demonstration of the intangible cultural heritage according to the quantitative evaluation results of the consistency of the intangible cultural heritage imitation behavior specifically includes:

[0022] According to the quantitative evaluation model of the consistency of intangible cultural heritage imitation behavior, the quantitative evaluation results of the consistency of intangible cultural heritage imitation behavior and the DTW distance between the current observation value and each standard value in the window are obtained;

[0023] According to the consistency requirements of intangible cultural heritage imitation behavior, the boundary threshold of the DTW distance between the current observation value and each standard value in the window is set;

[0024] Get within the boundary threshold range The number of consecutive window lengths between the DTW distances of the current observation value of a time series and each standard value in the window;

[0025] According to the number of consecutive window lengths of the DTW distance of each standard value, the process of dynamic demonstration of intangible cultural heritage is dynamically adjusted;

[0026] According to the matching position of the DTW distance of each window length of the standard value, an intangible cultural heritage dynamic demonstration speed adjustment model is established to dynamically adjust the intangible cultural heritage dynamic demonstration speed;

[0027] The process of dynamically adjusting the dynamic presentation of intangible cultural heritage specifically includes:

[0028] The DTW distance of the standard value is divided into the first Frame, Current Frame, and Next Frame frame;

[0029] If the length of each window is continuous Intra-frame, it means that the imitation behavior of intangible cultural heritage has a temporal delay, and the speed of the dynamic presentation of intangible cultural heritage needs to be reduced;

[0030] If the lengths of each window are continuous on the current frame, it means that the imitation behavior of the intangible cultural heritage has temporal consistency and the dynamic demonstration of the intangible cultural heritage is carried out normally;

[0031] If the length of each window is continuous Within the frame, it means that the imitation behavior of intangible cultural heritage has temporal advance, and the speed of dynamic demonstration of intangible cultural heritage needs to be improved;

[0032] The intangible cultural heritage dynamic demonstration speed adjustment model expression is:

[0033] ;

[0034] Where, Adjust the speed value for dynamic demonstration of intangible cultural heritage. 、 are the coefficients of the linear term and the quadratic term, respectively, which can be obtained by the least squares method. is the average value of the DTW distance value of the window standard value, For the The DTW distance value of the window standard value is is the number of windows of the DTW distance value of the standard value, where The value is 1 or , Select a function for the symbol.

[0035] Preferably, the comprehensive evaluation of the audience's acceptance level of the intangible cultural heritage imitation behavior based on the intangible cultural heritage dynamic demonstration results specifically includes:

[0036] Obtain the consistency assessment results of intangible cultural heritage imitation behaviors and the speed adjustment results of intangible cultural heritage dynamic demonstrations in the same sequence, and establish a list of imitation behaviors in different time sequences;

[0037] Based on the list of imitation behaviors at different time sequences and a weighted formula, an evaluation model for viewers' acceptance of imitation behaviors of intangible cultural heritage is established.

[0038] Through the evaluation model of viewers' acceptance level of imitation behavior of intangible cultural heritage, comprehensively evaluate the viewers' acceptance level of imitation behavior of intangible cultural heritage;

[0039] The evaluation model expression of the audience's acceptance level of imitation behavior of intangible cultural heritage is:

[0040] ;

[0041] Where, is the evaluation value of the audience's acceptance level of imitation behavior of intangible cultural heritage, 、 、 are the consistency evaluation results of intangible cultural heritage imitation behavior, the adjustment value of intangible cultural heritage dynamic demonstration speed, and the weight of intangible cultural heritage dynamic demonstration speed adjustment frequency, respectively. For the The consistency assessment value of the intangible cultural heritage imitation behavior, For the The weight of the speed adjustment of the dynamic demonstration of the intangible cultural heritage, For the The speed adjustment value of the dynamic demonstration of intangible cultural heritage. The average adjustment frequency of the dynamic demonstration speed of intangible cultural heritage, is the number of consistency assessment results of intangible cultural heritage imitation behaviors, The number of speed adjustments for dynamic demonstration of intangible cultural heritage.

[0042] Furthermore, this solution proposes an intangible cultural heritage digitization system for implementing the above-mentioned intangible cultural heritage digitization method, including:

[0043] A standard library module, which is used to extract spatial audio and behavioral trajectory features from intangible cultural heritage based on standard data of intangible cultural heritage items and establish an intangible cultural heritage feature standard library;

[0044] A three-dimensional display module, which is used to construct a dynamic three-dimensional display model of intangible cultural heritage that integrates multimodal data based on the intangible cultural heritage feature standard library using Autodesk Maya three-dimensional modeling software;

[0045] A dynamic capture environment module, which is used to use a spatial audio acquisition device and a multi-view camera array to perform simultaneous data acquisition to achieve dynamic capture of the viewer's spatial audio information and behavior trajectory;

[0046] A comprehensive evaluation module is used to achieve a quantitative evaluation of the consistency of intangible cultural heritage imitation behavior based on the intangible cultural heritage feature standard library and the viewer's spatial audio and behavioral trajectory data through data comparison and analysis; dynamically adjust the progress of the intangible cultural heritage dynamic demonstration based on the quantitative evaluation results of the intangible cultural heritage imitation behavior; and comprehensively evaluate the viewer's acceptance level of the intangible cultural heritage imitation behavior based on the intangible cultural heritage dynamic demonstration results.

[0047] Preferably, the comprehensive evaluation module includes:

[0048] A consistency assessment unit, which is used to achieve a quantitative assessment of the consistency of intangible cultural heritage imitation behavior through data comparison and analysis based on the intangible cultural heritage feature standard library and the viewer's spatial audio and behavior trajectory data;

[0049] A dynamic demonstration unit, configured to dynamically adjust the progress of the dynamic demonstration of the intangible cultural heritage based on the quantitative evaluation results of the consistency of the intangible cultural heritage imitation behavior;

[0050] The acceptance evaluation unit is used to comprehensively evaluate the audience's acceptance level of the intangible cultural heritage imitation behavior based on the intangible cultural heritage dynamic demonstration results.

[0051] Compared with the prior art, the present invention has the following beneficial effects:

[0052] The present invention provides an intangible cultural heritage digitization method. The method extracts spatial audio and behavior trajectory features from the intangible cultural heritage to construct an intangible cultural heritage feature standard library. Secondly, based on the intangible cultural heritage feature standard library and viewer spatial audio and behavior trajectory data, a quantitative evaluation model for consistency of intangible cultural heritage imitation behavior is established through data comparison and analysis based on an LSTM neural network algorithm to achieve quantitative evaluation of consistency of intangible cultural heritage imitation behavior. The method also dynamically adjusts the progress of intangible cultural heritage dynamic demonstration according to the number of continuity of each window length of each standard value DTW distance. Thus, the method establishes an intangible cultural heritage dynamic demonstration speed adjustment model according to the matching position of each window length of the DTW distance of the standard value to dynamically adjust the dynamic demonstration speed of the intangible cultural heritage. Finally, based on the intangible cultural heritage imitation behavior consistency evaluation result and the intangible cultural heritage dynamic demonstration speed adjustment result in the same sequence, an evaluation model for the viewer's acceptance level of the intangible cultural heritage imitation behavior is established based on a weighted formula. The evaluation model comprehensively evaluates the viewer's acceptance level of the intangible cultural heritage imitation behavior, thereby achieving the purpose of constructing a digitized model of intangible cultural heritage using three-dimensional dynamic modeling and real-time interactive technology, realizing a multi-sensory fusion dynamic imitation experience through multimodal human-computer interaction, and breaking through the interactive limitations of traditional static displays. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 This is a flow chart of a method for digitizing intangible cultural heritage according to the present invention;

[0054] Figure 2 This is a flowchart of the present invention for achieving a quantitative evaluation of the consistency of intangible cultural heritage imitation behavior based on the intangible cultural heritage feature standard library and the viewer's spatial audio and behavior trajectory data through data comparison and analysis;

[0055] Figure 3 A flowchart of the process of dynamically adjusting the dynamic presentation of intangible cultural heritage based on the quantitative evaluation results of the consistency of intangible cultural heritage imitation behavior according to the present invention;

[0056] Figure 4 This is a flow chart of comprehensively evaluating viewers' acceptance level of intangible cultural heritage imitation behavior based on the results of the dynamic demonstration of intangible cultural heritage in the present invention. DETAILED DESCRIPTION

[0057] The following description is intended to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are merely examples, and those skilled in the art may conceive of other obvious variations.

[0058] Reference Figure 1 As shown, a method for digitizing intangible cultural heritage includes:

[0059] Based on the standard data of intangible cultural heritage projects, extract the spatial audio and behavioral trajectory features of intangible cultural heritage and establish a standard library of intangible cultural heritage features;

[0060] Based on the intangible cultural heritage feature standard library, a dynamic 3D display model of intangible cultural heritage integrating multimodal data was constructed using Autodesk Maya 3D modeling software.

[0061] Using spatial audio acquisition devices and multi-view camera arrays to collect simultaneous data, the dynamic capture of the viewer's spatial audio information and behavior trajectory is achieved;

[0062] Based on the intangible cultural heritage feature standard library and the audience's spatial audio and behavioral trajectory data, through data comparison and analysis, a quantitative assessment of the consistency of intangible cultural heritage imitation behavior is achieved;

[0063] Dynamically adjust the process of dynamic demonstration of intangible cultural heritage based on the quantitative evaluation results of the consistency of intangible cultural heritage imitation behavior;

[0064] Based on the results of the dynamic demonstration of intangible cultural heritage, a comprehensive assessment is made of the audience's acceptance level of the imitation behavior of intangible cultural heritage.

[0065] It can be explained that traditional technology uses static display and one-touch interaction, which means that users can only receive information in one direction and it is difficult to form cultural resonance and deep cognition through active participation. Therefore, this solution creates a multimodal human-computer interaction to achieve a multi-sensory fusion dynamic imitation experience through quantitative evaluation of the consistency of intangible cultural heritage imitation behavior, dynamic adjustment of the process of dynamic demonstration of intangible cultural heritage, and comprehensive evaluation of the audience's acceptance level of intangible cultural heritage imitation behavior. Through the real-time interaction between the intangible cultural heritage feature standard library and the audience's spatial audio and behavior trajectory data, the audience's acceptance level of intangible cultural heritage imitation behavior is dynamically and comprehensively evaluated, thereby breaking through the interactive limitations of traditional static displays.

[0066] The extraction of spatial audio and behavioral trajectory features from intangible cultural heritage based on standard data of intangible cultural heritage items and the establishment of an intangible cultural heritage feature standard library specifically include:

[0067] According to the categories of intangible cultural heritage items, professional audio and behavioral trajectory collection devices are used to obtain standard data of intangible cultural heritage items;

[0068] Extract spatial audio and behavioral trajectory features of intangible cultural heritage based on standard data of intangible cultural heritage projects;

[0069] Among them, spatial audio features include: time domain features, frequency domain features and MFCC features, and behavioral trajectory features include: the starting point, end point, amplitude, speed of the action, as well as the coordinates, direction, and curvature of the trajectory;

[0070] Normalize the spatial audio and behavioral trajectory feature data of intangible cultural heritage to eliminate the influence of data dimension;

[0071] Based on the filtering algorithm, the spatial audio and behavioral trajectory feature data of intangible cultural heritage are filtered and denoised;

[0072] Establish a standard library of intangible cultural heritage characteristics to store intangible cultural heritage item categories, text descriptions, spatial audio characteristics, and behavioral trajectory feature data.

[0073] It can be explained that in order to ensure the accuracy of the quantitative assessment of the consistency of intangible cultural heritage imitation behavior, it is necessary to accurately extract the spatial audio and behavioral trajectory features and feature data of the intangible cultural heritage. By comparing and analyzing the standard data of intangible cultural heritage features with the spatial audio and behavioral trajectory feature data of the viewers, the consistency of intangible cultural heritage imitation behavior can be effectively quantitatively assessed. Therefore, this scheme extracts the spatial audio and behavioral trajectory features of intangible cultural heritage based on the standard data of intangible cultural heritage projects. Among them, spatial audio extraction splits the spatial audio data into time domain features and frequency domain features through wavelet transform or Fourier transform, and extracts MFCC features that reflect the auditory perception characteristics of the human ear through the Mel-frequency cepstral coefficient (MFCC) algorithm to fully cover the time-frequency structure and perceptual characteristics of the audio. At the same time, for the behavioral trajectory features, three-dimensional spatial coordinate data is collected through a multi-view camera array. Combined with key point detection and kinematic modeling, spatiotemporal dynamic features such as trajectory velocity, acceleration, and joint angle are extracted. Finally, a joint feature representation of spatial audio and behavioral trajectory is formed, providing a standardized data foundation for subsequent dynamic modeling and quantitative assessment of intangible cultural heritage.

[0074] The method of constructing a dynamic 3D display model of intangible cultural heritage integrating multimodal data based on the intangible cultural heritage feature standard library and using Autodesk Maya 3D modeling software specifically includes:

[0075] According to the categories of intangible cultural heritage projects, scenes of different categories of intangible cultural heritage projects were built using Autodesk Maya 3D modeling software;

[0076] Based on the intangible cultural heritage feature standard library, the spatial audio and behavioral trajectory feature data of intangible cultural heritage are converted into a format recognizable by Autodesk Maya.

[0077] According to the standard library of intangible cultural heritage characteristics and based on Autodesk Maya 3D modeling software, a dynamic 3D display model of intangible cultural heritage integrating multimodal data is constructed.

[0078] It can be explained that Autodesk Maya is an industry-level 3D computer graphics software developed by Autodesk. It is widely used in film and television animation, game development, virtual reality (VR), architectural visualization, industrial design and other fields. One of its core functions is 3D modeling, that is, creating, editing and optimizing the geometric shape and structure of 3D objects or scenes through software tools. Through polygonal modeling, NURBS modeling and carving tools, it can completely preserve the geometric form, texture details and spatial structure of traditional handicrafts, building components, performance props and other objects to form permanently storable digital assets. Through the Maya animation production system, key frame animations and motion capture data of traditional dance movements, martial arts moves, handicraft production processes, etc. are constructed. By importing intangible cultural heritage project categories, text introductions, spatial audio features and behavioral trajectory feature data, digital recording of skill movements and other functions can be realized.

[0079] The method of using the spatial audio acquisition device and the multi-view camera array to perform simultaneous data acquisition to dynamically capture the spatial audio information and behavior trajectory of the viewer specifically includes:

[0080] Using spatial audio acquisition devices and multi-view camera arrays, a multi-sensory fusion intangible cultural heritage simulation environment is constructed;

[0081] Using simultaneous data acquisition technology, the spatial audio signal and behavioral motion trajectory data of viewers imitating intangible cultural heritage are synchronously captured under a unified time base;

[0082] Under the same time base, for the dynamic 3D display model of intangible cultural heritage that integrates multimodal data, the spatial audio and behavioral motion trajectory data in the model are synchronously collected;

[0083] The spatial audio signals and behavioral motion trajectory data during imitation are used as test data sets, and the spatial audio and behavioral motion trajectory data in the model are used as target data sets.

[0084] It can be explained that in the digital protection and interactive experience of intangible cultural heritage, achieving real-time interaction between dynamic three-dimensional display data and the viewer's spatial audio and behavioral trajectory data is a key technical link. To achieve this goal, it is necessary to build a multimodal synchronous acquisition system during the data acquisition phase to ensure that the dynamic three-dimensional data of intangible cultural heritage and the viewer's interactive data (spatial audio, behavioral trajectory) are strictly aligned on the same time basis to ensure the temporal and spatial consistency, accuracy and reliability of the data. At the same time, it provides data support for the subsequent dynamic adjustment of the intangible cultural heritage dynamic demonstration process. Therefore, this solution uses a spatial audio acquisition device and a multi-view camera array to construct a multi-sensory fusion intangible cultural heritage simulation environment. Using simultaneous data acquisition technology, the spatial audio signal and behavioral motion trajectory data of the viewer's intangible cultural heritage imitation are synchronously captured under a unified time basis. At the same time, for the dynamic three-dimensional display model of intangible cultural heritage that integrates multimodal data, the spatial audio and behavioral motion trajectory data of the model are synchronously collected, thereby completing the collection of simultaneous data.

[0085] Reference Figure 2 As shown, the quantitative evaluation of the consistency of intangible cultural heritage imitation behavior is achieved through data comparison and analysis based on the intangible cultural heritage feature standard library and the viewer's spatial audio and behavior trajectory data, specifically including:

[0086] Compare each sample in the test dataset with the sample before and after the same sequence point in the target dataset. The historical samples constitute the input pair, and the target data window length is controlled by adjusting the sliding window;

[0087] Adopt FIFO queue to dynamically adjust the target data window length, maintain the time continuity of the data in the window, and always keep the most recent Standard time series data;

[0088] According to the target data window length, based on the DTW algorithm, the DTW distance between the current observation value and each standard value in the window is calculated;

[0089] The DTW distance between each current observation value and each standard value in the window is used as input, and the quantitative evaluation value of the consistency of the intangible cultural heritage imitation behavior is used as output;

[0090] Based on the attention mechanism, the contribution of the DTW distance value between the spatial audio and behavioral trajectory features of each intangible cultural heritage is dynamically weighted;

[0091] Based on the LSTM neural network algorithm, a quantitative evaluation model for the consistency of intangible cultural heritage imitation behavior is established to dynamically evaluate the consistency of intangible cultural heritage imitation behavior.

[0092] It can be explained that when viewers imitate intangible cultural heritage, due to errors in hardware and actions, the spatial audio and behavior trajectory data deviate, which causes inconsistencies between the intangible cultural heritage feature standard library with strictly the same time sequence and the viewer's spatial audio and behavior trajectory data, resulting in inaccurate results in the consistency evaluation of the dynamic evaluation of intangible cultural heritage imitation behavior, thus affecting subsequent data support. Therefore, this scheme sets each sample of the test data set to be before and after the same sequence point in the target data set. The historical samples constitute the input pair, and the data of several target data sets before and after the test data set are associated with each other in the same order, thereby improving the model's tolerance to the delay or advance of the viewer's imitation behavior, and improving the accuracy and reliability of the quantitative evaluation model for the consistency of intangible cultural heritage imitation behavior.

[0093] The LSTM neural network algorithm expression is:

[0094] The forget gate uses: , the input gate uses: , candidate memory uses: , memory update uses: , the output gate uses: , the hidden state uses: , where 、 、 、 、 、 、 、 is the weight matrix, 、 、 、 is the bias vector, is the Sigmoid function, is the DTW distance value after weighting by the attention mechanism, is the hyperbolic tangent function, ;

[0095] Through the Softmax activation function of the fully connected layer, the hidden state data is mapped to the output label space to obtain the probability distribution of the output label, that is, the consistency evaluation value of the intangible cultural heritage imitation behavior;

[0096] The consistency evaluation value of the intangible cultural heritage imitation behavior is expressed as:

[0097] ;

[0098] Where, No. The consistency assessment value of the intangible cultural heritage imitation behavior, is the weight matrix, is the bias vector.

[0099] Reference Figure 3 As shown, the process of dynamically adjusting the dynamic presentation of intangible cultural heritage based on the quantitative evaluation results of the consistency of the intangible cultural heritage imitation behavior specifically includes:

[0100] According to the quantitative evaluation model of the consistency of intangible cultural heritage imitation behavior, the quantitative evaluation results of the consistency of intangible cultural heritage imitation behavior and the DTW distance between the current observation value and each standard value in the window are obtained;

[0101] According to the consistency requirements of intangible cultural heritage imitation behavior, the boundary threshold of the DTW distance between the current observation value and each standard value in the window is set;

[0102] Get within the boundary threshold range The number of consecutive window lengths between the DTW distances of the current observation value of a time series and each standard value in the window;

[0103] According to the number of consecutive window lengths of the DTW distance of each standard value, the process of dynamic demonstration of intangible cultural heritage is dynamically adjusted;

[0104] According to the matching position of the DTW distance of each window length of the standard value, an intangible cultural heritage dynamic demonstration speed adjustment model is established to dynamically adjust the intangible cultural heritage dynamic demonstration speed;

[0105] The process of dynamically adjusting the dynamic presentation of intangible cultural heritage specifically includes:

[0106] The DTW distance of the standard value is divided into the first Frame, Current Frame, and Next Frame frame;

[0107] If the length of each window is continuous Intra-frame, it means that the imitation behavior of intangible cultural heritage has a temporal delay, and the speed of the dynamic presentation of intangible cultural heritage needs to be reduced;

[0108] If the lengths of each window are continuous on the current frame, it means that the imitation behavior of the intangible cultural heritage has temporal consistency and the dynamic demonstration of the intangible cultural heritage is carried out normally;

[0109] If the length of each window is continuous Within the frame, it means that the imitation behavior of intangible cultural heritage has temporal advance, and the speed of dynamic demonstration of intangible cultural heritage needs to be improved;

[0110] The intangible cultural heritage dynamic demonstration speed adjustment model expression is:

[0111] ;

[0112] Where, Adjust the speed value for dynamic demonstration of intangible cultural heritage. 、 are the coefficients of the linear term and the quadratic term, respectively, which can be obtained by the least squares method. is the average value of the DTW distance value of the window standard value, For the The DTW distance value of the window standard value is is the number of windows of the DTW distance value of the standard value, where The value is 1 or , Select a function for the symbol.

[0113] It can be explained that the number of continuity of each window length of the DTW distance of each standard value can effectively adjust the dynamic presentation of intangible cultural heritage according to the spatial audio and behavior trajectory feature data generated by the viewer. Frame, Current Frame, and Next Frame Frame, dynamically adjust the intangible cultural heritage dynamic demonstration speed according to the range of the window length continuity. Therefore, this scheme dynamically adjusts the intangible cultural heritage dynamic demonstration speed by establishing an intangible cultural heritage dynamic demonstration speed adjustment model. Among them, the intangible cultural heritage dynamic demonstration speed adjustment value is obtained through the intangible cultural heritage dynamic demonstration speed adjustment model. The sign of the symbol selection function is set by dynamically adjusting the comparison result of the intangible cultural heritage dynamic demonstration process. Among them,

[0114] ;

[0115] Among them, "consistency requirements" refer to the degree of conformity between the timing and feature matching of the imitation behavior of intangible cultural heritage and the standard behavior. On the one hand, the timing consistency requirement means that the imitation behavior and the standard behavior are synchronized in time. On the other hand, the feature matching consistency requirement means the consistency of the similarity between the characteristics of the imitation behavior and the characteristics of the standard behavior. Through the timing consistency and feature matching consistency, the state of the imitation behavior is comprehensively judged, so as to dynamically adjust the process of the dynamic demonstration of intangible cultural heritage. Among them, the imitation behavior state includes: delay, consistency and advance.

[0116] Reference Figure 4 As shown, the comprehensive evaluation of the audience's acceptance level of the intangible cultural heritage imitation behavior based on the results of the dynamic demonstration of intangible cultural heritage specifically includes:

[0117] Obtain the consistency assessment results of intangible cultural heritage imitation behaviors and the speed adjustment results of intangible cultural heritage dynamic demonstrations in the same sequence, and establish a list of imitation behaviors in different time sequences;

[0118] Based on the list of imitation behaviors at different time sequences and a weighted formula, an evaluation model for viewers' acceptance of imitation behaviors of intangible cultural heritage is established.

[0119] Through the evaluation model of viewers' acceptance level of imitation behavior of intangible cultural heritage, comprehensively evaluate the viewers' acceptance level of imitation behavior of intangible cultural heritage;

[0120] The evaluation model expression of the audience's acceptance level of imitation behavior of intangible cultural heritage is:

[0121] ;

[0122] Where, is the evaluation value of the audience's acceptance level of imitation behavior of intangible cultural heritage, 、 、 are the consistency evaluation results of intangible cultural heritage imitation behavior, the adjustment value of intangible cultural heritage dynamic demonstration speed, and the weight of intangible cultural heritage dynamic demonstration speed adjustment frequency, respectively. For the The consistency assessment value of the intangible cultural heritage imitation behavior, For the The weight of the speed adjustment of the dynamic demonstration of the intangible cultural heritage, For the The speed adjustment value of the dynamic demonstration of intangible cultural heritage. The average adjustment frequency of the dynamic demonstration speed of intangible cultural heritage, is the number of consistency assessment results of intangible cultural heritage imitation behaviors, The number of speed adjustments for dynamic demonstration of intangible cultural heritage.

[0123] It can be explained that the comprehensive evaluation of the audience's acceptance level of the imitation behavior of intangible cultural heritage is correlated with the consistency evaluation results of the imitation behavior of intangible cultural heritage, the adjustment value of the dynamic demonstration speed of intangible cultural heritage and the adjustment frequency of the dynamic demonstration speed of intangible cultural heritage. This scheme constructs an evaluation model of the audience's acceptance level of the imitation behavior of intangible cultural heritage through a weighted formula to comprehensively evaluate the audience's acceptance level of the imitation behavior of intangible cultural heritage, among which, For the The weight of the speed adjustment of the dynamic demonstration of the intangible cultural heritage, The above formula is to dynamically set the weight of the intangible cultural heritage dynamic demonstration speed adjustment according to the intangible cultural heritage dynamic demonstration speed adjustment value, where: 、 、 The weight of the dynamic demonstration speed of intangible cultural heritage is dynamically adjusted to ensure the fixed constant of different dynamic demonstration speeds of intangible cultural heritage, thereby improving the accuracy and reliability of the evaluation model of the audience's acceptance level of the imitation behavior of intangible cultural heritage.

[0124] Furthermore, based on the same inventive concept as the above-mentioned intangible cultural heritage digitization method, this solution proposes an intangible cultural heritage digitization system, including:

[0125] A standard library module, which is used to extract spatial audio and behavioral trajectory features from intangible cultural heritage based on standard data of intangible cultural heritage items and establish an intangible cultural heritage feature standard library;

[0126] A three-dimensional display module, which is used to construct a dynamic three-dimensional display model of intangible cultural heritage that integrates multimodal data based on the intangible cultural heritage feature standard library using Autodesk Maya three-dimensional modeling software;

[0127] A dynamic capture environment module, which is used to use a spatial audio acquisition device and a multi-view camera array to perform simultaneous data acquisition to achieve dynamic capture of the viewer's spatial audio information and behavior trajectory;

[0128] A comprehensive evaluation module is used to achieve a quantitative evaluation of the consistency of intangible cultural heritage imitation behavior based on the intangible cultural heritage feature standard library and the viewer's spatial audio and behavioral trajectory data through data comparison and analysis; dynamically adjust the progress of the intangible cultural heritage dynamic demonstration based on the quantitative evaluation results of the intangible cultural heritage imitation behavior; and comprehensively evaluate the viewer's acceptance level of the intangible cultural heritage imitation behavior based on the intangible cultural heritage dynamic demonstration results.

[0129] The comprehensive assessment module includes:

[0130] A consistency assessment unit, which is used to achieve a quantitative assessment of the consistency of intangible cultural heritage imitation behavior through data comparison and analysis based on the intangible cultural heritage feature standard library and the viewer's spatial audio and behavior trajectory data;

[0131] A dynamic demonstration unit, configured to dynamically adjust the progress of the dynamic demonstration of the intangible cultural heritage based on the quantitative evaluation results of the consistency of the intangible cultural heritage imitation behavior;

[0132] The acceptance evaluation unit is used to comprehensively evaluate the audience's acceptance level of the intangible cultural heritage imitation behavior based on the intangible cultural heritage dynamic demonstration results.

[0133] In summary, the advantages of the present invention are: using three-dimensional dynamic modeling and real-time interactive technology to construct a digital model of intangible cultural heritage, realizing a multi-sensory fusion dynamic imitation experience through human-computer interaction, and breaking through the interactive limitations of traditional static displays.

[0134] The above shows and describes the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The above embodiments and descriptions merely illustrate the principles of the present invention. Various changes and modifications may be made to the present invention without departing from the spirit and scope of the present invention. Such changes and modifications are intended to fall within the scope of the present invention. The scope of protection claimed by the present invention is defined by the appended claims and their equivalents.

Claims

1. A method for digitizing intangible cultural heritage, characterized in that: include: Based on the standard data of intangible cultural heritage projects, extract the spatial audio and behavioral trajectory features of intangible cultural heritage and establish a standard library of intangible cultural heritage features; Based on the intangible cultural heritage feature standard library, a dynamic 3D display model of intangible cultural heritage integrating multimodal data was constructed using Autodesk Maya 3D modeling software. Using spatial audio acquisition devices and multi-view camera arrays to collect simultaneous data, the dynamic capture of the viewer's spatial audio information and behavior trajectory is achieved; Based on the intangible cultural heritage feature standard library and the audience's spatial audio and behavioral trajectory data, through data comparison and analysis, a quantitative assessment of the consistency of intangible cultural heritage imitation behavior is achieved; Dynamically adjust the process of dynamic demonstration of intangible cultural heritage based on the quantitative evaluation results of the consistency of intangible cultural heritage imitation behavior; Based on the results of the dynamic demonstration of intangible cultural heritage, a comprehensive assessment is made of the audience's acceptance level of the imitation behavior of intangible cultural heritage.

2. The method for digitizing intangible cultural heritage according to claim 1, characterized in that: The extraction of spatial audio and behavioral trajectory features from intangible cultural heritage based on standard data of intangible cultural heritage items and the establishment of an intangible cultural heritage feature standard library specifically include: According to the categories of intangible cultural heritage items, professional audio and behavioral trajectory collection devices are used to obtain standard data of intangible cultural heritage items; Extract spatial audio and behavioral trajectory features of intangible cultural heritage based on standard data of intangible cultural heritage projects; Among them, spatial audio features include: time domain features, frequency domain features and MFCC features, and behavioral trajectory features include: the starting point, end point, amplitude, speed of the action, as well as the coordinates, direction, and curvature of the trajectory; Normalize the spatial audio and behavioral trajectory feature data of intangible cultural heritage to eliminate the influence of data dimension; Based on the filtering algorithm, the spatial audio and behavioral trajectory feature data of intangible cultural heritage are filtered and denoised; Establish a standard library of intangible cultural heritage characteristics to store intangible cultural heritage item categories, text descriptions, spatial audio characteristics, and behavioral trajectory feature data.

3. The method for digitizing intangible cultural heritage according to claim 2, characterized in that: The method of constructing a dynamic 3D display model of intangible cultural heritage integrating multimodal data based on the intangible cultural heritage feature standard library and using Autodesk Maya 3D modeling software specifically includes: According to the categories of intangible cultural heritage projects, scenes of different categories of intangible cultural heritage projects were built using Autodesk Maya 3D modeling software; Based on the intangible cultural heritage feature standard library, the spatial audio and behavioral trajectory feature data of intangible cultural heritage are converted into a format recognizable by Autodesk Maya. According to the standard library of intangible cultural heritage characteristics and based on Autodesk Maya 3D modeling software, a dynamic 3D display model of intangible cultural heritage integrating multimodal data is constructed.

4. The method for digitizing intangible cultural heritage according to claim 3, characterized in that: The method of using the spatial audio acquisition device and the multi-view camera array to perform simultaneous data acquisition to dynamically capture the spatial audio information and behavior trajectory of the viewer specifically includes: Using spatial audio acquisition devices and multi-view camera arrays, a multi-sensory fusion intangible cultural heritage simulation environment is constructed; Using simultaneous data acquisition technology, the spatial audio signal and behavioral motion trajectory data of viewers imitating intangible cultural heritage are synchronously captured under a unified time base; Under the same time base, for the dynamic 3D display model of intangible cultural heritage that integrates multimodal data, the spatial audio and behavioral motion trajectory data in the model are synchronously collected; The spatial audio signals and behavioral motion trajectory data during imitation are used as test data sets, and the spatial audio and behavioral motion trajectory data in the model are used as target data sets.

5. The method for digitizing intangible cultural heritage according to claim 4, characterized in that: The method of achieving a quantitative evaluation of the consistency of intangible cultural heritage imitation behavior based on the intangible cultural heritage feature standard library and the viewer's spatial audio and behavior trajectory data through data comparison and analysis specifically includes: Compare each sample in the test dataset with the sample before and after the same sequence point in the target dataset. The historical samples constitute the input pair, and the target data window length is controlled by adjusting the sliding window; Adopt FIFO queue to dynamically adjust the target data window length, maintain the time continuity of the data in the window, and always keep the most recent Standard time series data; According to the target data window length, based on the DTW algorithm, the DTW distance between the current observation value and each standard value in the window is calculated; The DTW distance between each current observation value and each standard value in the window is used as input, and the quantitative evaluation value of the consistency of the intangible cultural heritage imitation behavior is used as output; Based on the attention mechanism, the contribution of the DTW distance value between the spatial audio and behavioral trajectory features of each intangible cultural heritage is dynamically weighted; Based on the LSTM neural network algorithm, a quantitative evaluation model for the consistency of intangible cultural heritage imitation behavior is established to dynamically evaluate the consistency of intangible cultural heritage imitation behavior.

6. The method for digitizing intangible cultural heritage according to claim 5, characterized in that: The process of dynamically adjusting the dynamic presentation of intangible cultural heritage based on the quantitative evaluation results of the consistency of the intangible cultural heritage imitation behavior specifically includes: According to the quantitative evaluation model of the consistency of intangible cultural heritage imitation behavior, the quantitative evaluation results of the consistency of intangible cultural heritage imitation behavior and the DTW distance between the current observation value and each standard value in the window are obtained; According to the consistency requirements of intangible cultural heritage imitation behavior, the boundary threshold of the DTW distance between the current observation value and each standard value in the window is set; Get within the boundary threshold range The number of consecutive window lengths between the DTW distances of the current observation value of a time series and each standard value in the window; According to the number of consecutive window lengths of the DTW distance of each standard value, the process of dynamic demonstration of intangible cultural heritage is dynamically adjusted; According to the matching position of the DTW distance of each window length of the standard value, an intangible cultural heritage dynamic demonstration speed adjustment model is established to dynamically adjust the intangible cultural heritage dynamic demonstration speed; The process of dynamically adjusting the dynamic presentation of intangible cultural heritage specifically includes: The DTW distance of the standard value is divided into the first Frame, Current Frame, and Next Frame frame; If the length of each window is continuous Intra-frame, it means that the imitation behavior of intangible cultural heritage has a temporal delay, and the speed of the dynamic presentation of intangible cultural heritage needs to be reduced; If the lengths of each window are continuous on the current frame, it means that the imitation behavior of the intangible cultural heritage has temporal consistency and the dynamic demonstration of the intangible cultural heritage is carried out normally; If the length of each window is continuous Within the frame, it means that the imitation behavior of intangible cultural heritage has temporal advance, and the speed of dynamic demonstration of intangible cultural heritage needs to be improved; The intangible cultural heritage dynamic demonstration speed adjustment model expression is: ； Where, Adjust the speed value for dynamic demonstration of intangible cultural heritage. 、 are the coefficients of the linear term and the quadratic term, respectively, which can be obtained by the least squares method. is the average value of the DTW distance value of the window standard value, For the The DTW distance value of the window standard value is is the number of windows of the DTW distance value of the standard value, where The value is 1 or , Select a function for the symbol.

7. The method for digitizing intangible cultural heritage according to claim 6, characterized in that: The comprehensive evaluation of the audience's acceptance of the imitation behavior of intangible cultural heritage based on the results of the dynamic demonstration of intangible cultural heritage specifically includes: Obtain the consistency assessment results of intangible cultural heritage imitation behaviors and the speed adjustment results of intangible cultural heritage dynamic demonstrations in the same sequence, and establish a list of imitation behaviors in different time sequences; Based on the list of imitation behaviors at different time sequences and a weighted formula, an evaluation model for viewers' acceptance of imitation behaviors of intangible cultural heritage is established. Through the evaluation model of viewers' acceptance level of imitation behavior of intangible cultural heritage, comprehensively evaluate the viewers' acceptance level of imitation behavior of intangible cultural heritage; The evaluation model expression of the audience's acceptance level of imitation behavior of intangible cultural heritage is: ； Where, is the evaluation value of the audience's acceptance level of imitation behavior of intangible cultural heritage, 、 、 are the consistency evaluation results of intangible cultural heritage imitation behavior, the adjustment value of intangible cultural heritage dynamic demonstration speed, and the weight of intangible cultural heritage dynamic demonstration speed adjustment frequency, respectively. For the The consistency assessment value of the intangible cultural heritage imitation behavior, For the The weight of the speed adjustment of the dynamic demonstration of the intangible cultural heritage, For the The speed adjustment value of the dynamic demonstration of intangible cultural heritage. The average adjustment frequency of the dynamic demonstration speed of intangible cultural heritage, is the number of consistency assessment results of intangible cultural heritage imitation behaviors, The number of speed adjustments for dynamic demonstration of intangible cultural heritage.

8. An intangible cultural heritage digitization system, characterized by: A method for digitizing intangible cultural heritage according to any one of claims 1 to 7, comprising: A standard library module, which is used to extract spatial audio and behavioral trajectory features from intangible cultural heritage based on standard data of intangible cultural heritage items and establish an intangible cultural heritage feature standard library; A three-dimensional display module, which is used to construct a dynamic three-dimensional display model of intangible cultural heritage that integrates multimodal data based on the intangible cultural heritage feature standard library using Autodesk Maya three-dimensional modeling software; A dynamic capture environment module, which is used to use a spatial audio acquisition device and a multi-view camera array to perform simultaneous data acquisition to achieve dynamic capture of the viewer's spatial audio information and behavior trajectory; A comprehensive evaluation module is used to achieve a quantitative evaluation of the consistency of intangible cultural heritage imitation behavior based on the intangible cultural heritage feature standard library and the viewer's spatial audio and behavioral trajectory data through data comparison and analysis; dynamically adjust the progress of the intangible cultural heritage dynamic demonstration based on the quantitative evaluation results of the intangible cultural heritage imitation behavior; and comprehensively evaluate the viewer's acceptance level of the intangible cultural heritage imitation behavior based on the intangible cultural heritage dynamic demonstration results.

9. The intangible cultural heritage digitization system according to claim 8, characterized in that: The comprehensive assessment module includes: A consistency assessment unit, which is used to achieve a quantitative assessment of the consistency of intangible cultural heritage imitation behavior through data comparison and analysis based on the intangible cultural heritage feature standard library and the viewer's spatial audio and behavior trajectory data; A dynamic demonstration unit, configured to dynamically adjust the progress of the dynamic demonstration of the intangible cultural heritage based on the quantitative evaluation results of the consistency of the intangible cultural heritage imitation behavior; The acceptance evaluation unit is used to comprehensively evaluate the audience's acceptance level of the intangible cultural heritage imitation behavior based on the intangible cultural heritage dynamic demonstration results.

Images