Digital display system and method for non-perpetual cultural heritage
By combining optical and inertial motion capture, panoramic sound field acquisition, GIS+BIM technology and deep learning models, along with generative AI and blockchain evidence storage, a digital display system for intangible cultural heritage has been constructed. This solves the problem of insufficient dynamic capture in existing technologies and enables immersive experience and sustainable inheritance.
Patent Information
- Application Number
- CN202511451605.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-11
- Publication Date
- 2025-12-23
AI Technical Summary
Existing digital display systems for intangible cultural heritage are unable to fully capture and convey the performers' body language, rhythm, and emotional expression, resulting in a lack of realism, vividness, and cultural resonance in digital displays.
A hybrid optical and inertial motion capture system is used to record body language and rhythm, combined with panoramic sound field acquisition technology to recreate the acoustic environment, and a material decay model of handicrafts is established through hyperspectral imaging. A digital twin scene is constructed by combining GIS+BIM technology to form a holographic dataset. A deep learning model is used to identify key cultural elements, construct an intangible cultural heritage knowledge graph and a cultural gene bank, and combine generative AI technology to generate immersive interactive displays. An AI-driven personalized tour guide system and a blockchain evidence storage mechanism are deployed to form a living heritage closed loop.
It has achieved a comprehensive digital display of intangible cultural heritage, enhanced users' cultural resonance and emotional identification, and provided personalized intangible cultural heritage experiences and sustainable inheritance mechanisms.
Smart Images

Figure CN121187451A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of unmanned aerial vehicles, and in particular to a non-heritage cultural heritage digitization display system and method. BACKGROUND
[0002] Non-heritage cultural heritage (referred to as "non-heritage") is the wisdom of generations of people, which carries the historical memory, cultural genes and spiritual pursuit of the nation in a living form. From epic oral transmission to fingertip skills, non-heritage is not only a cultural bridge connecting the past and the future, but also an important link to maintain national identity.
[0003] Nowadays, we increasingly rely on non-heritage cultural heritage digitization display systems to gain a deeper understanding and learn about these valuable cultural heritage. However, as people's learning needs continue to grow, the current non-heritage cultural heritage digitization display system has the problem of insufficient capture of living state. For example, in a non-heritage museum, in order to display traditional opera, a holographic projection technology is used. However, this technology is relatively single, and can only reproduce the three-dimensional image of the opera performance, but it is difficult to fully capture and convey the living state characteristics of the opera, such as the body language, rhythm and emotional expression of the performers. This results in a lack of realism, vitality and cultural connotation in the digital display of the opera performance, making it difficult to evoke the cultural resonance and emotional identification of the audience, and thus a non-heritage cultural heritage digitization display system and method are proposed. SUMMARY
[0004] The purpose of the present application is to solve the problems existing in the prior art, and to propose a non-heritage cultural heritage digitization display system and method.
[0005] In order to achieve the above-mentioned purpose, the present application adopts the following technical solutions: A non-heritage cultural heritage digitization display system and method, comprising: A multi-modal living data acquisition layer: first, an optical and inertial hybrid motion capture system is used to record the body language and rhythm of non-heritage dynamic performances, panoramic sound field acquisition technology is used to restore the on-site acoustic environment, and a hyperspectral imaging system is used to establish a handicraft material decay model; at the same time, GIS+BIM technology is used to construct a digital twin scene of the birthplace of non-heritage, and an intelligent wearable device is provided for the inheritor to record physiological data, and finally a holographic data set of form, action and context is formed; finally, the holographic data set is output to the intelligent cultural analysis and reconstruction layer.
[0006] Intelligent cultural analysis and reconstruction layer: responsible for using natural language processing, computer vision and audio analysis technology to deeply analyze the holographic data set, extract cultural themes, visual features and melody rhythm and other core elements; then, through a deep learning model to identify key cultural elements such as traditional skill steps, folk literature motifs, and build a non-heritage knowledge graph, and combine with the extracted core elements to form a cultural gene library, and send the cultural gene library to the immersive interactive display layer; further, based on generative AI technology, dynamically reconstructing non-heritage culture according to user needs, generating virtual performances, interactive stories and other digital interpretations, and combining historical data and expert knowledge to simulate the cultural evolution process of non-heritage projects; finally, through natural language interaction and intelligent recommendation system, providing personalized non-heritage cultural experience and service for users.
[0007] Immersive interactive display layer: using the cultural gene library to generate immersive experience content, through the cooperation of mixed reality technology and AI narrative partner system, first using holographic projection and force feedback devices to build a three-dimensional display space for non-heritage projects, such as holographic theater presenting dynamic non-heritage performances, and digital twin workshops simulating traditional handicraft operations; At the same time, deploy an AI-driven personalized guide system to generate customized explanation paths based on user behavior data, and support users to reorganize cultural gene library elements through a co-creation platform to design personalized digital cultural and creative products; and collect user behavior data feedback to the sustainable ecological maintenance layer.
[0008] Sustainable ecological maintenance layer: through blockchain storage and smart contract to build a digital copyright management cornerstone, combined with the inheritance person empowerment platform to form a living inheritance closed loop; First, use blockchain technology to establish a unique digital fingerprint for non-heritage elements and store the entire creation track, and realize fine authorization and automatic distribution of IP through NFT smart contract; At the same time, build a digital workshop for inheritors, provide AI-assisted digital skill training and remote guidance tools, and build an active index for inheritors based on social media data to provide quantitative basis for policy support; And through influence assessment to promote the continuous injection of resources from government, academia and market.
[0009] The above technical solution further comprises: Further, the optical and inertial hybrid motion capture system records the body language and rhythm of non-heritage dynamic performances, and simultaneously uses panoramic sound field acquisition technology to restore the on-site acoustic environment, and establishes a handcraft material decay model through hyperspectral imaging, including the following steps: Record body language and rhythm: Before the performance, the optical and inertial hybrid motion capture system is calibrated. The optical motion capture system captures the optical markers attached to the performer's body through high-speed cameras, while the inertial motion capture system captures the motion data through the inertial measurement unit (IMU) worn on the performer's body. Through the spatial positioning algorithm, the optical markers and inertial sensor data are consistent in three-dimensional space: wherein is the data captured by the optical system, is the data captured by the inertial system, and ΔT is the calibration deviation between the two; After the performance starts, the optical and inertial hybrid motion capture system synchronously records the performer's body movement data. The optical system provides high-precision spatial position information, while the inertial system provides smooth motion posture information. The fusion of the two data records the body language and rhythm of the intangible cultural heritage dynamic performance.
[0010] Restoring the on-site acoustic environment: A microphone array is arranged at the intangible cultural heritage performance site to capture sound signals in all directions. The panoramic sound field acquisition technology is used to synchronously record the spatial audio information of the performance site, including the direction, distance, and moving track of the sound. Based on the collected sound field data, the acoustic environment of the intangible cultural heritage performance site is restored through the sound field reconstruction algorithm, so that the audience can experience the original sound atmosphere in the digital exhibition. The sound field reconstruction formula can be expressed as: wherein is the reconstructed sound field, is the sound field component collected by the i-th microphone, is the corresponding weight coefficient, and N is the number of microphones; Establishing a handicraft material decay model: A hyperspectral imager is used to scan the handicrafts to obtain their spectral reflectance data in the 400-2500 nm wavelength band. The spectral reflectance characteristics of different wavelengths are analyzed to identify the composition and structural characteristics of the handicraft materials. Based on the spectral data analysis results, a handicraft material decay model is established to predict the trend of material change over time: wherein D(t) is the degree of material decay at time t, is the initial decay degree, ( t ′) is the decay rate coefficient, ( t ′) is the spectral characteristic parameter at time t ′.
[0011] Further, the combination of GIS+BIM technology is used to build a digital twin scene of the intangible cultural heritage origin place. Smart wearable devices are provided for inheritors to record the physiological data of creation. Finally, a holographic data set of form, action, and context is formed, including the following steps: Building a digital twin scene of the intangible cultural heritage origin place: Collecting geographic information data (such as terrain, topography, water system, etc.) and building information data (such as building structure, material, texture, etc.) of the intangible cultural heritage origin place, and performing geometric precision adaptation, semantic information mapping, and topological relationship reconstruction. The BIM model and GIS data are fused. The seven-parameter conversion model (Bursa model) is used to convert the BIM local coordinate system to the GIS geographic coordinate system (such as CGCS2000): Wherein BIM The data in the BIM local coordinate system, GIS The data in the GIS geographic coordinate system, and ΔT is the conversion parameter, including translation, rotation, and scaling parameters; Integrating the relative elevation of the BIM model with the digital elevation model (DEM) of GIS to construct a continuous three-dimensional terrain surface. Based on the processed data, a three-dimensional model of the intangible cultural heritage origin place is constructed, including buildings, terrain, topography, and other elements, and a three-dimensional display of the digital twin scene is performed. A hybrid storage scheme and a data lightweight engine are used to support the optimization of the rendering efficiency of large-scale three-dimensional scenes, ensuring smooth display and interaction of the digital twin scene.
[0012] Recording physiological data of creation: Selecting appropriate smart wearable devices (such as smart bracelets, smart glasses, etc.) for inheritors and ensuring correct wearing of the devices to accurately capture physiological data during the creation process. The built-in sensors (such as photoelectric sensors, acceleration sensors, eye tracking sensors, etc.) in the devices capture physiological data of the inheritors during the creation process, such as heart rate, eye movement trajectory, and posture changes. The collected data is converted from analog to digital, processed by the processor, and analyzed. It is transmitted to the mobile application or other devices for storage and processing through wireless technology (such as Bluetooth, Wi-Fi, etc.), ensuring real-time and accuracy of the data. Then, the transmitted physiological data is analyzed to extract valuable information, such as the creation state and emotional changes of the inheritors, which are used to analyze the essence of the intangible cultural heritage and the creation process of the inheritors.
[0013] Forming a holographic data set: The morphological data in the digital twin scene (such as building structures, topography, etc.), the motion capture system recorded motion data (such as body language, rhythm, etc.), and the physiological data recorded by the smart wearable device (such as heart rate, eye movement trajectory, etc. Contextual data) are fused, and based on the fused data, a holographic data set of morphology, action, and context is constructed, which comprehensively records various aspects of intangible cultural heritage, including its morphological characteristics, action performance, and cultural context. Use the holographic data set for digital display, inheritance and research of intangible cultural heritage, and provide immersive intangible cultural experience through virtual reality (VR), augmented reality (AR) and other technologies, so that the audience can experience the charm of intangible culture.
[0014] Further, the key cultural elements are identified by the deep learning model, such as traditional skill steps, folk literature motifs, and a non-heritage knowledge graph is constructed, and combined with the extracted core elements, a cultural gene library is formed, including the following steps: Identify key cultural elements: Select appropriate deep learning models, such as convolutional neural networks (CNN), recurrent neural networks (RNN), or Transformers, etc., and train the model according to the characteristics of intangible cultural heritage; the training data includes multi-modal data such as images, audio, video and text of intangible projects; then use the trained deep learning model to extract features from multi-modal data of intangible cultural heritage; for example, extract visual features in images through CNN, extract semantic features in text through RNN or Transformer; finally, based on the extracted features, the deep learning model identifies key cultural elements in intangible cultural heritage, such as traditional skill steps, folk literature motifs, etc.
[0015] Construct a non-heritage knowledge graph: Identify entities from multi-modal data of intangible cultural heritage, such as characters, places, events, tools, etc., which are the basic units of the non-heritage knowledge graph; extract relationships between entities, such as the order of skill steps, the inheritance relationship between characters, etc., which form the edges of the non-heritage knowledge graph; integrate the identified entities and relationships into the non-heritage knowledge graph to form a structured knowledge representation; the knowledge graph can be stored and managed using a graph database for efficient querying and reasoning.
[0016] Form a cultural gene library: The core elements extracted by the deep learning model, such as cultural themes, visual features, and rhythmic cadences, are combined with the intangible cultural heritage knowledge graph. The core elements provide rich semantic information for the cultural gene library, while the intangible cultural heritage knowledge graph provides structured relationships for these elements. Based on the combination of core elements and the intangible cultural heritage knowledge graph, a cultural gene library is constructed. The cultural gene library is a database that contains various elements and relationships of intangible cultural heritage, supporting the digital display, inheritance, and research of intangible cultural heritage. Through the cultural gene library, users can gain a deep understanding of the connotation and essence of intangible cultural heritage, and also provide inspiration and materials for the innovation and development of intangible cultural heritage.
[0017] Further, the generation-based AI technology dynamically reconstructs intangible cultural heritage according to user needs, generates virtual performances, interactive stories, and other digital interpretations, and combines historical data and expert knowledge to simulate the cultural evolution process of intangible projects, including the following steps: Analyze user needs and generate: Through natural language interaction and intelligent recommendation systems, user interest points and needs for intangible cultural heritage are collected and analyzed through user behavior data, questionnaires, online interactions, etc. Based on user needs, generation-based AI technologies such as GANs, VAEs, and Transformers are used to generate corresponding digital interpretation content, such as virtual performances based on user interest in certain intangible dance, and interactive stories based on user interest in certain intangible story. During content generation, the core elements of intangible projects and information in the cultural gene library are integrated, and the generated digital interpretation content conforms to the characteristics and essence of intangible cultural heritage.
[0018] Integrate historical data and expert knowledge: Collect historical data of intangible projects from archives, libraries, museums, and other institutions, including inheritance pedigree, skill changes, performance records, etc., and integrate expert understanding and predictions of intangible cultural evolution from intangible heritage, cultural, and historical fields. Simulate cultural evolution: Combine historical data and expert knowledge to build a cultural evolution model of intangible projects. The evolution model is based on Agent-Based Modeling technology, simulating the transmission path and variation rules of intangible heritage in historical context. By setting different evolution parameters and conditions, the possible cultural evolution direction of intangible projects in the future is predicted. At the same time, the constructed evolution model simulates the cultural evolution process of intangible projects through computer simulation and visualization, enabling users to intuitively understand the evolution and development of intangible projects in the long river of history.
[0019] Further, the use of holographic projection and force feedback devices to build a three-dimensional display space for non-heritage projects, such as holographic theater to present dynamic non-heritage performances, digital twin workshop to simulate traditional handicraft operations, including the following steps: Building dynamic non-heritage performance display: Set up a holographic projection system, including projection equipment, optical elements (such as holographic film, mirror) and display medium (such as transparent holographic screen), so that the system produces high-quality three-dimensional images; through optical and inertial hybrid motion capture system, panoramic sound field acquisition technology and other means to obtain non-heritage performance data including performer's action data, sound data and visual multi-modal data; use holographic projection technology to convert non-heritage performance data into holographic images; through image processing algorithm and rendering technology, ensure the clarity, color restoration and dynamic effect of holographic images; display the generated holographic images in the holographic theater, and the audience can watch the non-heritage performance from different angles without wearing special equipment to obtain an immersive viewing experience.
[0020] Simulate traditional handicraft operations: Select appropriate force feedback devices, such as HaptX Gloves, which can simulate tactile feedback, including force, texture and temperature, etc., and integrate them into the digital twin workshop for seamless connection with the virtual environment; through sensors and motion capture systems to collect data of traditional handicraft operations, such as clay resistance of pottery throwing and operation force of loom, etc.; based on the collected data, build a force feedback model: , where is the force output by the force feedback device, k is the feedback gain coefficient, is the desired position or state in the virtual environment, is the actual position or state of the user's operation; the model should be able to simulate the force feedback effect of different materials and different operations; in the digital twin workshop, use force feedback devices to simulate traditional handicraft operations, users can feel the tactile feedback in the virtual environment through force feedback devices, such as clay resistance and loom vibration, so as to obtain a more realistic operation experience.
[0021] Further, the AI-driven personalized guide system is deployed to generate customized interpretation paths based on user behavior data, and the co-creation platform supports users to reorganize cultural gene bank elements and design personalized digital cultural and creative products, including the following steps: Deploy personalized guide system: Through sensors, cameras and user interaction devices deployed in non-heritage exhibition space, real-time collection of user behavior data such as residence time, movement trajectory and interaction frequency; use AI algorithm to analyze the collected user behavior data to identify user's interest preferences: wherein is the user interest preference, f is the AI analysis function, is the user behavior dataset; based on the user interest preference, combined with the knowledge graph of intangible cultural heritage projects and the cultural gene library, the AI-driven tour guide system dynamically generates a customized interpretation path, making the interpretation content highly matched with the user's interest; Establish a co-creation platform: Users access the intangible cultural heritage cultural gene library through the co-creation platform, which contains various elements of intangible cultural heritage projects, such as traditional skill steps, folk literature motifs, visual features, and rhythm and tempo. The co-creation platform provides design tools to support users in reorganizing elements in the cultural gene library. Users can select and combine different cultural elements according to their own creativity and interests to design personalized digital creative products. Based on the user's design choices, the co-creation platform uses generative AI technology to assist users in generating personalized digital creative products such as virtual clothing, dynamic wallpapers, and interactive stories.
[0022] Further, the unique digital fingerprint of the intangible cultural heritage elements is established using blockchain technology, and the creation track is stored throughout the process. Through NFT smart contracts, IP fine-grained authorization and automatic distribution of benefits are realized, including the following steps: Establish a unique digital fingerprint and store the creation track throughout the process: Using blockchain technology, a unique digital fingerprint is generated for intangible cultural heritage elements using a hash function. The characteristic information of intangible cultural heritage elements is hashed to obtain a fixed-length hash value, which serves as the unique identifier for the element: where H is the digital fingerprint (hash value), Hash is the hash function, is the characteristic information of the intangible cultural heritage element; during the creation, inheritance, and dissemination of intangible cultural heritage elements, the creation track is stored throughout the process using the tamper-proof nature of blockchain. Information such as creation time, creator, and modification records is recorded on the blockchain.
[0023] Fine-grained authorization and automatic distribution of benefits for IP: The digital fingerprint and related information of the intangible cultural heritage elements are cast into NFT (Non-Fungible Token), each NFT represents a unique intangible cultural heritage element or part of the rights and interests, the NFT smart contract is deployed, the authorization rules and income distribution mechanism of the IP are defined, the smart contract sets the authorization scope, the use period, the income distribution ratio and other parameters, the fine-grained authorization of the IP is carried out, when the intangible cultural heritage elements are used, the smart contract automatically executes the authorization rules, verifies the use permission, and automatically distributes the income when the conditions are met, for example, when the intangible cultural heritage elements are used for commercial cooperation, the smart contract can automatically distribute the income to the inheritors, creators or right holders according to the preset income distribution ratio.
[0024] Further, the digital workshop of inheritors is built, AI-assisted digital skill training and remote guidance tools are provided, and an active index of inheritors is constructed based on social media data to provide quantitative basis for policy support, including the following steps: Building a digital workshop of inheritors: Clarify the functional requirements of the digital workshop, including digital skill training, remote guidance, work display and exchange, etc., so that the workshop can fully support the digital inheritance activities of the inheritors; select appropriate technology platforms and tools, such as cloud computing platforms, online collaboration tools, multimedia processing software, etc.; design the user interface and user experience of the digital workshop to ensure that the interface is simple and easy to operate, so that the inheritors can easily get started and fully utilize the functions of the workshop.
[0025] Provide digital skill training and remote guidance tools: Develop or integrate AI-assisted digital skill training tools, such as intelligent teaching systems, virtual reality (VR) training simulators, etc., which can provide personalized training content and feedback according to the learning needs and progress of the inheritors, improving the training effect; at the same time, build a remote guidance platform with functions such as screen sharing, file transfer, online annotation, etc., supporting real-time audio and video communication and collaboration between inheritors and experts; use AI technology to analyze the operation data and work results of the inheritors, provide targeted improvement suggestions and optimization schemes, and through machine learning algorithms, continuously optimize the performance and accuracy of AI-assisted tools.
[0026] Construct an active index of inheritors: First, determine the social media platforms and data indicators that need to be monitored, such as the number of fans, interaction rate (likes, comments, shares), content publishing frequency, etc., use web crawlers or API interfaces to collect relevant data of the inheritors on social media; clean and organize the data, remove duplicate, invalid and abnormal data; based on the cleaned data, construct the active index of the inheritors: Where A is the active index, The weight of the i-th index (set according to the importance of the index), The value of the i-th index (such as the number of fans, interaction rate, etc.), n is the number of indexes, and the influence degree of different indexes on the activity is reflected by adjusting the weight; the activity index is updated regularly, and the social media performance of the inheritor is displayed by using a visual tool (such as a chart, a dashboard, etc.), so as to help the inheritor and the policy maker intuitively understand the activity and influence of the inheritor.
[0027] Provide a quantitative basis for policy support: Correlation analysis is performed on the activity index of the inheritor and other related data (such as the inheritance situation of the intangible cultural heritage project, the support effect of the policy, the social and economic indexes, etc.), the key factors and policy needs affecting the inheritance of intangible cultural heritage are identified; based on the activity index and the correlation analysis result, the support effect of the existing policy on the inheritance of intangible cultural heritage is evaluated, a quantitative basis is provided for policy making and adjustment; the analysis result and policy suggestion are reported to the policy maker regularly, so as to promote the effective inheritance and development of intangible cultural heritage; the report contains the change trend of the activity index, the key influence factor analysis, the policy effect evaluation and improvement suggestion, etc.
[0028] The present application has the following beneficial effects: In the present application, optical and inertial hybrid motion capture, panoramic sound field acquisition, hyperspectral imaging and GIS+BIM technology are adopted, combined with intelligent wearable devices, to comprehensively capture the form, action and context of the intangible cultural heritage project, form a holographic data set; and through natural language processing, computer vision, audio analysis technology and deep learning model, cultural elements are extracted and an intangible cultural heritage knowledge graph and cultural gene library are constructed; the immersive interactive display layer utilizes mixed reality and AI narrative partner system to create a three-dimensional display space and personalized guide, supports users to co-create digital cultural and creative products; finally, through blockchain and smart contract, digital copyright is protected, a digital workshop of the inheritor is built, and a living inheritance closed loop is formed, thereby comprehensively solving the problem of insufficient live capture of traditional intangible cultural heritage digital display system, greatly promoting cultural resonance and emotional identification of users, and effectively improving user experience. BRIEF DESCRIPTION OF DRAWINGS
[0029] FIG. 1 The system block diagram of the intangible cultural heritage digital display system and method proposed in the present application. DETAILED DESCRIPTION
[0030] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.
[0031] Referring to FIG. 1 The application is a non-heritage cultural heritage digital display system and method, comprising: The application is a non-heritage cultural heritage digital display system and method, comprising: A multi-modal live data acquisition layer: first, an optical and inertial hybrid motion capture system is used to record the body language and rhythm of non-heritage dynamic performances, a panoramic sound field acquisition technology is used to restore the on-site acoustic environment, and a hyperspectral imaging system is used to establish a handcraft material decay model; at the same time, GIS+BIM technology is used to construct a digital twin scene of the non-heritage origin, and an intelligent wearable device is provided for the inheritor to record the physiological data of creation, and finally a holographic data set of form, action and context is formed; finally, the holographic data set is output to the intelligent cultural analysis and reconstruction layer.
[0032] An intelligent cultural analysis and reconstruction layer: responsible for using natural language processing, computer vision and audio analysis technology to deeply analyze the holographic data set, extract cultural themes, visual features and melody rhythms, etc. core elements; then, through a deep learning model, key cultural elements such as traditional skill steps and folk literature motifs are identified, a non-heritage knowledge graph is constructed, and the cultural gene library is combined with the extracted core elements to form a cultural gene library, and the cultural gene library is sent to the immersive interactive display layer; further, based on generative AI technology, according to user needs, the non-heritage culture is dynamically reconstructed, virtual performances, interactive stories, etc. digital interpretation is generated, and combined with historical data and expert knowledge, the cultural evolution process of the non-heritage project is simulated; finally, through natural language interaction and intelligent recommendation system, personalized non-heritage cultural experience and service are provided for users.
[0033] An immersive interactive display layer: using the cultural gene library to generate immersive experience content, through the cooperation of mixed reality technology and AI narrative partner system, first, using holographic projection and force feedback devices to construct a three-dimensional display space of non-heritage projects, such as holographic theater presenting dynamic non-heritage performances, digital twin workshops simulating traditional handicraft operations; at the same time, deploying an AI-driven personalized guide system, generating customized explanation paths according to user behavior data, and supporting users to reorganize cultural gene library elements through a co-creation platform to design personalized digital cultural and creative products; and collecting user behavior data feedback to the sustainable ecological maintenance layer.
[0034] Sustainable ecological maintenance layer: through blockchain storage and smart contract to build a digital copyright management cornerstone, combined with the inheritance of the empowerment platform to form a living heritage closed loop; First, use blockchain technology to establish a unique digital fingerprint for non-heritage elements and store the entire track of creation. Through NFT smart contract, realize the fine authorization of IP and automatic distribution of benefits; At the same time, build a digital workshop for inheritors, provide AI-assisted digital skill training and remote guidance tools, and build an active index of inheritors based on social media data to provide quantitative basis for policy support; And through influence assessment to promote the continuous injection of government, academic and market resources.
[0035] In one embodiment, the use of optical and inertial hybrid motion capture system records the body language and rhythm of non-heritage dynamic performance, synchronously adopts panoramic sound field acquisition technology to restore the on-site acoustic environment, and establishes a handcraft material decay model through hyperspectral imaging, including the following steps: Record body language and rhythm: Before the start of non-heritage performance, calibrate the optical and inertial hybrid motion capture system; The optical motion capture system captures the optical marker points pasted on the performer through a high-speed camera, and the inertial motion capture system captures the action data through the inertial measurement unit (IMU) worn on the performer; Through the spatial positioning algorithm, the optical marker points and inertial sensor data are consistent in three-dimensional space: , wherein is the data captured by the optical system, is the data captured by the inertial system, and ΔT is the calibration deviation between the two; After the start of the performance, the optical and inertial hybrid motion capture system synchronously records the body movement data of the performer; The optical system provides high-precision spatial position information, and the inertial system provides smooth action posture information. The fusion of the two data completely records the body language and rhythm of non-heritage dynamic performance.
[0036] Restore the on-site acoustic environment: Arrange the microphone array at the non-heritage performance site to capture sound signals in all directions; Use panoramic sound field acquisition technology to synchronously record the spatial audio information of the performance site including the direction, distance and moving track of sound; Based on the collected sound field data, the acoustic environment of the non-heritage performance site is restored through sound field reconstruction algorithm, so that the audience can experience the original sound atmosphere in the digital exhibition, and the sound field reconstruction formula can be expressed as: , wherein is the reconstructed sound field, is the sound field component collected by the i-th microphone, is the corresponding weight coefficient, and N is the number of microphones; Establishing a handicraft material degradation model: A hyperspectral imager is used to scan the handicraft, and spectral reflectance data of the handicraft in the 400-2500nm waveband are obtained; the spectral reflectance characteristics of different wavebands are analyzed to identify the composition and structural characteristics of the handicraft material; and based on the analysis results of the spectral data, a handicraft material degradation model is established to predict the trend of material change over time: where D(t) is the degree of material degradation at time t, is the initial degradation degree, ( t ′) is the degradation rate coefficient, ( t ′) is the spectral characteristic parameter at time t ′.
[0037] In one embodiment, the combination of GIS+BIM technology is used to build a digital twin scene of the intangible cultural heritage origin place, and an intelligent wearable device is provided for the inheritor to record the creation physiological data, and finally a holographic data set of form, action and context is formed, including the following steps: Building a digital twin scene of the intangible cultural heritage origin place: Collecting geographic information data (such as terrain, topography, water system, etc.) and building information data (such as building structure, material, texture, etc.) of the intangible cultural heritage origin place, and performing geometric accuracy adaptation, semantic information mapping and topological relationship reconstruction, and fusing BIM model and GIS data; using a seven-parameter conversion model (Bursa model) to convert the BIM local coordinate system to the GIS geographic coordinate system (such as CGCS2000): wherein BIM is the data in the BIM local coordinate system, GIS is the data in the GIS geographic coordinate system, and ΔT is the conversion parameter, including translation, rotation and scaling parameters; Integrating the relative elevation of the BIM model and the digital elevation model (DEM) of GIS to build a continuous three-dimensional terrain surface; and based on the processed data, building a three-dimensional model of the intangible cultural heritage origin place, including buildings, terrain, topography and other elements, and performing three-dimensional display of the digital twin scene; using a hybrid storage scheme and a data lightweight engine to support, optimizing the rendering efficiency of large-scale three-dimensional scenes, and ensuring smooth display and interaction of the digital twin scene.
[0038] Recording creation physiological data: Select appropriate smart wearable devices (such as smart bracelets, smart glasses, etc.) for the inheritors and ensure that the devices are worn correctly to accurately capture physiological data during the creation process; the built-in sensors in the devices (such as photoelectric sensors, acceleration sensors, eye movement tracking sensors, etc.) capture physiological data such as heart rate, eye movement trajectory, and posture changes during the creation process; the collected data is converted from analog to digital, processed by the processor, and analyzed, then transmitted to the mobile application or other devices for storage and processing through wireless technology (such as Bluetooth, Wi-Fi, etc.), ensuring real-time and accuracy of the data; then analyze the transmitted physiological data and extract valuable information such as the creator's creation state and emotional changes to analyze the essence of the intangible cultural heritage and the creation process of the inheritors.
[0039] Forming a holographic data set: Fuse the morphological data in the digital twin scene (such as architectural structures, topography, etc.), the motion capture system recorded motion data (such as body language, rhythm, etc.), and the physiological data recorded by the smart wearable device (such as heart rate, eye movement trajectory, etc. Contextual data), and based on the fused data, construct a holographic data set of morphology, motion, and context, comprehensively record various aspects of intangible cultural heritage, including its morphological characteristics, motion performance, and cultural context. Use the holographic data set for digital display, inheritance, and research of intangible cultural heritage, and provide immersive intangible cultural experiences through virtual reality (VR), augmented reality (AR), etc. so that the audience can experience the charm of intangible culture.
[0040] In one embodiment, the key cultural elements are identified by a deep learning model, such as traditional skill steps, folk literature motifs, and a non-heritage knowledge graph is constructed, and the core elements extracted are combined to form a cultural gene library, including the following steps: Identify key cultural elements: Select appropriate deep learning models such as convolutional neural networks (CNN), recurrent neural networks (RNN), or Transformers, etc., and train the model according to the characteristics of intangible cultural heritage; training data includes multi-modal data such as images, audio, video, and text of intangible projects; then use the trained deep learning model to extract features from multi-modal data of intangible cultural heritage; for example, extract visual features from images using CNN, and extract semantic features from text using RNN or Transformer; finally, based on the extracted features, the deep learning model identifies key cultural elements in intangible cultural heritage, such as traditional skill steps, folk literature motifs, etc. Constructing a non-heritage knowledge graph: Identify entities such as people, places, events, tools, etc. from the multi-modal data of intangible cultural heritage, which are the basic units of the intangible cultural knowledge graph; extract the relationships between entities, such as the order of steps between skills, the inheritance relationship between people, etc., which constitute the edges of the intangible cultural knowledge graph; integrate the identified entities and relationships into the intangible cultural knowledge graph to form a structured knowledge representation; the knowledge graph can be stored and managed using a graph database, enabling efficient querying and reasoning.
[0041] Construct a cultural gene library: Combine the core elements extracted by the deep learning model (such as cultural themes, visual features, rhythm and tempo, etc.) with the intangible cultural knowledge graph, which provides rich semantic information for the cultural gene library, and the intangible cultural knowledge graph provides structured relationships for these elements; based on the combination of core elements and intangible cultural knowledge graph, construct a cultural gene library; the cultural gene library is a database containing various elements and relationships of intangible cultural heritage, supporting the digital display, inheritance and research of intangible culture; through the cultural gene library, users can deeply understand the connotation and essence of intangible culture, and also provide inspiration and materials for the innovation and development of intangible culture.
[0042] In one embodiment, the generation-based AI technology dynamically reconstructs intangible culture according to user needs, generates virtual performances, interactive stories, and other digital interpretations, and combines historical data and expert knowledge to simulate the cultural evolution process of intangible projects, including the following steps: Analyze user needs and generate: Through natural language interaction and intelligent recommendation system, collect and analyze user interest points and needs for intangible culture through user behavior data, questionnaire surveys, online interactions, etc.; based on user needs, use generation-based AI technology (such as GANs, VAEs, Transformers, etc.) to generate corresponding digital interpretation content, for example, generate virtual performances according to user interest in a certain intangible dance; generate interactive stories according to user interest in a certain intangible story; during content generation, integrate core elements of intangible projects and information in the cultural gene library, and the generated digital interpretation content conforms to the characteristics and essence of intangible culture.
[0043] Integrate historical data and expert knowledge: Collect historical data of intangible projects including inheritance pedigree, skill changes, performance records from archives, libraries, museums, etc., and integrate the understanding and prediction of intangible cultural evolution from experts in the fields of intangible culture, culture, history, etc.
[0044] Simulate cultural evolution: Combine historical data and expert knowledge to build a cultural evolution model of intangible cultural heritage projects; the evolution model is based on Agent-Based Modeling technology, simulates the transmission path and variation rule of intangible cultural heritage in historical context, predicts the possible cultural evolution direction of intangible cultural heritage projects in the future by setting different evolution parameters and conditions; at the same time, use the constructed evolution model to simulate the cultural evolution process of intangible cultural heritage projects through computer simulation and visual display, so that users can intuitively understand the evolution and development of intangible cultural heritage projects in the long river of history.
[0045] In one embodiment, the use of holographic projection and force feedback device to build a three-dimensional display space of intangible cultural heritage projects, such as holographic theater to present dynamic intangible cultural heritage performance, digital twin workshop to simulate traditional handicraft operation, including the following steps: Build a dynamic intangible cultural heritage performance display: Set up a holographic projection system, including projection equipment, optical elements (such as holographic film, mirror) and display medium (such as transparent holographic screen), so that the system produces high-quality three-dimensional stereoscopic images; through optical and inertial hybrid motion capture system, panoramic sound field acquisition technology and other means to obtain the motion data, sound data and visual multi-modal data of intangible cultural heritage performance; use holographic projection technology to convert intangible cultural heritage performance data into holographic images; through image processing algorithm and rendering technology, ensure the clarity, color restoration and dynamic effect of holographic images; display the generated holographic images in the holographic theater, and the audience can watch the intangible cultural heritage performance from different angles without wearing special equipment to obtain an immersive viewing experience.
[0046] Simulate traditional handicraft operation: Select appropriate force feedback devices, such as HaptX Gloves, which can simulate tactile feedback, including force, texture and temperature, etc., integrate force feedback devices into digital twin workshop to achieve seamless connection with virtual environment; through sensors and motion capture systems to collect data of traditional handicraft operation, such as clay resistance of pottery throwing and operation force of loom, etc.; based on the collected data, build a force feedback model: , where is the force output by the force feedback device, k is the feedback gain coefficient, is the desired position or state in the virtual environment, is the actual position or state of the user's operation; the model should be able to simulate the force feedback effect of different materials and different operations; in the digital twin workshop, use force feedback devices to simulate traditional handicraft operation, users can feel the tactile feedback in the virtual environment through force feedback devices, such as clay resistance and loom vibration, so as to obtain a more realistic operation experience.
[0047] In one embodiment, the AI-driven personalized tour system is deployed to generate customized interpretation paths based on user behavior data and support users in reorganizing cultural gene bank elements through a co-creation platform to design personalized digital cultural and creative products, including the following steps: Deploying a personalized tour system: Through sensors, cameras, and user interaction devices deployed in intangible cultural heritage exhibition spaces, user behavior data such as dwell time, movement trajectory, and interaction frequency are collected in real time; AI algorithms are used to analyze the collected user behavior data to identify user interest preferences: where is the user interest preference, f is the AI analysis function, is the user behavior data set; based on user interest preferences, combined with the knowledge graph and cultural gene bank of intangible cultural heritage projects, the AI-driven tour system dynamically generates customized interpretation paths to make interpretation content highly match user interests.
[0048] Establishing a co-creation platform: Users access the intangible cultural heritage cultural gene bank through the co-creation platform, which contains various elements of intangible cultural heritage projects, such as traditional skill steps, folk literature motifs, visual features, and rhythm and tempo. The co-creation platform provides design tools to support users in reorganizing elements in the cultural gene bank. Users can select and combine different cultural elements based on their creativity and interests to design personalized digital cultural and creative products. Based on user design choices, the co-creation platform uses generative AI technology to assist users in generating personalized digital cultural and creative products such as virtual clothing, dynamic wallpapers, and interactive stories.
[0049] In one embodiment, the blockchain technology is used to establish a unique digital fingerprint for intangible cultural heritage elements and record the entire creation track, and the NFT smart contract is used to realize fine-grained authorization and automatic distribution of IP benefits, including the following steps: Establishing a unique digital fingerprint and recording the entire creation track: Using blockchain technology, a unique digital fingerprint is generated for intangible cultural heritage elements using a hash function. The characteristic information of intangible cultural heritage elements is hashed to obtain a fixed-length hash value as the unique identifier of the element: where H is the digital fingerprint (hash value), Hash is the hash function, is the characteristic information of the intangible cultural heritage element; during the creation, inheritance, and dissemination of intangible cultural heritage elements, the non-tamperable nature of blockchain is used to record the entire creation track, and information such as creation time, creator, and modification record is recorded on the blockchain; Fine-grained authorization and automatic distribution of IP benefits: Cast the digital fingerprints and related information of non-heritage elements into NFTs (Non-Fungible Tokens), each NFT represents a unique non-heritage element or part of its rights, deploy NFT smart contracts, define IP authorization rules and revenue distribution mechanisms, smart contracts set authorization scope, usage period, revenue sharing ratio, etc. Fine-grained authorization of IP, when non-heritage elements are used, smart contracts automatically execute authorization rules, verify usage permissions, and automatically distribute revenue when conditions are met, for example, when non-heritage elements are used for commercial cooperation, smart contracts can automatically distribute revenue to related inheritors, creators or rights holders according to the pre-set revenue sharing ratio.
[0050] In one embodiment, the construction of the inheritor digital workshop provides AI-assisted digital skill training and remote guidance tools, and builds an inheritor activity index based on social media data to provide quantitative basis for policy support, including the following steps: Building an inheritor digital workshop: Clearly define the functional requirements of the digital workshop, including digital skill training, remote guidance, work display and exchange, etc., so that the workshop can fully support the digital inheritance activities of the inheritors; choose appropriate technology platforms and tools, such as cloud computing platforms, online collaboration tools, multimedia processing software, etc.; design the user interface and user experience of the digital workshop to ensure that the interface is simple and easy to understand, and the operation is convenient, so that the inheritors can easily get started and fully utilize the functions of the workshop.
[0051] Provide digital skill training and remote guidance tools: Develop or integrate AI-assisted digital skill training tools such as intelligent teaching systems and virtual reality (VR) training simulators, which can provide personalized training content and feedback according to the learning needs and progress of the inheritors, improving training effectiveness; at the same time, build a remote guidance platform with functions such as screen sharing, file transfer, online annotation, etc., supporting real-time audio and video communication and collaboration between inheritors and experts; use AI technology to analyze the operation data and work results of the inheritors, provide targeted improvement suggestions and optimization schemes, and through machine learning algorithms, continuously optimize the performance and accuracy of AI-assisted tools.
[0052] Build an inheritor activity index: First, determine the social media platforms and data indicators that need to be monitored, such as the number of fans, interaction rate (likes, comments, shares), content publishing frequency, etc., use web crawlers or API interfaces to collect relevant data of the inheritors on social media; clean and organize the data, remove duplicate, invalid and abnormal data; based on the cleaned data, build an inheritor activity index: Where A is the activity index, The weight of the i-th index (set according to the importance of the index), The value of the i-th index (such as the number of fans, interaction rate, etc.), n is the number of indexes, by adjusting the weight, reflecting the influence degree of different indexes on the activity; regularly update the activity index, and use visualization tools (such as charts, dashboards, etc.) to show the social media performance of the inheritor, help the inheritor and policy makers intuitively understand the activity and influence of the inheritor.
[0053] Provide quantitative basis for policy support: Correlation analysis is performed on the activity index of the inheritor and other related data (such as the inheritance situation of intangible cultural heritage projects, the effect of policy support, social and economic indicators, etc.), and the key factors and policy needs affecting the inheritance of intangible cultural heritage are identified; based on the activity index and the results of correlation analysis, the support effect of existing policies on the inheritance of intangible cultural heritage is evaluated, and quantitative basis is provided for policy making and adjustment; regularly report the analysis results and policy recommendations to policy makers to promote the effective inheritance and development of intangible cultural heritage; the report contains the trend of activity index, key influence factor analysis, policy effect evaluation and improvement suggestion, etc.
[0054] Although the embodiments of the present application have been shown and described, it can be understood by those skilled in the art that various changes, modifications, replacements and modifications can be made to these embodiments without departing from the principles and spirits of the present application, and the scope of the present application is defined by the appended claims and their equivalents.
Claims
1. A digital display system and method for intangible cultural heritage, characterized in that, include: Multimodal live data acquisition layer: First, a hybrid optical and inertial motion capture system is used to record the body language and rhythm of intangible cultural heritage performances. Simultaneously, panoramic sound field acquisition technology is used to recreate the acoustic environment of the site, and a material decay model of the handicrafts is established through hyperspectral imaging. At the same time, GIS+BIM technology is combined to construct a digital twin scene of the intangible cultural heritage site, and smart wearable devices are provided for the inheritors to record their creative physiological data, forming a holographic dataset integrating form, movement, and context. Finally, the holographic dataset is output to the intelligent cultural analysis and reconstruction layer. The Intelligent Culture Analysis and Reconstruction Layer is responsible for using natural language processing, computer vision, and audio analysis technologies to deeply analyze holographic datasets and extract core elements such as cultural themes, visual features, and melodic rhythms. Subsequently, it identifies key cultural elements, such as traditional craft steps and folk literature motifs, through deep learning models, and constructs an intangible cultural heritage knowledge graph. This graph is then combined with the extracted core elements to form a cultural gene bank, which is sent to the immersive interactive display layer. Based on generative AI technology, it dynamically reconstructs intangible cultural heritage according to user needs, generating digital interpretations such as virtual performances and interactive stories. It also combines historical data and expert knowledge to simulate the cultural evolution of intangible cultural heritage projects. Finally, through natural language interaction and an intelligent recommendation system, it provides users with personalized intangible cultural heritage experiences and services. Immersive Interactive Display Layer: Utilizing a cultural gene bank to generate immersive experience content, and through the collaboration of mixed reality technology and an AI narrative partner system, a three-dimensional display space for intangible cultural heritage projects is first constructed using holographic projection and force feedback devices. A holographic theater presents dynamic intangible cultural heritage performances, and a digital twin workshop simulates traditional handicraft operations. At the same time, an AI-driven personalized tour guide system is deployed to generate customized explanation paths based on user behavior data, and a co-creation platform supports users in recombining elements of the cultural gene bank to design personalized digital cultural and creative products. And collect user behavior data and feed it back to the sustainable ecosystem maintenance layer; Sustainable Ecosystem Maintenance Layer: This layer establishes a digital copyright management foundation through blockchain notarization and smart contracts, forming a living inheritance closed loop when combined with an inheritor empowerment platform. Firstly, blockchain technology is used to create unique digital fingerprints for intangible cultural heritage elements and record their creation process throughout. NFT smart contracts are used for refined IP licensing and automatic revenue distribution. Simultaneously, digital workshops for inheritors are established, providing AI-assisted digital skills training and remote guidance tools. An inheritor activity index is constructed based on social media data, providing quantitative evidence for policy support. Furthermore, influence assessments drive the continuous injection of resources from the government, academia, and the market.
2. The digital display system and method for intangible cultural heritage according to claim 1, characterized in that, The process involves using a hybrid optical and inertial motion capture system to record the body language and rhythm of intangible cultural heritage performances, simultaneously employing panoramic sound field acquisition technology to recreate the acoustic environment of the performance, and establishing a material decay model of the handicrafts through hyperspectral imaging. This includes the following steps: Recording body language and rhythm: Before the intangible cultural heritage performance begins, the hybrid optical and inertial motion capture system is calibrated. The optical motion capture system uses a high-speed camera to capture optical markers attached to the performer's body, while the inertial motion capture system uses an inertial measurement unit worn by the performer to capture motion data. Through spatial positioning algorithms, the optical markers and inertial sensor data are kept consistent in three-dimensional space. ,in Data captured by the optical system The data is captured by the inertial system, and ΔT is the calibration deviation between the two. Once the performance begins, the optical and inertial hybrid motion capture system simultaneously records the performer's limb movement data; the optical system provides high-precision spatial position information, while the inertial system provides smooth movement posture information. The data from both systems are fused together to fully record the body language and rhythm of the intangible cultural heritage dynamic performance. Recreate the acoustic environment of the scene: Microphone arrays are deployed at the intangible cultural heritage performance site to capture sound signals from all directions; panoramic sound field acquisition technology is used to simultaneously record spatial audio information of the performance site, including the location, distance, and movement trajectory of the sound; and based on the acquired sound field data, a sound field reconstruction algorithm is used to reconstruct the acoustic environment of the intangible cultural heritage performance site. The sound field reconstruction formula is as follows: ,in For the reconstructed sound field, Let be the sound field component captured by the i-th microphone. Here are the corresponding weighting coefficients, and N is the number of microphones; Establish a material decay model for handicrafts: A hyperspectral imager was used to scan handicrafts, acquiring their spectral reflectance data in the 400-2500 nm wavelength range. The spectral reflectance characteristics of different wavelengths were analyzed to identify the composition and structural features of the handicraft materials. Based on the spectral data analysis results, a material decay model was established to predict the material's changing trend over time. Where D(t) is the degree of material decay at time t. The initial decay level, ( t ′) is the decay rate coefficient, ( t ′) represents time t Spectral characteristic parameters at time ′.
3. The digital display system and method for intangible cultural heritage according to claim 1, characterized in that, The method of constructing a digital twin scene of the intangible cultural heritage site by combining GIS+BIM technology, equipping inheritors with smart wearable devices to record their creative physiological data, and forming a holographic dataset integrating form, movement, and context, includes the following steps: Constructing digital twin scenarios of intangible cultural heritage sites: Geographic and architectural information data of intangible cultural heritage sites are collected, and geometric accuracy adaptation, semantic information mapping, and topological relationship reconstruction are performed to fuse BIM models and GIS data. A seven-parameter transformation model is used to convert the BIM local coordinate system to the GIS geographic coordinate system. ,in BIM Data in the BIM local coordinate system. GIS For data in a GIS geographic coordinate system, ΔT is the transformation parameter, including translation, rotation, and scaling parameters; Integrating the relative elevation of the BIM model with the digital elevation model of GIS, a continuous three-dimensional terrain surface is constructed; and based on the processed data, a three-dimensional model of the intangible cultural heritage site is constructed, including elements such as buildings, terrain, and landforms, to provide a three-dimensional display of the digital twin scene; a hybrid storage scheme and a lightweight data engine are used to optimize the rendering efficiency of large-scale three-dimensional scenes. Recording physiological data during creation: The system selects suitable smart wearable devices for inheritors and ensures that the devices are worn correctly to accurately capture physiological data during the creative process. The devices have built-in sensors that capture the physiological data of the inheritors during the creative process. After the collected data is converted from analog to digital, processed and analyzed by the processor, it is transmitted wirelessly to mobile applications and other devices for storage and processing. Then, the transmitted physiological data is analyzed to extract information on the inheritors' creative state and emotional changes. Forming a holographic dataset: This method integrates morphological data from digital twin scenarios, motion data recorded by motion capture systems, and physiological data recorded by smart wearable devices. Based on the integrated data, a holographic dataset that combines morphology, motion, and context is constructed to comprehensively record all aspects of intangible cultural heritage, including its morphological characteristics, motion performance, and cultural context. The holographic dataset is used for the digital display, inheritance, and research of intangible cultural heritage, and provides an immersive intangible cultural heritage experience through virtual reality and augmented reality technologies.
4. The digital display system and method for intangible cultural heritage according to claim 1, characterized in that, The process of identifying key cultural elements, such as traditional craft steps and folk literature motifs, through deep learning models, constructing an intangible cultural heritage knowledge graph, and combining it with the extracted core elements to form a cultural gene pool, includes the following steps: Key cultural elements for character identification: Suitable deep learning models, such as convolutional neural networks, recurrent neural networks, and Transformers, are selected and trained according to the characteristics of intangible cultural heritage. The training data includes multimodal data of intangible cultural heritage projects, including images, audio, video, and text. Then, the trained deep learning model is used to extract features from the multimodal data of intangible cultural heritage. Finally, based on the extracted features, the deep learning model identifies the key cultural elements in intangible cultural heritage. Constructing a knowledge graph of intangible cultural heritage: Entities are identified from the multimodal data of intangible cultural heritage, and these entities are the basic units that constitute the intangible cultural heritage knowledge graph. Relationships between entities are extracted, and these relationships constitute the edges of the intangible cultural heritage knowledge graph. The identified entities and relationships are integrated into the intangible cultural heritage knowledge graph to form a structured knowledge representation. The knowledge graph is stored and managed using a graph database for efficient querying and reasoning. Constructing a cultural gene pool: By combining the core elements extracted from the deep learning model with the intangible cultural heritage (ICH) knowledge graph, the core elements provide rich semantic information for the cultural gene bank, while the ICH knowledge graph provides structured relationships among these elements. Based on the combination of core elements and the ICH knowledge graph, a cultural gene bank is constructed. The cultural gene bank is a database containing various elements and relationships of ICH, supporting the digital display, inheritance, and research of ICH. Through the cultural gene bank, users can gain a deeper understanding of the connotation and essence of ICH, while also providing inspiration and materials for the innovation and development of ICH.
5. The digital display system and method for intangible cultural heritage according to claim 1, characterized in that, The aforementioned generative AI technology dynamically reconstructs intangible cultural heritage based on user needs, generating digital interpretations such as virtual performances and interactive stories. It also combines historical data and expert knowledge to simulate the cultural evolution of intangible cultural heritage projects, including the following steps: Analyze user needs and generate: Using a natural language interaction and intelligent recommendation system, we collect and analyze users' interests and needs regarding intangible cultural heritage through user behavior data, questionnaires, and online interactions. Based on user needs, we use generative AI technology to generate corresponding digital interpretation content. We generate interactive stories based on users' interests in a particular intangible cultural heritage story. During the content generation process, we integrate the core elements of intangible cultural heritage projects and information from the cultural gene pool. The generated digital interpretation content conforms to the characteristics and essence of intangible cultural heritage. Integrating historical data with expert knowledge: We collect historical data on intangible cultural heritage projects from archives, libraries, and museums, including their lineage, changes in techniques, and performance records. We also integrate the understanding and predictions of the evolution of intangible cultural heritage from experts in the fields of intangible cultural heritage, culture, and history. Simulated cultural evolution: By combining historical data and expert knowledge, a cultural evolution model for intangible cultural heritage projects is constructed. Based on Agent-Based Modeling technology, the evolution model simulates the dissemination path and variation patterns of intangible cultural heritage in historical contexts. By setting different evolutionary parameters and conditions, it predicts the possible future cultural evolution direction of intangible cultural heritage projects. At the same time, the constructed evolutionary model is used to simulate the cultural evolution process of intangible cultural heritage projects through computer simulation and visualization.
6. The digital display system and method for intangible cultural heritage according to claim 1, characterized in that, The method of constructing a three-dimensional display space for intangible cultural heritage projects using holographic projection and force feedback equipment, such as a holographic theater presenting dynamic intangible cultural heritage performances and a digital twin workshop simulating traditional handicraft operations, includes the following steps: Constructing dynamic intangible cultural heritage performance displays: A holographic projection system is set up, including projection equipment, optical elements, and display media, to produce high-quality three-dimensional images; optical and inertial hybrid motion capture systems and panoramic sound field acquisition technology are used to acquire intangible cultural heritage performance data, including performers' motion data, sound data, and visual multimodal data; holographic projection technology is used to convert the intangible cultural heritage performance data into holographic images; image processing algorithms and rendering technology are used to ensure the clarity, color reproduction, and dynamic effects of the holographic images; and the generated holographic images are displayed in a holographic theater. Simulates traditional handicraft operations: Force feedback devices are selected to simulate tactile feedback including force, texture, and temperature. These devices are integrated into a digital twin workshop, and data from traditional handicraft operations are acquired through sensors and motion capture systems. Based on this data, a force feedback model is constructed. ,in Let k be the force output by the force feedback device, and k be the feedback gain coefficient. For the desired position or state in the virtual environment, The model simulates the force feedback effect under different materials and operations, representing the actual position or state of the user's operation. In the digital twin workshop, force feedback devices are used to simulate traditional handicraft operations, allowing users to feel tactile feedback in the virtual environment and obtain a realistic operating experience.
7. The digital display system and method for intangible cultural heritage according to claim 1, characterized in that, The deployment of the AI-driven personalized tour guide system generates customized explanation routes based on user behavior data, and supports users in reorganizing cultural gene pool elements through a co-creation platform to design personalized digital cultural and creative products, including the following steps: Deploy a personalized tour guide system: Sensors, cameras, and user interaction devices deployed within the intangible cultural heritage exhibition space are used to collect user behavior data in real time; AI algorithms are then used to analyze this data to identify user interests and preferences. ,in It represents user interests and preferences, and f is the AI analysis function. It is a user behavior dataset; based on user interests and preferences, combined with the knowledge graph and cultural gene database of intangible cultural heritage projects, the AI-driven tour guide system dynamically generates customized explanation paths; Establish a co-creation platform: Users access the Intangible Cultural Heritage Gene Bank through the co-creation platform. The Intangible Cultural Heritage Gene Bank contains various elements of Intangible Cultural Heritage projects. The co-creation platform provides design tools to support users in recombining elements in the gene bank. Users can select and combine different cultural elements according to their own creativity and interests to design personalized digital cultural and creative products. Based on the user's design choices, the co-creation platform uses generative AI technology to assist users in generating personalized digital cultural and creative products.
8. The digital display system and method for intangible cultural heritage according to claim 1, characterized in that, The method of using blockchain technology to establish a unique digital fingerprint for intangible cultural heritage elements and record the entire creation process, and using NFT smart contracts for refined IP licensing and automatic revenue distribution, includes the following steps: Establish a unique digital fingerprint and record the entire creation process: Using blockchain technology, a unique digital fingerprint is generated for each intangible cultural heritage element through a hash function. The characteristic information of the intangible cultural heritage element is hashed to obtain a fixed-length hash value, which serves as the unique identifier of the element. Where H is the digital fingerprint and Hash is the hash function. It is the characteristic information of intangible cultural heritage elements; in the process of creation, inheritance and dissemination of intangible cultural heritage elements, the immutable characteristics of blockchain are used to record the entire creation process, and the information of each link is recorded on the blockchain. Perform fine-grained IP licensing and automatically distribute revenue: The digital fingerprints and related information of intangible cultural heritage elements are cast into NFTs. Each NFT represents a unique intangible cultural heritage element or a portion of its rights. NFT smart contracts are deployed to define the licensing rules and revenue distribution mechanism of the IP. The smart contract sets parameters such as the scope of authorization, usage period, and revenue sharing ratio to carry out refined licensing of the IP. When the intangible cultural heritage element is used, the smart contract automatically executes the licensing rules, verifies the usage rights, and automatically distributes the revenue when the conditions are met.
9. The digital display system and method for intangible cultural heritage according to claim 1, characterized in that, The establishment of digital workshops for inheritors, providing AI-assisted digital skills training and remote guidance tools, and constructing an activity index for inheritors based on social media data to provide quantitative evidence for policy support, includes the following steps: Building a digital workshop for inheritors: Define the functional requirements of the digital workshop, including digital skills training, remote guidance, and work display and exchange; select appropriate technology platforms and tools; and design a simple, clear, and easy-to-use digital workshop. Provide digital skills training and remote guidance tools: Develop or integrate AI-assisted digital skills training tools that provide personalized training content and feedback based on the learning needs and progress of inheritors, thereby improving training effectiveness; simultaneously build a remote guidance platform with functions such as screen sharing, file transfer, and online annotation to support real-time audio and video communication and collaboration between inheritors and experts; utilize AI technology to analyze the operational data and work results of inheritors, providing targeted improvement suggestions and optimization solutions, and continuously optimize the performance and accuracy of AI-assisted tools through machine learning algorithms; Constructing an activity index for successors: First, identify the social media platforms and data metrics to be monitored, and collect relevant data on inheritors on social media using web crawlers and API interfaces. Clean and organize the data, removing duplicates, invalid data, and abnormal data. Based on the cleaned data, construct an inheritor activity index. Where A is the activity index, Let i be the weight of the i-th indicator. Let be the value of the i-th indicator, and n be the number of indicators. By adjusting the weights, we can reflect the degree of influence of different indicators on the activity level. We will regularly update the activity index and use visualization tools to show the social media performance of inheritors, so as to help inheritors and policymakers intuitively understand the activity and influence of inheritors. Provide quantitative basis for policy support: The activity index of inheritors will be correlated with other relevant data to identify key factors and policy needs affecting the inheritance of intangible cultural heritage. Based on the activity index and correlation analysis results, the support effect of existing policies on the inheritance of intangible cultural heritage will be evaluated, providing a quantitative basis for policy formulation and adjustment. The analysis results and policy recommendations will be reported to policymakers regularly to promote the effective inheritance and development of intangible cultural heritage. The report includes the changing trend of the activity index, analysis of key influencing factors, policy effectiveness evaluation, and improvement suggestions.
Citation Information
Patent Citations
Auxiliary age-deduction method for ancient calligraphies and paintings
CN108519336A
Construction method of multivariate data fusion holographic space system
CN115391882A
Digital display system and method for non-perpetual cultural heritage
CN116992067A
Intelligent training communication system inherited by wood carving skill of Tongshan mountain and construction method of intelligent training communication system
CN118261756A
Tourism content recommendation system for analyzing favorites of tourism scenic spots
CN119474552A
Cited By
Generation method and system of Qiang product, computer equipment and storage medium
CN121811065A