A visual communication system of the 56 national cultural roots

Abstract

The application discloses a visual communication system for the places of the cultural roots of 56 nationalities, and aims to solve the problems of single communication dimension and missing data correlation in the prior art. The system comprises five modules of data acquisition, preprocessing and correlation modeling, space-time mapping visualization, immersive interactive communication and system operation and maintenance, and the modules are sequentially correlated. Cultural root related data is acquired through multi-modal data acquisition, a space-time correlation model is constructed through preprocessing and correlation modeling, and all-round visualization is realized through space-time folding mapping and multi-modal fusion rendering, and cultural promotion is completed in combination with VR / AR interaction and social communication, and the system operation and maintenance module guarantees stable operation. The application realizes deep communication of the material, non-material and space-time of the cultural roots of nationalities, has prominent innovation points and high practicability, and can be applied to cultural protection, education and other scenes.

Description

Technical Field

[0001] This invention relates to the fields of cultural dissemination and digital visualization technology, and in particular to a visualization dissemination system for the cultural roots of the 56 ethnic groups. Background Technology

[0002] Each of my country's 56 ethnic groups possesses a unique cultural foundation, and the locations of these cultural foundations (including their birthplaces, core transmission areas, and representative cultural sites) are the core carriers of their culture. Currently, the dissemination and display of these cultural foundation locations mainly rely on offline venues, on-site visits, and traditional media reports, which suffer from the following technical deficiencies and shortcomings: The dissemination is limited to a single dimension: existing technologies mostly present cultural foundations in a single-modal form, such as text, images, and videos, failing to achieve a multi-dimensional integrated display of the cultural foundation's "material carriers + non-material connotations + spatiotemporal evolution," and thus failing to intuitively reflect the deep connection between cultural foundations and regional environment and historical context. Data linkage is missing: There is a lack of systematic integration and correlation modeling of the cultural foundation data of various ethnic groups (including site coordinates, intangible cultural heritage skills, folk festivals, languages ​​and scripts, historical documents, etc.). The cultural data of different ethnic groups and different types are fragmented, making it difficult to present the fusion and symbiotic relationship of ethnic cultures. Insufficient interactive experience: Existing visualization technologies are mostly passive browsing modes, lacking personalized interaction and immersive experience based on user needs, and cannot allow users to deeply participate in the exploration and dissemination of cultural roots; Insufficient innovation: Existing technologies mostly use general digital display frameworks and do not design special visualization and dissemination technology solutions for the special characteristics of ethnic cultural roots. In particular, there is a lack of technology for the accurate collection and distinctive presentation of data on the cultural roots of minority ethnic groups.

[0003] In existing technologies, some cultural heritage digitization projects (such as Digital Dunhuang and Panoramic Palace Museum) only digitally display single cultural heritage sites or specific regional cultures, failing to cover the locations of the cultural roots of all 56 ethnic groups in China, and failing to address the issues of correlation mapping and in-depth visualization and dissemination of multi-ethnic cultural data. Some ethnic cultural map products only achieve geographical labeling of cultural sites, lacking dynamic presentation and interactive dissemination functions of cultural connotations and historical evolution. Therefore, there is an urgent need for a technical solution that can achieve multi-dimensional, correlated, and immersive visualization and dissemination of the cultural roots of all 56 ethnic groups, filling the gaps in existing technologies. Summary of the Invention

[0004] The purpose of this invention is to overcome the shortcomings of existing technologies in the dissemination of the cultural roots of ethnic groups, such as a single dimension of dissemination, lack of data correlation, insufficient interactive experience, and lack of innovation. This invention provides a visual dissemination system for the cultural roots of the 56 ethnic groups. Through multimodal cultural data collection, spatiotemporal correlation mapping modeling, personalized immersive visualization, and interactive dissemination, this system achieves comprehensive and in-depth visual dissemination of the "material + non-material + spatiotemporal" aspects of the cultural roots of the 56 ethnic groups, providing technical support for the protection and promotion of ethnic cultural heritage.

[0005] The technical solution of this invention is implemented as follows: A visual communication system for the cultural roots of 56 ethnic groups in China, comprising five interconnected core modules: The system includes a data acquisition module for collecting multimodal raw data, a data preprocessing and association modeling module for data processing and association modeling, a spatiotemporal mapping visualization module for multidimensional dynamic visualization, an immersive interactive communication module for deep interaction and cultural dissemination, and a system operation and maintenance module for stable system operation and maintenance. Each module corresponds to the others, forming a complete visual communication technology chain.

[0006] Preferably, the data acquisition module adopts a three-dimensional acquisition method combining fixed-point acquisition, mobile acquisition, and literature mining, specifically including: The fixed-point acquisition unit is used to deploy multi-dimensional acquisition terminals to collect the geographical coordinates, three-dimensional spatial structure, surface texture, and audio data of intangible cultural heritage techniques of cultural sites. A mobile data acquisition unit is used to carry AR glasses and a panoramic camera to collect dynamic data in remote areas and upload it in real time. The document mining unit is used to mine textual data and establish association tags based on natural language processing technology; The fixed-point acquisition unit also includes a motion capture sensor with a sampling frequency of not less than 100Hz, used to collect motion trajectory data of intangible cultural heritage skills.

[0007] Preferably, the processing flow of the data preprocessing and association modeling module includes: The data preprocessing steps include using the RANSAC algorithm to denoise the 3D laser scanning data, the wavelet threshold denoising algorithm to denoise the audio data, the TF-IDF algorithm to extract text keywords, and standardizing all data into JSON format. The steps for extracting cultural foundation elements involve extracting core geographical, material, intangible, and historical elements based on preprocessed data, and using a dedicated element extraction model to extract intangible cultural elements. The spatiotemporal correlation modeling steps involve constructing a five-dimensional correlation model encompassing geography, history, and culture, and then building a correlation graph using graph neural networks.

[0008] Preferably, the extraction formula for intangible cultural heritage skills in the intangible cultural heritage element extraction model is as follows: ; in, Let i be the vector of the core elements of the i-th intangible cultural heritage skill. This represents the feature vector of the skill's movement trajectory. For material feature vectors, As a feature vector of historical inheritance, , , The weighting coefficients are and satisfy the following conditions: The weighting coefficients are determined using the analytic hierarchy process (AHP).

[0009] Preferably, in the spatiotemporal correlation modeling step, the node correlation strength of the correlation graph is calculated using the following formula: ; in, Let the association strength be the relationship between the i-th and j-th nodes. For geographic coordinate similarity, For historical time similarity, For cultural similarity.

[0010] Preferably, the spatiotemporal mapping visualization module includes a four-layer visualization structure: The basic visualization layer uses the WGS-84 coordinate system to construct a geographic base map and marks the location of cultural roots with ethnic totem patterns. The spatiotemporal folding visualization layer uses spatiotemporal folding mapping technology to map the cultural evolution process of different historical periods onto the same interface, supporting linked display of the timeline. The multimodal fusion rendering layer uses voxel rendering, skeletal animation rendering and other technologies to achieve synchronous visualization of multiple data types; The associated visualization layer uses a force-oriented layout algorithm to present the relationships between cultural elements.

[0011] Preferably, the immersive interactive communication module includes: The immersive interactive unit adopts VR+AR integrated interactive technology, supports gesture recognition and multi-ethnic language voice interaction, and realizes virtual scene interaction and reality-virtual integrated interaction; The personalized recommendation unit builds an interest model based on user interaction behavior data and pushes personalized content through a collaborative filtering recommendation algorithm. Socialized communication units are used to build a social sharing matrix and set up an incentive mechanism based on points.

[0012] Preferably, the system operation and maintenance module includes: The data update unit establishes a dynamic data update mechanism once a quarter, and updates the associated models synchronously. The security protection unit uses blockchain to encrypt and store data, sets up a four-level user permission classification mechanism, and is equipped with DDoS attack protection technology. The fault monitoring and repair unit monitors the module's operating status in real time through a distributed monitoring system, and supports automatic fault alarms and backup module switching.

[0013] Preferably, the multi-dimensional acquisition terminal of the fixed-point acquisition unit includes: High-precision GPS positioning equipment with an accuracy of ±0.1m, 3D laser scanner with a scanning distance of 0.1-100m, and multispectral imaging equipment with a spectral range of 400-1000nm; The mobile acquisition unit is equipped with a panoramic camera with a resolution of no less than 8K and a frame rate of no less than 30fps, and the data is uploaded in real time through a 5G edge computing terminal with a transmission rate of ≥1Gbps.

[0014] Preferably, in the multimodal fusion rendering layer, the three-dimensional laser scanning data adopts voxel rendering technology with a voxel resolution of 0.01m, the intangible cultural heritage skill movement data adopts skeletal animation rendering technology, the ethnic language audio data adopts sound wave visualization rendering technology, and the text data adopts tag cloud rendering technology. All types of data are displayed synchronously through a multi-channel synchronous rendering algorithm.

[0015] The embodiments of the present invention have the following advantages due to the adoption of the above technical solutions: I. Innovation: Breaking through the limitations of existing single-modal and single-dimensional propagation technologies, it pioneered a technical solution of "five-dimensional spatiotemporal correlation model + spatiotemporal folding mapping + multimodal fusion rendering", which realizes the deep integration and visualization of the "geography-history-culture" foundation of the 56 ethnic groups. In particular, it designed a special collection and extraction technology for the cultural foundation data of minority ethnic groups, filling the existing technological gap. II. Novelty: It adopts the niche but reasonable visualization technology of spatiotemporal folding mapping to compress the cultural evolution of different historical periods into the same visualization space. At the same time, it combines VR / AR fusion interaction and social communication technology to realize the transformation of the communication mode from "passive browsing" to "active participation", which is significantly different from the communication mode of existing technologies. III. Practicality: It can achieve comprehensive and in-depth visual dissemination of the cultural roots of the 56 ethnic groups, providing users with an immersive and personalized cultural exploration experience. At the same time, it encourages users to actively spread ethnic culture through social dissemination mechanisms, effectively promoting the protection and promotion of ethnic cultural heritage. It is suitable for various scenarios such as cultural venues, educational institutions, and tourist attractions. IV. Stability and Security: Through technologies such as dynamic data updates, blockchain encrypted storage, and fault monitoring and repair in the system operation and maintenance module, the system is ensured to operate stably, securely, and continuously, and the timeliness and integrity of data are effectively guaranteed. V. Scalability: The system adopts a modular design, with each module being independent and scalable. Cultural data types can be added, visualization algorithms optimized, and interactive functions expanded as needed, demonstrating good scalability and adaptability.

[0016] The above overview is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features of the invention will become readily apparent from the accompanying drawings and the following detailed description. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a diagram of the overall system architecture of the present invention; Figure 2 This is a diagram showing the composition of the data acquisition module of the present invention; Figure 3 This is a hierarchical diagram of the spatiotemporal mapping visualization module of the present invention; Figure 4 This is a system workflow diagram of the present invention. Detailed Implementation

[0019] In the following description, only certain exemplary embodiments are briefly described. As those skilled in the art will recognize, the described embodiments can be modified in various ways without departing from the spirit or scope of the invention. Therefore, the drawings and description are considered to be exemplary in nature and not restrictive.

[0020] It is important to note that terms such as "first," "second," "symmetric," and "array" are used only to distinguish between descriptive and positional descriptions and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, features specified with terms such as "first" or "symmetric" may explicitly or implicitly include one or more of that feature; similarly, when the quantity of certain features is not limited by words such as "two" or "three," it should be noted that such features also explicitly or implicitly include one or more features. In this invention, unless otherwise explicitly specified and limited, terms such as "installation," "connection," and "fixation" should be interpreted broadly; for example, they can refer to a fixed connection, a detachable connection, or an integral molding; they can refer to a mechanical connection, a direct connection, a welding connection, or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the accompanying drawings and specific circumstances.

[0021] The embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0022] like Figure 1-4 As shown, this invention provides a visual dissemination system for the cultural roots of 56 ethnic groups in China. Its core technical solution includes a data acquisition module, a data preprocessing and correlation modeling module, a spatiotemporal mapping visualization module, an immersive interactive dissemination module, and a system operation and maintenance module. These modules are sequentially interconnected and causally related, forming a complete technical chain. The specific technical solution is as follows: 1. Data Acquisition Module This module is used to collect multimodal raw data on the locations of the cultural roots of the 56 ethnic groups, providing a data foundation for subsequent data processing and visualization. Addressing the diversity and unique characteristics of ethnic cultural root data, a three-dimensional data collection approach combining fixed-point collection, mobile collection, and literature mining is adopted, specifically including: Fixed-point data collection unit: Multi-dimensional data collection terminals are deployed in the core areas of the cultural foundation of each ethnic group (such as the birthplace of the ethnic group and representative intangible cultural heritage sites). These terminals include high-precision GPS positioning equipment, 3D laser scanners, multispectral imaging equipment, and audio acquisition equipment. They collect geographical coordinate data (accuracy ±0.1m), 3D spatial structure data, surface texture data of cultural relics and buildings, and audio data of intangible cultural heritage skills (such as ethnic musical instrument performances and folk singing). Mobile data collection unit: Using mobile data collection equipment equipped with AR glasses and panoramic cameras, the data collection personnel go deep into remote areas where the ethnic culture is rooted to collect dynamic data such as videos of folk festival activities, demonstrations of folk artists' skills, and recordings of ethnic language speech, and the data is uploaded in real time through a 5G edge computing module; Document Mining Unit: Based on Natural Language Processing (NLP) technology, this unit mines textual materials such as ethnic history records, ancient books and documents, and local archives to extract textual data related to cultural roots, including historical time nodes, personal stories, and folk customs. It also establishes association markers between textual data and geographic coordinates and dynamic images.

[0023] The innovation of this module lies in its design of a dedicated data acquisition technology that combines "motion capture of intangible cultural heritage skills with extraction of language pronunciation features" to address the scarcity of data on the cultural foundations of minority groups. This technology uses motion capture sensors (sampling frequency 100Hz) to collect motion trajectory data of folk arts and crafts, and extracts the pronunciation spectrum features of ethnic languages ​​through speech feature extraction algorithms, providing unique data support for subsequent visualization.

[0024] 2. Data Preprocessing and Association Modeling Module This module is used to preprocess the collected multimodal raw data and construct a spatiotemporal correlation model of the cultural foundation data of the 56 ethnic groups, which is the core key to realizing multi-dimensional visualization and dissemination. The processing flow and technical solution of this module are as follows, with each step corresponding to the previous one: Data preprocessing steps: First, the raw data is cleaned, denoised, and standardized. For noise points in the 3D laser scanning data, a point cloud denoising method based on the RANSAC algorithm is used to remove isolated noise points (denoising accuracy ≥98%). For environmental noise in the audio data, a wavelet threshold denoising algorithm (wavelet basis function selected as db4, decomposition level 5) is used for denoising. For text data, the Jieba word segmentation algorithm is used for word segmentation, and keywords are extracted using the TF-IDF algorithm (keyword extraction accuracy ≥95%). After standardization, all data is uniformly converted to JSON format for easy subsequent data interaction and modeling.

[0025] The steps for extracting cultural foundation elements are as follows: Based on the preprocessed data, the core elements of each ethnic group's cultural foundation are extracted, including geographical elements (site coordinates, regional scope), material cultural elements (architecture, artifacts, clothing), intangible cultural elements (crafts, customs, language, festivals), and historical elements (historical periods, evolutionary milestones). Specifically, a dedicated element extraction model was designed for intangible cultural elements. Taking intangible cultural heritage crafts as an example, the extraction formula is as follows: in, For the first The core element vector of intangible cultural heritage skills; The feature vector of the skill movement trajectory; Material feature vectors used in the technique; This represents the characteristic vector of the historical inheritance of skills; , , Weighting coefficients ( The weight values ​​are determined by the Analytic Hierarchy Process (AHP) to ensure the accuracy of element extraction.

[0026] The spatiotemporal correlation modeling steps are as follows: A three-dimensional correlation model of "geography-history-culture" is constructed to achieve deep correlation of cultural foundation data from different ethnic groups and types. This model uses geographic coordinates as the basic dimension (X-axis: longitude, Y-axis: latitude, Z-axis: altitude), historical time as the time dimension (T-axis: Gregorian calendar), and cultural elements as the attribute dimension (A-axis: cultural type, including material and intangible culture), mapping the cultural foundation data of each ethnic group into a five-dimensional space of "three-dimensional geography + one-dimensional time + one-dimensional attribute." A correlation graph is constructed using a graph neural network (GNN), where nodes represent cultural foundation elements (such as the birthplace of an ethnic group, a certain intangible cultural heritage technique), and edges represent the correlation relationships between elements (such as the inheritance relationship of "birthplace-intangible cultural heritage technique," the integration relationship of "different ethnic groups-similar techniques"). The correlation strength is calculated as follows: in, The association strength between the i-th node and the j-th node ( ); Geographic coordinate similarity; For historical time similarity; This formula represents the similarity of cultural attributes. It can accurately quantify the degree of correlation between different cultural elements, providing a basis for subsequent visualization.

[0027] 3. Spatiotemporal mapping visualization module This module, based on the five-dimensional relational data output by the data preprocessing and correlation modeling module, achieves a multi-dimensional and dynamic visualization of the cultural roots of the 56 ethnic groups, serving as a core display carrier for cultural dissemination. This module breaks through the limitations of existing single-modal visualization technologies, employing a "niche but reasonable" spatiotemporal folding mapping and multimodal fusion rendering technique. The specific solution is as follows: Basic visualization layer: Construct a global geographic information base map (using the WGS-84 coordinate system), and mark the geographic coordinates and core area of ​​the cultural roots of each ethnic group through a vector layer. The marking style adopts the representative totem elements of each ethnic group (such as the wolf totem of the Mongolian ethnic group and the fire totem of the Yi ethnic group) to realize the geographic visualization and positioning of the cultural roots. Space-Time Folding Visualization Layer: Using space-time folding mapping technology, the evolution process of the ethnic cultural roots in different historical periods (such as ethnic migration routes, the rise and fall of cultural sites, and the inheritance context of skills) is mapped onto the same visualization interface. Through the time-axis control, users can drag the time slider to view the distribution and status of the ethnic cultural roots in a certain historical period (such as the Tang Dynasty, the Qing Dynasty, and modern times), realizing the space-time linkage display of "past - present". The innovation of this technology lies in: breaking through the traditional linear time display mode, adopting the folding mapping algorithm to compress the cultural evolution in a long historical period into the same visualization space, facilitating users to intuitively perceive the space-time evolution law of cultural roots; Multi-Modal Fusion Rendering Layer: For different types of cultural root data, corresponding visualization rendering technologies are adopted to achieve multi-modal fusion display. Specifically, it includes: for 3D laser scanning data, voxel rendering technology (voxel resolution 0.01m) is used to present the three-dimensional structure of cultural sites; for intangible cultural heritage skill action data, skeletal animation rendering technology is used to restore the action process of folk skills; for ethnic language audio data, sound wave visualization rendering technology is used to convert the audio spectrum into dynamic visual graphics; for text data, tag cloud rendering technology is used to intuitively present the key words of cultural connotations. At the same time, through the multi-channel synchronous rendering algorithm, the synchronous display of "three-dimensional structure + dynamic action + sound wave graphics + tag cloud" is achieved, forming a multi-sensory fusion visualization effect; Associated Visualization Layer: Based on the association graph of the association modeling module, the force-directed layout algorithm is used to visually present the elements of ethnic cultural roots of different ethnic groups and different types in the form of nodes - edges. When the user clicks on a certain node (such as "Tibetan Thangka Skill"), the system automatically highlights the associated nodes (such as the place of origin of Thangka, inheriting artists, and related folk festivals), and shows the association relationship through dynamic connection lines, intuitively presenting the symbiotic relationship of ethnic cultures.

[0028] 4. Immersive Interactive Communication Module This module is used to achieve in-depth interaction between users and visualization content, and build a multi-channel cultural communication mechanism to transform the visualization display into an effective cultural communication behavior. This module is based on VR / AR fusion interaction and social communication technology, and the specific solutions are as follows: Immersive Interactive Unit: Employing VR+AR fusion interactive technology, this unit provides users with an immersive cultural exploration experience. Wearing VR devices, users can "enter" virtual locations rooted in ethnic cultures (such as Miao stilted houses or the Uyghur Kashgar Old City). Through gesture recognition (recognition accuracy ≥99%) and voice interaction (supporting voice recognition in various ethnic languages), users can interact with cultural elements in the virtual scene (such as drawing virtual Thangkas or experiencing the playing of ethnic musical instruments). Simultaneously, through AR technology, users can point their phone or tablet camera at cultural site markers in the real-world scene to trigger the overlay of virtual cultural elements (such as overlaying historical scene restoration images or intangible cultural heritage skill demonstration animations at the site), achieving a fusion of "reality-virtual" interaction. Personalized Recommendation Unit: Based on user interaction data (such as browsing history, click preferences, and dwell time), a user interest model is constructed, and personalized cultural heritage visualization content is recommended to users through collaborative filtering recommendation algorithms. For example, for users interested in intangible cultural heritage skills, dynamic visualization content and interactive experience projects of intangible cultural heritage skills of various ethnic groups are given priority; for users interested in historical evolution, historical evolution content with spatiotemporal folding visualization is given priority. Socialized Communication Unit: This unit constructs a social matrix for cultural dissemination, supporting users in sharing their interactive experiences (such as virtual Thangka paintings, cultural exploration journeys, and experience videos) through social platforms like WeChat, Weibo, and Douyin. Simultaneously, the system features a "Cultural Dissemination Expert" points system; the more likes, comments, and shares a user's content receives, the higher their points. These points can be redeemed for virtual cultural souvenirs or offline cultural experience opportunities, incentivizing users to actively participate in the dissemination of the roots of ethnic culture.

[0029] 5. System Operation and Maintenance Module This module ensures stable system operation, data updates, and security protection, providing operational support for the entire visualization and dissemination system. Specifically, it includes: Data Update Unit: Establish a dynamic update mechanism for the cultural foundation data of the 56 ethnic groups, regularly (quarterly) supplement new cultural data (such as newly added intangible cultural heritage inheritors and newly discovered cultural sites) through the data collection module, and update the original correlation model through the data preprocessing and correlation modeling module to ensure the timeliness of the visualization content; Security Protection Unit: Utilizes blockchain technology to encrypt and store cultural foundation data, ensuring its immutability and integrity; establishes a user permission hierarchy mechanism (visitors, registered users, administrators, cultural experts), with different permissions granting access to different content and operational functions to prevent data leakage; employs DDoS attack protection technology to ensure stable system operation. Fault monitoring and repair unit: The distributed monitoring system monitors the operating status of each module in real time. When a module failure is detected (such as data acquisition failure, abnormal visualization rendering, or failure of interactive functions), an alarm message is automatically issued, and a backup module is started to replace the faulty module. At the same time, maintenance personnel are arranged to repair the fault to ensure the continuous operation of the system.

[0030] In this embodiment, the present invention operates as follows: First, the data acquisition module is activated. High-precision GPS positioning devices and 3D laser scanners are deployed in the core areas of each ethnic group's cultural heritage through fixed-point acquisition units to accurately collect static data such as the geographical coordinates and 3D spatial structure of cultural sites. Simultaneously, motion capture sensors collect data on the movement trajectories of intangible cultural heritage techniques. The mobile acquisition unit, equipped with AR glasses and a panoramic camera, delves into remote areas to collect dynamic data such as videos of folk festivals and demonstrations of folk arts, which are then uploaded in real-time to the data processing server using 5G edge computing terminals. The document mining unit, based on natural language processing technology, extracts historical and folk data related to the cultural heritage from ethnic histories, ancient texts, and other textual materials, and establishes associations with geographical and image data.

[0031] After data collection is completed, the data preprocessing and association modeling module automatically starts working: First, the collected raw data is preprocessed in a targeted manner, using the RANSAC algorithm to remove isolated noise points in the 3D laser scanning data, using the wavelet threshold denoising algorithm to purify the audio data, using the TF-IDF algorithm to extract text keywords, and then standardizing all data into JSON format; then, based on the preprocessed data, the core elements of geography, material culture, intangible culture, and history are extracted, among which the intangible cultural heritage skills are extracted using a dedicated extraction model; finally, a five-dimensional association model of "geography-history-culture" is constructed, an association map is built using a graph neural network, and the degree of association between each cultural foundation element is quantified using the association strength calculation formula, generating an association data map that can be directly used for visualization.

[0032] Based on the associated data map, the spatiotemporal mapping visualization module begins to perform multi-dimensional visualization: the basic visualization layer constructs a global geographic information base map using the WGS-84 coordinate system, and uses representative totem styles of various ethnic groups to mark the geographical coordinates and core area of ​​the cultural foundation; the spatiotemporal folding visualization layer uses spatiotemporal folding mapping technology to compress and map the evolution process of ethnic cultural foundations in different historical periods onto the same visualization interface, and users can drag the slider using the timeline control to view the distribution and status of the cultural foundations of various ethnic groups in any historical period; the multimodal fusion rendering layer uses adaptive rendering technology for different types of data to achieve synchronous display of 3D structure, dynamic action, sound wave graphics, and tag clouds; the associated visualization layer, based on the force-oriented layout algorithm, presents the relationship between the elements of the cultural foundations of various ethnic groups, and clicking on any node will automatically highlight the associated elements and links.

[0033] Once the visualization is complete, the immersive interactive communication module begins operation: users can "enter" virtual cultural foundation scenes through VR devices, interacting with virtual cultural elements using gesture recognition and multi-ethnic language voice interaction functions; scanning cultural relic markers in real-world scenes with AR devices can trigger overlay displays of virtual historical scenes and skill demonstration animations; the personalized recommendation unit pushes visual content tailored to user interests based on user browsing history, click preferences, and other interaction data through collaborative filtering recommendation algorithms; the social communication unit allows users to share their interactive experiences to various social media platforms, accumulating points based on sharing data, which can be redeemed for virtual cultural souvenirs or offline cultural experience qualifications, incentivizing users to actively participate in cultural dissemination.

[0034] Throughout the system's operation, the system operation and maintenance module provides continuous support: the data update unit automatically initiates data supplementation and model update every quarter to ensure the timeliness of the visualized content; the security protection unit protects cultural data from tampering through blockchain encrypted storage technology, manages data access permissions through a four-level user permission hierarchy mechanism, and ensures stable system operation with the help of DDoS attack protection technology; the fault monitoring and repair unit monitors the working status of each module in real time through a distributed monitoring system, immediately issues an alarm once a fault is detected, automatically starts a backup module to replace the faulty module, and notifies operation and maintenance personnel to repair the fault, ensuring the continuous and stable operation of the system.

[0035] The following are several other specific embodiments of the application of this invention: Example 1 First, the data acquisition module is activated. For scenarios with weak network coverage in remote areas, the configuration of the acquisition terminals is optimized. The fixed-point acquisition unit is equipped with an offline storage module (storage capacity of no less than 1TB) to temporarily store static data such as 3D laser scanning and multispectral imaging, which will be uploaded in batches after the acquisition personnel arrive in the network coverage area. The mobile acquisition unit uses lightweight AR acquisition equipment, simplifying the device's size and power consumption, and adapting to the acquisition needs of complex terrains such as mountains and plateaus. It focuses on acquiring complete process videos and hands-on audio recordings of intangible cultural heritage techniques such as ethnic costume making and traditional building construction. The document mining unit adds an ancient book image recognition function, which can identify and extract text from images of damaged ancient books and handwritten documents, further enriching the sources of text data.

[0036] After data collection is completed, the data preprocessing and correlation modeling module initiates an optimized processing flow: Addressing the unique characteristics of offline data collection, it first performs data integrity verification, automatically identifying and marking missing or corrupted data to remind staff to supplement the collection; in the data denoising stage, it optimizes algorithm parameters to improve the denoising effect of data collected in complex environments, with the audio data denoising process adding a human voice separation function to accurately separate the voice of intangible cultural heritage demonstrations from environmental noise; in the cultural foundation element extraction stage, it focuses on strengthening the classification and sorting of material cultural elements, subdividing them into four major categories: architecture, cultural relics, clothing, and tools; in the spatiotemporal correlation modeling stage, it simplifies the hierarchical structure of the correlation graph, prioritizing the retention of core correlations (such as the relationship between the place of origin and core intangible cultural heritage techniques, and the relationship between different cultural elements of the same ethnic group), improving modeling efficiency and adapting to the computing needs of small and medium-sized servers.

[0037] Based on the optimized associated data map, the spatiotemporal mapping visualization module performs adaptive display work: the basic visualization layer adds a terrain and landform display function, which can intuitively present the geographical environmental features such as mountains, plains, and rivers where the cultural roots are located, helping users understand the relationship between culture and regional environment; the spatiotemporal folding visualization layer supports custom historical period annotations, and users can manually input specific historical years or dynasties, and the system can quickly locate and display the distribution of the cultural roots of various ethnic groups during that period; the multimodal fusion rendering layer adopts lightweight rendering technology, reducing the hardware configuration requirements of terminal devices, so that ordinary smartphones and tablets can also smoothly display 3D visualization content; the associated visualization layer adds an association relationship filtering function, which allows users to filter the associated content of a certain type of cultural element as needed, improving browsing efficiency.

[0038] After the visualization is completed, the immersive interactive communication module activates its adaptive interactive functions: the immersive interaction unit simplifies the VR interaction process, eliminating the need for dedicated VR equipment. The virtual scene perspective is switched via the phone's gyroscope, and users can interact with virtual cultural elements through touchscreen operation; the personalized recommendation unit adds a scenario-based recommendation mode, pushing suitable visual content based on the user's current location (such as cultural venues, schools, or tourist attractions). For example, for users in tourist attractions, it prioritizes recommending tour routes and unique cultural experiences rooted in local ethnic culture; the social communication unit adds a cultural knowledge quiz function, allowing users to share relevant ethnic cultural knowledge quizzes when sharing their interactive results. Both parties receive points rewards for correct answers, enhancing the knowledge and fun of cultural communication.

[0039] Throughout the system's operation, the system maintenance module initiated targeted support measures: the data update unit adopted an incremental update mode, updating only the newly added cultural data and the relationships between changes, reducing data transmission volume and update time; the security protection unit added a data anonymization function, anonymizing data involving ethnic privacy and unpublished cultural materials before displaying them; and the fault monitoring and repair unit added a terminal device compatibility monitoring function, which can monitor the operating status of different terminal devices in real time and automatically push optimization patches for compatibility issues, ensuring stable system operation on different terminals.

[0040] Example 2 First, the data acquisition module was activated, focusing on the needs of ethnic language and culture dissemination. The collection of language-related data was strengthened, and the fixed-point acquisition unit was equipped with multi-channel audio acquisition equipment to simultaneously collect voice data such as daily conversations, traditional songs, and myths in ethnic languages ​​from different age groups and dialect areas. The mobile acquisition unit organized a professional language acquisition team to go deep into ethnic minority areas to collect specialized voice and video data such as pronunciation techniques and grammar rules of ethnic languages. The literature mining unit focused on mining textual materials such as ethnic language dictionaries and grammar books to extract core information related to language and writing, and to establish the connection between language data and cultural elements such as folk customs and festivals.

[0041] After data collection is completed, the data preprocessing and correlation modeling module initiates a special language data processing workflow: the data preprocessing stage adds a speech-to-text function, which can convert the collected ethnic language speech data into corresponding text, and also supports the comparison and conversion between ethnic language scripts and Chinese characters; in the cultural foundation element extraction stage, a new category of language and culture elements is added, incorporating ethnic languages, scripts, dialects, etc. into the core element system; in the spatiotemporal correlation modeling stage, the spatiotemporal correlation of language and culture elements is strengthened, focusing on presenting the origin, spread, and evolution trajectory of ethnic languages, as well as the interaction and influence between different ethnic languages.

[0042] Based on the language and culture-specific related data map, the spatiotemporal mapping visualization module performs distinctive display work: the basic visualization layer adds a language distribution heatmap, which can intuitively present the core distribution areas and spread range of each ethnic language; the spatiotemporal folding visualization layer focuses on displaying the evolution of language and culture, clearly presenting the distribution changes of ethnic languages ​​and dialect differentiation in different historical periods; the multimodal fusion rendering layer adds a language pronunciation visualization function, transforming the pronunciation characteristics of ethnic languages ​​into dynamic visual graphics to help users understand the differences between different pronunciations; the association visualization layer prioritizes displaying the relationship between language and culture elements and other cultural elements, such as the relationship between ethnic languages ​​and folk festivals and traditional songs.

[0043] After the visualization is completed, the immersive interactive communication module launches special interactive functions for language and culture: the immersive interactive unit adds language learning interactive functions, allowing users to learn the basic pronunciation and common vocabulary of ethnic languages ​​through voice reading aloud and pronunciation comparison; the personalized recommendation unit pushes suitable language and culture content based on the user's language learning progress and interests, such as audio and text materials of ethnic songs and myths; the social communication unit supports the sharing of language learning results, allowing users to share their reading aloud recordings and learning notes, forming a language learning and exchange community to help the inheritance and dissemination of ethnic languages.

[0044] Throughout the system's operation, the system maintenance module initiated special support measures: the data update unit added a dedicated language data update channel to promptly supplement newly added ethnic language research findings and rescue data collected for endangered languages; the security protection unit strengthened copyright protection for language data, setting exclusive access permissions for unpublished endangered language data, allowing only authorized language researchers to access it; and the fault monitoring and repair unit added a dedicated monitoring system for voice interaction faults, quickly locating and repairing faults in functions such as speech recognition and speech synthesis to ensure the stable operation of language learning and interaction functions.

[0045] Example 3 First, the data acquisition module is activated to adapt to the needs of cultural and educational scenarios. The data acquisition module has added a dedicated education acquisition unit, which can collect educational data such as ethnic culture textbooks, courseware, and videos of famous teachers' explanations for the cultural and educational needs of primary and secondary schools and universities. The fixed-point acquisition unit has added a campus-adaptive acquisition terminal, which is small in size and easy to operate. It can be quickly deployed in scenarios such as campus cultural exhibition halls and research bases to collect 3D data of cultural exhibits and audio explanations. The mobile acquisition unit collaborates with educational institutions to carry out ethnic culture research and learning activities, organize teachers and students to participate in the data acquisition process, and collect data such as experience videos and Q&A audio during the research and learning process.

[0046] After data collection is completed, the data preprocessing and correlation modeling module initiates an education-adaptive processing flow: The data preprocessing stage adds an educational data classification and labeling function, classifying and labeling the collected educational data by grade level (primary, middle, high school, and university) and subject (Chinese, history, art, and geography); the cultural foundation element extraction stage strengthens the extraction of core knowledge points based on educational needs, transforming cultural elements into knowledge points that are easy to teach; the spatiotemporal correlation modeling stage adds a knowledge point association function, establishing relationships between different cultural knowledge points (such as the relationship between a nation's folk festivals and historical events, or the relationship between traditional crafts and geographical environment), adapting to the knowledge point connection needs in the teaching process.

[0047] Based on education-adaptive relational data maps, the spatiotemporal mapping visualization module performs teaching-specific display tasks: the basic visualization layer adds a campus study tour route marking function, which can mark study tour check-in points and teaching focuses in the locations of the cultural roots of various ethnic groups; the spatiotemporal folding visualization layer supports the linked display of historical events, and clicking on a historical event node can simultaneously display the changes in the cultural roots of various ethnic groups under the influence of the event; the multimodal fusion rendering layer adds a teaching demonstration mode, which can demonstrate the production process of intangible cultural heritage skills and the construction steps of traditional buildings step by step, adapting to the demonstration needs of classroom teaching; the relational visualization layer supports the knowledge point retrieval function, and teachers can input teaching knowledge points, and the system can quickly locate and display related cultural root elements and relationships.

[0048] After the visualization is completed, the immersive interactive communication module launches educational-specific interactive functions: the immersive interactive unit adds a virtual study tour function, allowing students to simulate visiting the locations of the roots of ethnic culture through virtual scenes and complete study tour tasks (such as identifying cultural exhibits and recording folk customs); the personalized recommendation unit pushes appropriate cultural learning content and interactive tasks based on students' grade level, subject, and learning progress; the social communication unit adds a class sharing function, supporting students to share their study tour results and learning notes within the class, and teachers can comment on and guide students' shared content, enhancing the interactivity and effectiveness of cultural education.

[0049] Throughout the system's operation, the system operation and maintenance module initiates dedicated support measures for the education scenario: the data update unit adds a timely update mechanism for educational data, synchronously updating the latest ethnic culture textbooks and teaching resources; the security protection unit adds student privacy protection functions, strictly protecting students' personal information and learning data; and the fault monitoring and repair unit adds a priority guarantee mechanism for teaching periods, prioritizing the allocation of system resources during critical periods such as school classes and study tours to ensure stable system operation and avoid affecting the conduct of teaching activities.

[0050] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various variations or substitutions within the technical scope disclosed in the present invention, and these should all be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A visual communication system for the cultural roots of the 56 ethnic groups, characterized in that, This includes five core modules that are sequentially linked: The system includes a data acquisition module for collecting multimodal raw data, a data preprocessing and association modeling module for data processing and association modeling, a spatiotemporal mapping visualization module for multidimensional dynamic visualization, an immersive interactive communication module for deep interaction and cultural dissemination, and a system operation and maintenance module for stable system operation and maintenance. Each module corresponds to the others, forming a complete visual communication technology chain.

2. The system according to claim 1, characterized in that, The data acquisition module employs a three-dimensional acquisition method combining fixed-point acquisition, mobile acquisition, and literature mining, specifically including: The fixed-point acquisition unit is used to deploy multi-dimensional acquisition terminals to collect the geographical coordinates, three-dimensional spatial structure, surface texture, and audio data of intangible cultural heritage techniques of cultural sites. A mobile data acquisition unit is used to carry AR glasses and a panoramic camera to collect dynamic data in remote areas and upload it in real time. The document mining unit is used to mine textual data and establish association tags based on natural language processing technology; The fixed-point acquisition unit also includes a motion capture sensor with a sampling frequency of not less than 100Hz, used to collect motion trajectory data of intangible cultural heritage skills.

3. The system according to claim 1, characterized in that, The processing flow of the data preprocessing and association modeling module includes: The data preprocessing steps include using the RANSAC algorithm to denoise the 3D laser scanning data, the wavelet threshold denoising algorithm to denoise the audio data, the TF-IDF algorithm to extract text keywords, and standardizing all data into JSON format. The steps for extracting cultural foundation elements involve extracting core geographical, material, intangible, and historical elements based on preprocessed data, and using a dedicated element extraction model to extract intangible cultural elements. The spatiotemporal correlation modeling steps involve constructing a five-dimensional correlation model encompassing geography, history, and culture, and then building a correlation graph using graph neural networks.

4. The system according to claim 3, characterized in that, The extraction formula for intangible cultural heritage skills in the intangible cultural heritage element extraction model is as follows: ; in, Let i be the vector of the core elements of the i-th intangible cultural heritage skill. This represents the feature vector of the skill's movement trajectory. For material feature vectors, As a feature vector of historical inheritance, , , The weighting coefficients are and satisfy the following conditions: The weighting coefficients are determined using the analytic hierarchy process (AHP).

5. The system according to claim 3, characterized in that, In the spatiotemporal correlation modeling step, the node correlation strength of the correlation graph is calculated using the following formula: ; in, Let the association strength be the relationship between the i-th and j-th nodes. For geographic coordinate similarity, For historical time similarity, For cultural similarity.

6. The system according to claim 1, characterized in that, The spatiotemporal mapping visualization module includes a four-layer visualization structure: The basic visualization layer uses the WGS-84 coordinate system to construct a geographic base map and marks the location of cultural roots with ethnic totem patterns. The spatiotemporal folding visualization layer uses spatiotemporal folding mapping technology to map the cultural evolution process of different historical periods onto the same interface, supporting linked display of the timeline. The multimodal fusion rendering layer uses voxel rendering, skeletal animation rendering and other technologies to achieve synchronous visualization of multiple data types; The associated visualization layer uses a force-oriented layout algorithm to present the relationships between cultural elements.

7. The system according to claim 1, characterized in that, The immersive interactive communication module includes: The immersive interactive unit adopts VR+AR integrated interactive technology, supports gesture recognition and multi-ethnic language voice interaction, and realizes virtual scene interaction and reality-virtual integrated interaction; The personalized recommendation unit builds an interest model based on user interaction behavior data and pushes personalized content through a collaborative filtering recommendation algorithm. Socialized communication units are used to build a social sharing matrix and set up an incentive mechanism based on points.

8. The system according to claim 1, characterized in that, The system operation and maintenance module includes: The data update unit establishes a dynamic data update mechanism once a quarter, and updates the associated models synchronously. The security protection unit uses blockchain to encrypt and store data, sets up a four-level user permission classification mechanism, and is equipped with DDoS attack protection technology. The fault monitoring and repair unit monitors the module's operating status in real time through a distributed monitoring system, and supports automatic fault alarms and backup module switching.

9. The system according to claim 2, characterized in that, The multi-dimensional acquisition terminal of the fixed-point acquisition unit includes: High-precision GPS positioning equipment with an accuracy of ±0.1m, 3D laser scanner with a scanning distance of 0.1-100m, and multispectral imaging equipment with a spectral range of 400-1000nm; The mobile acquisition unit is equipped with a panoramic camera with a resolution of no less than 8K and a frame rate of no less than 30fps, and the data is uploaded in real time through a 5G edge computing terminal with a transmission rate of ≥1Gbps.

10. The system according to claim 6, characterized in that, In the multimodal fusion rendering layer, the three-dimensional laser scanning data adopts voxel rendering technology with a voxel resolution of 0.01m, the intangible cultural heritage skill movement data adopts skeletal animation rendering technology, the ethnic language audio data adopts sound wave visualization rendering technology, and the text data adopts tag cloud rendering technology. All types of data are displayed synchronously through a multi-channel synchronous rendering algorithm.

Images