Virtuality and reality combined display system for element universe museum
By applying metacosmic technology in museums, combining 3D scanning, multispectral imaging and AR technology, a display system that combines virtual and real is built, solving the limitations of traditional digital display methods, realizing personalized and interactive visiting experience, and improving user satisfaction and the digitalization process of the museum.
Patent Information
- Application Number
- CN202411979783.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-31
- Publication Date
- 2025-05-13
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The digital display method of traditional museums is limited to two-dimensional planes, which is difficult to present the three-dimensional sense and detailed characteristics of cultural relics. It lacks personalization and interactivity, and cannot meet the audience's needs for in-depth participation and personalized experience.
Develop a virtual and real display system for the Metaverse Museum, collect cultural relics data through 3D scanning and multi-spectral imaging technology, combine user behavior analysis to build a high-fidelity virtual cultural relics model and personalized exhibition route, and use AR technology to achieve the virtual and real combination, enhancing interactivity and immersion.
It realizes the display experience of personalized guide planning and the combination of virtual and real, enhances the user's sense of participation and satisfaction, and continuously improves the user experience through feedback and optimization modules, improving the digitalization process of the museum and the audience's visiting experience.
Smart Images

Figure CN119992013A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the fields of metaverse technology and museum display technology, and specifically to a virtual-real combination display system for a metaverse museum. Background Art
[0002] With the rapid development of information technology, digitalization and virtualization technologies are gradually penetrating into all areas of society, bringing unprecedented changes to people's lives. In the museum field, traditional display methods can no longer meet the modern audience's needs for interactivity and immersion. In recent years, the rise of the concept of metaverse has provided new ideas for the digital transformation of museums. As a new digital space integrating digitization, virtualization and socialization, metaverse provides unlimited possibilities for museum display and interaction. By using advanced 3D modeling, rendering and augmented reality technology, metaverse can construct a highly realistic virtual environment, allowing the audience to feel as if they are in the long river of history and feel the charm of cultural relics up close.
[0003] Traditional museums still have many shortcomings in digital display. On the one hand, traditional digital display methods are often limited to two-dimensional planes, making it difficult to present the three-dimensionality and detailed features of cultural relics. On the other hand, traditional display methods lack personalization and interactivity, and cannot meet the audience's needs for deep participation and personalized experience. In addition, traditional museums also have many limitations in the collection, analysis and utilization of cultural relic data, resulting in a single display content and a lack of depth. These problems have seriously restricted the museum's digitalization process and the audience's visiting experience.
[0004] Therefore, developing a virtual-real display system for the Metaverse Museum will greatly promote the museum's digitalization process and enhance the audience's visiting experience and cultural literacy. Summary of the invention
[0005] The purpose of the present invention is to make up for the shortcomings of the existing technology and provide a virtual-reality display system for the Metaverse Museum. The system realizes personalized guide planning and virtual-reality display experience through data collection, analysis and user portrait construction. The system uses 3D scanning and multi-spectral imaging technology to collect cultural relics data, and combines user behavior analysis to construct high-fidelity virtual cultural relic models and personalized exhibition routes. The virtual-reality display module pushes AR content based on user interests, enhancing interactivity and immersion. In addition, the system continues to improve user experience through feedback and optimization modules.
[0006] In order to solve the above technical problems, the present invention provides the following technical solutions: a virtual-real combination display system for a metaverse museum, the system comprising a data acquisition module, a data analysis and user portrait module, a personalized tour planning module, a virtual-real combination display module, and a feedback and optimization module;
[0007] The data collection module collects user registration information and historical browsing behavior data through museum websites and mobile application channels, obtains shape data of cultural relics through 3D scanning equipment, collects texture and color data of cultural relics through multi-spectral imaging technology, and digitally organizes historical and cultural background information of cultural relics;
[0008] The data analysis and user portrait module: cleans and standardizes the collected user data, analyzes the user browsing history through association rule mining, finds out the potential associations in the browsing behavior, divides different behavior groups based on the user's operation behavior on the website and application using a clustering algorithm, calculates the user's explicit interests by analyzing the user's search keywords, mines the implicit interests based on the user's browsing behavior on the exhibits and the characteristic attributes of the exhibits, classifies the users according to their basic information, behavior and interests, and labels the corresponding interest tags for the same type of users;
[0009] The personalized tour planning module receives data from the data analysis and user portrait modules, divides users into academic research groups, cultural experience groups, and innovative exploration groups according to their interest tags, plans routes for each group, and plans personalized exhibition routes for customers through exhibition route calculation formulas;
[0010] The virtual-real combination display module: uses 3D modeling software and rendering technology to build a virtual cultural relic model based on cultural relic collection data, provides users with personalized guided paths in the virtual museum according to the determined user interests and visiting routes, and builds virtual museum scenes according to different historical periods and cultural backgrounds, uses image recognition and positioning technology to accurately match AR content with physical exhibits, pushes personalized AR content based on user portraits, and sets up interactive devices and multi-sensory experience facilities in the physical exhibition hall;
[0011] The feedback and optimization module collects user feedback data through online questionnaires, in-application feedback functions and on-site feedback, and classifies and organizes the user feedback data, adjusts user portraits and navigation plans based on user feedback, and improves and upgrades display technology and interactive functions.
[0012] Furthermore, the data analysis and user portrait module uses association rule mining algorithm to discover potential associations in user browsing behaviors. Assume that the user set is U = {u1, u2, ..., u n}, the exhibit set is I = {i1, i2, ..., i m}, the user's browsing behavior on the exhibits is represented by a binary relationship matrix R = (r ij ) indicates that r ij =1 indicates user u i Viewed exhibits j , r ij= 0 means no browsing. Define the support and confidence indicators to measure the degree of association between exhibits. For exhibit i a and i b , and its support calculation formula is: Indicates that you have viewed exhibits at the same time a and i b The proportion of users to the total number of users, the confidence calculation formula is: Indicates that you have viewed the exhibits a Of the users, also viewed exhibit i b The proportion of users is calculated by setting the support threshold T Support and the confidence threshold f Confidencet , and dig out exhibit pairs with strong correlation.
[0013] Furthermore, in the data analysis and user portrait module, users are divided into different behavior groups based on their operation behaviors on websites and applications through the user behavior similarity formula. Suppose the operation behavior feature vectors of user i and user j are and Define user similarity as S ij , the calculation formula is: Set the similarity threshold T, when S ij When ≥T, user i and user j are classified into the same category.
[0014] Furthermore, the data analysis and user portrait module calculates the user's explicit interest in the exhibits through the explicit interest calculation formula. Suppose all different keyword sets are W = {w1, w2, ..., w q}, for user u i The search keyword vector is V i =(v i1 , v i2 , …, v iq ), where v ij Indicates keyword w j In user u i The frequency of occurrence in the search history of is:
[0015] Furthermore, the data analysis and user portrait module calculates the user's implicit interest in the exhibits through the implicit interest calculation formula. Let the feature vector of the exhibit be P j =(p j1 , p j2 ,…,p jr ), for user u i and exhibit j, calculated as:
[0016] Furthermore, the personalized tour planning module includes route planning for academic research groups: screening of cultural relics with high academic value that represent key technologies of a specific historical period, designing tour routes based on the logical sequence of academic research and the inherent knowledge relationships between cultural relics, providing professional research reports, paper databases, in-depth interpretation lectures by experts, and setting up an online academic exchange community.
[0017] Furthermore, the personalized tour planning module plans routes for cultural experience groups: regional handicrafts, traditional festival objects and cultural relics with rich cultural connotations are selected, the tour route design focuses on creating cultural context and emotional atmosphere, and the tour content is mainly in the form of vivid storytelling, on-site demonstrations by cultural inheritors and recorded video explanations.
[0018] Furthermore, the personalized tour planning module plans routes for innovative and exploratory groups: 3D printed cultural relic models, modern creative works with traditional elements are selected, and the planning of the tour routes is full of modernity and technology, with creative workshops and interactive experience areas.
[0019] Furthermore, the personalized tour guide planning module plans a personalized exhibition route for the customer through an exhibition route calculation formula. Suppose exhibition route R = (e1, e2, ..., e n ), where e i represents the i-th exhibit in the route, and calculates the comprehensive interest of user u in exhibit ei I(u, e i ), the formula is: I(u, e i )=α×XQ x (u,e i )+(1-α)×XQ y (u, ei), where α is the weight coefficient, XQ x (u,e i ) represents user u’s interest in exhibit e i The explicit interest of XQ y (u,e i ) represents user u’s interest in exhibit e i The implicit interest of exhibition route R is used to calculate the interest I(u, R) of user u. The formula is: where w i Exhibit e i The weight in the route, choose I(u, e i ) value is taken as the personalized exhibition route of user u.
[0020] Compared with the existing technology, the virtual-real combination display system of the Metaverse Museum has the following advantages:
[0021] Beneficial effects:
[0022] 1. The present invention collects user information and cultural relic data comprehensively and meticulously through the data acquisition module, providing a basis for subsequent personalized display and guided tour planning. The data analysis and user portrait module explores the user's potential needs and interests, so that the display content can accurately match the user's preferences, enhancing the user's sense of participation and satisfaction. The virtual-real combination display module uses 3D modeling and rendering technology to build a virtual cultural relic model, and realizes seamless connection with physical exhibits through AR technology, bringing an immersive visiting experience to users. In addition, the existence of the feedback and optimization module enables the system to continuously collect user feedback, continuously optimize and improve the display content and functions, and ensure the long-term stability of the system.
[0023] 2. The present invention successfully integrates the immersive and interactive features of the metaverse into the museum's display through personalized tour planning and a combination of virtual and real display methods, bringing users a brand new visiting experience. In data processing and algorithm application, through association rule mining algorithms and user behavior similarity formula technology, it achieves accurate grasp of user needs and personalized recommendations, and improves the intelligence and humanization level of the system, which not only makes the present invention technically creative, but also lays a solid foundation for its wide application in the market.
[0024] Other advantages, objectives and features of the present invention will be set forth in part in the following description and, in part, will be apparent to those skilled in the art based on an examination of the following or may be taught from the practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0026] Figure 1 It is a flow chart of a virtual-real combination display system of a metaverse museum;
[0027] Figure 2 This is a process framework diagram of a virtual-real display system for a metaverse museum. DETAILED DESCRIPTION
[0028] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the specific implementation mode, structure, characteristics and effects of the present invention are described in detail below in combination with the accompanying drawings and preferred embodiments.
[0029] Embodiment 1
[0030] History lover Xiao Li's tour
[0031] Data collection: After Xiao Li registered on the museum's mobile application, his browsing behavior data was recorded by the system. Xiao Li often browsed museum-related content on weekend afternoons, with a particular focus on ancient historical relics. He visited the "Qin Dynasty Bronze Sword", "Han Dynasty Tile End", and "Tang Dynasty Bronze Mirror" exhibits. He stayed on the "Qin Dynasty Bronze Sword" page for 11 minutes, on the "Han Dynasty Tile End", and on the "Tang Dynasty Bronze Mirror" for 2 minutes, and on the "Tang Dynasty Bronze Mirror" for 3 minutes.
[0032] Data analysis and profiling, after the system cleans and standardizes Xiao Li’s data, it finds through association rule mining that the user set is U = {u1, u2, …, u n}, the exhibit set is I = {i1, i2, ..., i m}, the user's browsing behavior on the exhibits is represented by the binary relationship matrix R = (r ij ) means (r ij =1 indicates user u i Viewed exhibits j , r ij =0 means not browsed), for exhibit i a (such as "Qin Dynasty bronze sword") and i b (such as "Terracotta Warriors and Horses of the Qin Dynasty"), the support calculation formula is: Assume that the number of users who have browsed "Qin Dynasty Bronze Sword" and "Qin Dynasty Terracotta Warriors" is n. ab , the total number of users is N, then the support is: At the same time, the confidence calculation formula is: Assume that the number of users who have browsed "Qin Dynasty Bronze Sword" is n a , the confidence level is: Set the support threshold T Support and the confidence threshold T Confidencet ,When the calculation results meet the threshold condition, the exhibits are judged to have strong association.
[0033] Based on the user behavior similarity formula, let the operation behavior feature vectors of user i (Xiao Li) and user j be X i =(x i1 , x i2 , …, x ip ) and X j =(x j1 , x j2 , …, x jp ), define user similarity as S ij , the calculation formula is: Set the similarity threshold T, when S ijWhen ≥T, Xiao Li and other users who have similar browsing behaviors for ancient historical relics are classified into the same category, and Xiao Li can be determined to be a history enthusiast.
[0034] According to the explicit interest calculation formula, let all different keyword sets be W = {w1, w2, ..., w q}, Xiao Li’s search keyword vector is V i =(v i1 , v i2 , …, v iq )(v ij Indicates keyword w j The frequency or weight of appearing in Xiao Li’s search history), the explicit interest calculation formula is: Xiao Li searches for the keywords "ancient weapons", "historical relics", and "dynasty evolution" at a high frequency, which further clarifies his explicit interest in historical relics. Combined with the implicit interest calculation formula, the characteristic vector of the exhibit is set as P j =(p j1 , p j2 ,…,p jr ), for Xiao Li (ui ) and exhibit j, calculated as: By analyzing Xiao Li's browsing behavior and the characteristics of the exhibits, we found that he has a strong interest in exhibits that reflect the level of ancient craftsmanship and historical and cultural heritage. The system marked Xiao Li with the interest tag of "history enthusiast".
[0035] Personalized tour guide and virtual and real display, according to Xiao Li’s interest tags, the personalized tour guide planning module plans an exhibition route for him. Let the exhibition route R = (e1, e2, ..., e n )(e i represents the i-th exhibit in the route), calculate Xiao Li’s response to exhibit e i The comprehensive interest I(u, e i ), the formula is: I(u, ei ) =α×XQ x (u,e i )+(1-α)×XQ y (u,e i ), where XQ x (u,e i ) indicates that Xiao Li is interested in the exhibits i The explicit interest of XQ y (u,e i ) indicates that Xiao Li is interested in the exhibits i The implicit interest of the exhibition route is calculated as follows: α is the weight coefficient. The interest of the exhibition route to Xiao Li is calculated as follows: w i Exhibit e i The weight in the route, choose I(u, ei ) value is taken as Xiao Li’s personalized exhibition route.
[0036] The virtual display combines the real and the virtual. In terms of virtual display, professional 3D modeling software and advanced rendering technology are used to build a high-fidelity virtual cultural relic model. Xiao Li can use VR equipment to observe the details of the sword body texture and hilt decoration of the "Qin Dynasty Bronze Sword" up close, as if he were in an ancient sword-making workshop. According to Xiao Li's interests and visiting route, the virtual museum scene is set to start from the historical scene of the Qin Dynasty and gradually transition to the Han, Tang and Song Dynasties. For example, the casting process animation of the Qin Dynasty bronze sword is displayed in the Qin Dynasty scene, and the usage scene of Han Dynasty weapons is displayed in the Han Dynasty scene.
[0037] Using image recognition and positioning technology, when Xiao Li approaches the physical exhibit of "Qin Dynasty Bronze Sword" in the physical exhibition hall, the mobile phone will push content about the bronze sword's production process, historical background, and role in ancient wars, presented in the form of animation. Interactive devices are set up in the physical exhibition hall. For example, Xiao Li can simulate the use of "Han Dynasty weapons" through the touch screen, and feel its weight and wielding method. At the same time, multi-sensory experience facilities are set up, such as playing Tang Dynasty court music in the "Tang Dynasty Bronze Mirror" exhibition hall to create a historical atmosphere.
[0038] Feedback and optimization: After Xiao Li's visit, he expressed his hope through the on-site feedback collection form to add more comparative displays of historical relics in the virtual display, and to add some historical puzzles to the interactive experience. The system classified and sorted Xiao Li's opinions, adjusted Xiao Li's user portrait based on the feedback, added his preference tags for comparative displays of historical relics and historical puzzles, and optimized the tour planning. More comparative displays of relics were added to the subsequent recommended routes. From the display technology aspect, the function of the virtual model comparative display was improved; from the interactive function aspect, more interactive modules for historical puzzles were developed to provide a better visiting experience for Xiao Li and other history enthusiasts.
[0039] To sum up, in this embodiment, the system comprehensively collects data about Xiao Li, a history enthusiast, through a series of browsing behaviors on the museum's mobile application, including browsing time and exhibit preferences. After data analysis and processing by the portrait module, an accurate user portrait of Xiao Li is constructed to clarify his identity as a history enthusiast. The personalized tour planning module customizes a visiting route for him based on the portrait. In the virtual-reality display module, Xiao Li gains an in-depth experience through VR, AR technology and interactive devices. The feedback after the visit prompts system optimization, demonstrating the complete process of the Metaverse Museum display system from data collection to personalized services to continuous improvement, fully reflecting its ability to provide history enthusiasts with high-quality, customized visiting experiences, and effectively enhancing users' exploration and perception of historical culture.
[0040] Embodiment 2:
[0041] Youngster Xiao Wang's cultural experience trip
[0042] Data collection and portrait generation,Data collection: Xiao Wang registered through the museum website, and his identity information was shown as a teenager. On the website, Xiao Wang's browsing behavior data was recorded in detail. He mainly browsed in his spare time, especially on holidays, and showed a strong interest in content full of cultural characteristics and fantasy elements. He had browsed the "Minority Costumes", "Traditional Folk Handicrafts", and "Cultural Relics Related to Ancient Myths" sections. He stayed on the pages of the "Miao Silver Jewelry", "Paper-Cutting Art", and "Shan Hai Jing Strange Beasts" exhibits for a long time, and searched for the keywords "Minority Culture" and "Mythical Beasts in Myths" during the browsing process.
[0043] Data analysis and user portrait construction:
[0044] After the system comprehensively processed Xiao Wang’s data, it discovered through in-depth association rule mining that among the user groups who browsed certain specific exhibits (such as “Miao silver jewelry”), a certain proportion of users also browsed other related exhibits (such as “Dong embroidery” and “Yi lacquerware”). There are intrinsic connections between these exhibits, thereby unearthing the potential connections in Xiao Wang’s browsing behavior.
[0045] Based on Xiao Wang's operating behavior on the website and using the user behavior similarity analysis method, the system classifies Xiao Wang into a category with other teenagers with similar browsing patterns and interests, and determines that Xiao Wang belongs to the group of cultural experience-oriented teenagers. This classification is mainly based on his frequent browsing of content related to ethnic minority culture and myths, as well as the specific browsing order.
[0046] By analyzing Xiao Wang's search keywords, we can identify his explicit interest in ethnic minority culture and myths. The frequent appearance of these keywords reflects his preference for cultural exploration.
[0047] Further combining Xiao Wang's browsing behavior characteristics of the exhibits and the characteristic attributes of the exhibits themselves, the system deeply explores his implicit interest in exhibits with regional characteristics, rich cultural heritage significance and fantasy colors. Based on the above analysis results, the system accurately labels Xiao Wang with the interest label of "cultural experience-oriented teenager".
[0048] Personalized guided tour and exhibition experience. Based on Xiao Wang’s interest label of “cultural experience-oriented youth”, the personalized guided tour planning module carefully designed an exclusive exhibition route. This route includes many exhibits that can arouse his interest, such as “Miao silver jewelry”, “Dong embroidery”, “Yi lacquerware”, “paper-cutting art”, “Strange Beasts in Classic of Mountains and Seas” and “Tibetan Thangka”, and fully considers the cultural connection and appeal between the exhibits, aiming to bring Xiao Wang a coherent and wonderful cultural experience journey.
[0049] The tour route design focuses on creating a cultural context and emotional atmosphere. The guided tour content is mainly in the form of vivid storytelling, on-site demonstrations by cultural inheritors, or recorded video explanations. For example, when introducing "Miao silver jewelry", not only its craftsmanship characteristics are described, but also the legends behind the Miao silver jewelry and its important role in Miao traditional festivals; in the "Paper-Cutting Art" experience area, paper-cutting artists are arranged to demonstrate paper-cutting techniques on site, and explain the origin and development of paper-cutting art, as well as the characteristics of paper-cutting styles in different regions; in the "Tibetan Thangka" display area, videos of Thangka painters painting Thangkas are played, explaining the religious and cultural connotations of Thangkas and the details of the painting process.
[0050] The system combines the real and the virtual in display, with the help of advanced 3D modeling and rendering technology, to construct realistic virtual cultural relic models, such as the virtual model of "Miao silver jewelry". Xiao Wang can use virtual reality equipment to appreciate these virtual cultural relics in an immersive way, as if he were in a festival celebration of ethnic minorities, and see the vivid scenes of Miao girls singing and dancing in gorgeous silver jewelry, and deeply feel the unique charm of ethnic minority culture. According to Xiao Wang's interests and visiting routes, the virtual museum scenes are cleverly designed to create a rich ethnic minority cultural atmosphere and a fantasy mythological world scene. In the ethnic minority cultural area, Xiao Wang can appreciate the rich and colorful life scenes of different ethnic groups; in the mythological story area, he seems to have stepped into a mysterious fairyland, full of curiosity and surprise.
[0051] Using image recognition and positioning technology, when Xiao Wang approaches the "Miao Silver Jewelry" exhibit in the physical exhibition hall, relevant AR content will be pushed to his mobile phone in a timely manner. This content includes a detailed introduction to the production process of Miao silver jewelry, the profound cultural implications behind it, and wonderful interpretations of Miao myths and legends. Through vivid animations and clear voice explanations, Xiao Wang can have a deeper understanding of the connotation of the exhibits. In the physical exhibition hall, a variety of interactive devices are set up. For example, Xiao Wang can personally participate in the "Paper-Cutting Art Experience" activity. Under the guidance of professionals, he can make paper-cut works by hand and feel the fun of traditional handicrafts. At the same time, it is also equipped with multi-sensory experience facilities. For example, in the "Shan Hai Jing Strange Beasts" exhibition hall, mysterious and fantastic sound effects surround it, further enhancing the mythological atmosphere, making Xiao Wang seem to have traveled into the ancient mythological world.
[0052] Feedback and optimization: After Xiao Wang finished his visit, he expressed his thoughts through the feedback function in the museum application. He hoped that more ethnic minority cultural performances and mythological role-playing projects could be added in future visits to more deeply experience the charm of different cultures. The system carefully collected and organized Xiao Wang's feedback. Based on these feedbacks, Xiao Wang's user portrait was adjusted in a timely manner to incorporate his interest in ethnic minority cultural performances and mythological role-playing. At the same time, the tour planning was optimized. In the subsequent recommended tour routes for Xiao Wang, recommendations for related activity experience areas were specially added to ensure that he could get a richer and more satisfactory visiting experience. In terms of display technology, the animation effects and sound quality of virtual scenes were continuously improved to make them more realistic and attractive. In terms of interactive functions, ethnic minority cultural performances and mythological role-playing projects were actively added to further enhance the participation and fun of young audiences in the museum visit.
[0053] To sum up, in this embodiment, the browsing and registration information of the teenager Xiao Wang on the museum website is collected by the system. The system uses a variety of analysis methods to classify Xiao Wang as a cultural experience-oriented youth group based on his interest in ethnic minority culture and mythology-related content, and generates a corresponding portrait. The personalized tour plan fits the route planned according to his interests. In the virtual and real display link, Xiao Wang immerses himself in the colorful cultural atmosphere with the help of virtual scenes, AR content and interactive devices. In the feedback link, Xiao Wang puts forward his expectations, and the system optimizes his portrait and tour plan accordingly. The whole process shows that the system accurately grasps the cultural experience needs of young people, continuously optimizes services, provides young people with a creative and educational cultural exploration journey, and enhances their understanding and love of diverse cultures.
[0054] The above description is only a preferred embodiment of the present invention and does not limit the present invention in any form. Although the present invention has been disclosed as a preferred embodiment as above, it is not used to limit the present invention. Any technical personnel in this field can make some changes or modify the technical contents disclosed above into equivalent embodiments without departing from the scope of the technical solution of the present invention. However, any brief modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention without departing from the content of the technical solution of the present invention are still within the scope of the technical solution of the present invention.
Claims
1. A virtual-real display system for a metaverse museum, characterized in that: The system includes data collection module, data analysis and user portrait module, personalized guide planning module, virtual and real combination display module and feedback and optimization module; The data collection module collects user registration information and historical browsing behavior data through museum websites and mobile application channels, obtains shape data of cultural relics through 3D scanning equipment, collects texture and color data of cultural relics through multi-spectral imaging technology, and digitally organizes historical and cultural background information of cultural relics; The data analysis and user portrait module: cleans and standardizes the collected user data, analyzes the user browsing history through association rule mining, finds out the potential associations in the browsing behavior, divides different behavior groups based on the user's operation behavior on the website and application using a clustering algorithm, calculates the user's explicit interests by analyzing the user's search keywords, mines the implicit interests based on the user's browsing behavior on the exhibits and the characteristic attributes of the exhibits, classifies the users according to their basic information, behavior and interests, and labels the corresponding interest tags for the same type of users; The personalized tour planning module receives data from the data analysis and user portrait modules, divides users into academic research groups, cultural experience groups, and innovative exploration groups according to their interest tags, plans routes for each group, and plans personalized exhibition routes for customers through exhibition route calculation formulas; The virtual-real combination display module: uses 3D modeling software and rendering technology to build a virtual cultural relic model based on cultural relic collection data, provides users with personalized guided paths in the virtual museum according to the determined user interests and visiting routes, and builds virtual museum scenes according to different historical periods and cultural backgrounds, uses image recognition and positioning technology to accurately match AR content with physical exhibits, pushes personalized AR content based on user portraits, and sets up interactive devices and multi-sensory experience facilities in the physical exhibition hall; The feedback and optimization module collects user feedback data through online questionnaires, in-application feedback functions and on-site feedback, and classifies and organizes the user feedback data, adjusts user portraits and navigation plans based on user feedback, and improves and upgrades display technology and interactive functions.
2. A virtual-real combination display system of a metaverse museum according to claim 1, characterized in that: The data analysis and user portrait module uses the association rule mining algorithm to discover the potential associations in user browsing behaviors. Suppose the user set is U = {u1, u2, ..., u n }, the exhibit set is I = {i1, i2, ..., i m }, the user's browsing behavior on the exhibits is represented by a binary relationship matrix R = (r ij ) indicates that r ij =1 indicates user u i Viewed exhibits j ,r ij = 0 means no browsing. Define the support and confidence indicators to measure the degree of association between exhibits. For exhibit i a and i b , and its support calculation formula is: Indicates that you have viewed exhibits at the same time a and i b The proportion of users to the total number of users, the confidence calculation formula is: Indicates that you have viewed the exhibits a Of the users, also viewed exhibit i b The proportion of users is calculated by setting the support threshold T Support and the confidence threshold T Confidencet , and dig out exhibit pairs with strong correlation.
3. The virtual-real combination display system of the Metaverse Museum according to claim 1 is characterized in that: In the data analysis and user portrait module, users are divided into different behavior groups based on their operation behaviors on websites and applications through the user behavior similarity formula. Suppose the operation behavior feature vectors of user i and user j are and Define user similarity as S ij , the calculation formula is: Set the similarity threshold T, when S ij When ≥T, user i and user j are classified into the same category.
4. The virtual-real combination display system of the Metaverse Museum according to claim 1 is characterized in that: The data analysis and user portrait module calculates the user's explicit interest in the exhibits through the explicit interest calculation formula. Suppose all different keyword sets are W = {w1, w2, ..., w q }, for user u i The search keyword vector is V i =(v i1 , v i2 , …, v iq ), where v ij Indicates keyword w j In user u i The frequency of occurrence in the search history of is:
5. The virtual-real combination display system of the Metaverse Museum according to claim 1 is characterized in that: In the data analysis and user portrait module, the implicit interest calculation formula is used to calculate the user's implicit interest in the exhibits. Let the feature vector of the exhibit be P j =(p j1 , p j2 ,…,p jr ), for user u i and exhibit j, calculated as:
6. The virtual-real combination display system of the Metaverse Museum according to claim 1 is characterized in that: The personalized tour planning module includes route planning for academic research groups: screening of cultural relics with high academic value and representing key technologies of a specific historical period, designing tour routes based on the logical sequence of academic research and the inherent knowledge relationships between cultural relics, providing professional research reports, paper databases, in-depth interpretation lectures by experts, and setting up an online academic exchange community.
7. The virtual-real combination display system of the Metaverse Museum according to claim 1 is characterized in that: The personalized tour planning module includes planning of routes for cultural experience groups: selecting regional handicrafts, traditional festival objects and cultural relics with rich cultural connotations; the tour route design focuses on creating cultural context and emotional atmosphere; the tour content is mainly in the form of vivid storytelling, on-site demonstrations by cultural inheritors and recorded video explanations.
8. The virtual-real combination display system of the Metaverse Museum according to claim 1 is characterized in that: The personalized tour planning module plans routes for innovative and exploratory groups: 3D printed cultural relic models and modern creative works with traditional elements are selected. The planning of the tour routes is full of modernity and technology, and creative workshops and interactive experience areas are set up.
9. The virtual-real combination display system of the Metaverse Museum according to claim 1 is characterized in that: The personalized tour guide planning module plans a personalized exhibition route for the customer through the exhibition route calculation formula. Suppose the exhibition route R = (e1, e2, ..., e n ), where e i represents the i-th exhibit in the route, and calculates the comprehensive interest of user u in exhibit ei I(u, e i ), the formula is: I(u, e i )=α×XQ x (u,e i )+(1-a)×XQ y (u,e i ), where α is the weight coefficient, XQ x (u,e i ) represents user u’s interest in exhibit e i The explicit interest of XQ y (u,e i ) represents user u’s interest in exhibit e i The implicit interest of exhibition route R is used to calculate the interest I(u, R) of user u. The formula is: where w i Exhibit e i The weight in the route, choose I(u, e i ) value is taken as the personalized exhibition route of user u.
Citation Information
Cited By
Interaction method and system applied to painting and calligraphy exhibition
CN120279221A
Dynamic exhibition system for digital museum exhibits
CN120318476A
Digital twinning-based literature and blog exhibition hall virtual-real fusion guide system and method
CN120599187A
Virtual-reality fusion guide system and method for cultural and museum exhibition halls based on digital twins
CN120599187B
Cultural heritage virtual reconstruction display system based on element universe
CN120689558A