A method and system for the interaction between virtual digital cultural relics and audiences

By combining gesture capture and voice recognition technology, user input is monitored in real time, and high-quality virtual digital cultural relics scenes are retrieved and displayed, the problem of insufficient interactivity and rendering quality in virtual digital cultural relics display is solved, and user experience and cultural relics protection efficiency is improved.

CN119759215BActive Publication Date: 2025-07-04POLY CULTURE COMM CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510259324.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-03-06
Publication Date
2025-07-04
Estimated Expiration
2045-03-06

AI Technical Summary

Technical Problem

The existing virtual digital cultural relics display methods lack deep interaction and immersion, insufficient user experience, and the rendering quality and interaction methods need to be improved.

Method used

Through gesture capture and speech recognition technology, user input is monitored in real time, target cultural relics information is obtained, and high-quality rendered virtual scenes are retrieved according to user needs, for rendering quality detection and synthetic display.

Benefits of technology

It improves the audience's participation and immersion, provides rich cultural relics information and viewing experience, and reduces the difficulty and cost of cultural relics protection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119759215B_ABST
    Figure CN119759215B_ABST
Patent Text Reader

Abstract

The present invention provides an interaction method and system between virtual digital cultural relics and audiences. The interaction method between the virtual digital cultural relics and audiences includes: real-time monitoring of the user's gesture and voice inputs through a gesture capture device and a voice acquisition device, and obtaining the target cultural relic information required by the user currently through the user's gesture and voice inputs; retrieving the virtual scene that has been rendered corresponding to the target cultural relic information according to the target cultural relic information required by the user, and performing a rendering quality detection on the virtual scene that has been rendered; when the virtual scene that has been rendered meets the requirements of the rendering instruction, synthesizing a virtual scene with cultural relic data by using the cultural relic data corresponding to the target cultural relic information and the virtual scene that has been rendered, and performing a visual display. The system includes modules corresponding to the method steps.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention provides an interaction method and system between virtual digital cultural relics and audiences, belonging to the technical field of virtual digital interaction. Background Art

[0002] With the rapid development of information technology and the wide application of digital technology, the protection and inheritance of cultural heritage have entered a new digital era. Traditionally, the display and viewing of cultural relics are limited by physical space and time, making it difficult for the general public to access precious cultural relic resources anytime and anywhere. To overcome this limitation, virtual digital cultural relic technology has emerged. It transforms physical cultural relics into virtual objects that can be displayed and interacted with in the digital space through high-precision scanning, modeling, and rendering technologies. However, most of the existing virtual digital cultural relic display methods stay at the level of static display or simple click interaction, lacking in-depth interactivity and immersion, and it is difficult to fully stimulate the interest and participation of audiences. In addition, although existing technologies can achieve a certain degree of interaction, they often rely on traditional input devices such as mice and keyboards, and these methods have certain limitations in user experience, especially for audiences who hope to interact with cultural relics in a more natural and intuitive way. Moreover, the rendering quality of virtual scenes is crucial for providing a high-quality interaction experience. Different cultural relics have different requirements for rendering technology due to factors such as their materials, textures, and lighting conditions. Therefore, how to quickly retrieve and display a virtual scene with high-quality rendering according to the characteristics of the target cultural relic, while ensuring the efficiency and stability of the rendering process, is another problem that needs to be solved.

[0003] Since the existing virtual digital cultural relic display technology still needs to be improved in terms of interaction methods, rendering quality, and user experience. Therefore, developing an interaction method for virtual digital cultural relics that can combine gesture capture and speech recognition technologies, real-time monitor user input, and quickly retrieve and display virtual digital cultural relics with high-quality rendering according to user needs is of great significance for promoting the digital protection and inheritance of cultural heritage and improving the participation and experience quality of audiences. Summary of the Invention

[0004] The present invention provides an interaction method and system between virtual digital cultural relics and audiences to solve the technical problems existing in the above-mentioned prior art. The adopted technical solutions are as follows:

[0005] An interaction method between virtual digital cultural relics and audiences, the interaction method between virtual digital cultural relics and audiences includes:

[0006] Real-time monitor the gesture and speech inputs of users through a gesture capture device and a voice collection device, and obtain the target cultural relic information required by the user currently through the gesture and speech inputs of the user;

[0007] Retrieve the rendered virtual scene corresponding to the target cultural relic information required by the user, and perform rendering quality detection on the rendered virtual scene;

[0008] When the rendered virtual scene meets the requirements of the rendering instruction, synthesize a virtual scene with cultural relic data using the cultural relic data corresponding to the target cultural relic information and the rendered virtual scene, and perform visual display.

[0009] Further, real-time monitor the user's gestures and voice inputs through a gesture capture device and a voice collection device, and obtain the target cultural relic information currently required by the user through the user's gestures and voice inputs, including:

[0010] Initialize the gesture capture device and the voice collection device;

[0011] Capture the user's hand movements through the accelerometer and gyroscope set inside the gesture capture device;

[0012] Use the predefined gesture recognition algorithm in the data processing unit set inside the gesture capture device to perform gesture recognition on the captured user's hand movements, and determine the user's hand sliding position;

[0013] Obtain the cultural relic information corresponding to the hand sliding position according to the user's hand sliding position, and use the cultural relic information corresponding to the hand sliding position as the first cultural relic data information;

[0014] Real-time collect the user's voice command information through the voice collection device;

[0015] Convert the user's voice command information into a voice digital signal, and perform noise filtering and sound enhancement processing on the voice digital signal corresponding to the voice command information to obtain the processed voice digital signal;

[0016] Convert the voice digital signal into text data, and perform text recognition on the text data to obtain the second cultural relic data information currently required by the user;

[0017] Determine the target cultural relic information from the first cultural relic data information and the second cultural relic data information.

[0018] Further, determining the target cultural relic information from the first cultural relic data information and the second cultural relic data information includes:

[0019] When the cultural relic information included in the first cultural relic data information and the second cultural relic data information is the same, then use the cultural relic information jointly determined by the first cultural relic data information and the second cultural relic data information as the target cultural relic information;

[0020] When the cultural relic information included in the first cultural relic data information and the second cultural relic data information is different, the target cultural relic information is determined according to the generation times corresponding to the first cultural relic data information and the second cultural relic data information.

[0021] Further, when the cultural relic information included in the first cultural relic data information and the second cultural relic data information is different, determining the target cultural relic information according to the generation times corresponding to the first cultural relic data information and the second cultural relic data information includes:

[0022] Extract the generation time of the first cultural relic data information;

[0023] Extract the starting acquisition time of the hand movement corresponding to the first cultural relic data information;

[0024] Retrieve the virtual scene data and cultural relic background data corresponding to the first cultural relic data information;

[0025] Extract the generation time of the second cultural relic data information;

[0026] Extract the starting acquisition time of the voice command information corresponding to the second cultural relic data information;

[0027] Retrieve the virtual scene data and cultural relic background data corresponding to the second cultural relic data information;

[0028] Obtain the generation time index coefficient corresponding to the first cultural relic data information by using the generation time of the first cultural relic data information and the starting acquisition time of the hand movement corresponding to the first cultural relic data information;

[0029] Among them, the generation time index coefficient corresponding to the first cultural relic data information is obtained through the following formula:

[0030]

[0031] Among them, S 01 represents the generation time index coefficient corresponding to the first cultural relic data information; I 01 represents the operation intention intensity corresponding to the first cultural relic data information; C 01 represents the cultural relic data complexity corresponding to the first cultural relic data information; t q01 represents the starting acquisition time of the hand movement corresponding to the first cultural relic data information; t s01 represents the generation time of the first cultural relic data information; I 01 represents the operation intention intensity corresponding to the first cultural relic data information;

[0032] Among them, the operation intention intensity corresponding to the first cultural relic data information is obtained through the following formula:

[0033]

[0034] Among them, C 01 represents the complexity of the cultural relic data corresponding to the first cultural relic data information; w 01 and w 02 represent the first weight coefficient and the second weight coefficient corresponding to the first cultural relic data information; F 01 represents the data volume of the virtual scene data corresponding to the first cultural relic data information; F c represents the preset data volume reference value; T 01 represents the virtual scene video duration of the virtual scene data corresponding to the first cultural relic data information; T c represents the preset duration reference value; M 01 represents the number of pictures included in the cultural relic background data corresponding to the first cultural relic data information; M c represents the preset number of pictures reference value;

[0035] And, the operation intention intensity corresponding to the first cultural relic data information is obtained through the following formula:

[0036]

[0037] Among them, I 01 represents the operation intention intensity corresponding to the first cultural relic data information; w 03 、 w 04 and w 05 respectively represent the third weight coefficient, the fourth weight coefficient and the fifth weight coefficient corresponding to the first cultural relic data information; f 01 represents the generated access frequency of the user to the first cultural relic data information; D 01 represents the generated browsing duration of the user to the first cultural relic data information; R 01 represents the proportion of the number of repeated selections of the user for the first cultural relic data information in the total number of all cultural relics selected by the user; f x represents the overall access frequency of the first cultural relic data information;D x Indicates the total browsing duration of the first cultural relic data information; R x Indicates the proportion of the first cultural relic data information that is repeatedly selected by the same user;

[0038] Obtain the generation time index coefficient corresponding to the second cultural relic data information by using the generation time of the second cultural relic data information and the starting acquisition time of the hand movement corresponding to the second cultural relic data information;

[0039] Among them, the generation time index coefficient corresponding to the second cultural relic data information is obtained through the following formula:

[0040]

[0041] Among them, S 02 Indicates the generation time index coefficient corresponding to the second cultural relic data information; I 02 Indicates the operation intention intensity corresponding to the second cultural relic data information; C 02 Indicates the cultural relic data complexity corresponding to the second cultural relic data information; t q02 Indicates the starting acquisition time of the voice command information corresponding to the second cultural relic data information; t s02 Indicates the generation time of the second cultural relic data information; I 02 Indicates the operation intention intensity corresponding to the second cultural relic data information;

[0042] Among them, the operation intention intensity corresponding to the second cultural relic data information is obtained through the following formula:

[0043]

[0044] Among them, C 02 Indicates the cultural relic data complexity corresponding to the first cultural relic data information; k 01 and k 02 Indicates the first weight coefficient and the second weight coefficient corresponding to the second cultural relic data information; F 02 Indicates the data volume of the virtual scene data corresponding to the second cultural relic data information; F c Indicates the preset data volume reference value; T 02 Indicates the virtual scene video duration of the virtual scene data corresponding to the second cultural relic data information; Tc Indicates a preset duration reference value; M 02 Indicates the number of pictures included in the cultural relic background data corresponding to the second cultural relic data information; M c Indicates a preset picture quantity reference value;

[0045] Moreover, the operation intention intensity corresponding to the second cultural relic data information is obtained through the following formula:

[0046]

[0047] Wherein, I 02 Indicates the operation intention intensity corresponding to the second cultural relic data information; k 03 , k 04 and k 05 respectively indicate the third weight coefficient, the fourth weight coefficient, and the fifth weight coefficient corresponding to the second cultural relic data information; f 02 Indicates the generated access frequency of the user for the second cultural relic data information; D 02 Indicates the generated browsing duration of the user for the second cultural relic data information; R 02 Indicates the proportion of the number of times the second cultural relic data information is repeatedly selected by the same user in the total number of times all cultural relics are selected by the user; f x Indicates the overall access frequency of the second cultural relic data information; D x Indicates the total browsing duration of the second cultural relic data information; R x Indicates the proportion of the second cultural relic data information being repeatedly selected by the same user;

[0048] Compare the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information to obtain a comparison result;

[0049] Determine the target cultural relic information according to the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information.

[0050] Furthermore, determining the target cultural relic information according to the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information includes:

[0051] Compare the generation time corresponding to the first cultural relic data information with the generation time corresponding to the second cultural relic data information to obtain a generation time difference;

[0052] Compare the generation time difference with a preset time difference threshold;

[0053] When the generation time difference exceeds the preset time difference threshold, extract the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information;

[0054] Compare the coefficient difference corresponding to the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information with a preset coefficient difference threshold;

[0055] When the coefficient difference between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information is less than the preset coefficient difference threshold, determine the cultural relic data information with the later generation time among the generation time corresponding to the first cultural relic data information and the generation time corresponding to the second cultural relic data information as the target cultural relic information;

[0056] When the coefficient difference between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information is not less than the preset coefficient difference threshold, determine the cultural relic data information corresponding to the maximum coefficient value among the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information as the target cultural relic information;

[0057] When the generation time difference does not exceed the preset time difference threshold, determine the cultural relic data information corresponding to the minimum coefficient value among the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information as the target cultural relic information.

[0058] Further, retrieve the virtual scene that has been rendered corresponding to the target cultural relic information required by the user, and perform rendering quality detection on the rendered virtual scene, including:

[0059] Retrieve the virtual scene that has been rendered corresponding to the target cultural relic information required by the user;

[0060] Retrieve the scene parameters of the rendered virtual scene; wherein, the scene parameters include frame rate, dynamic range value, and resolution;

[0061] Obtain the rendering quality evaluation coefficient corresponding to the rendered virtual scene by using the scene parameters of the rendered virtual scene;

[0062] Compare the rendering quality evaluation coefficient corresponding to the rendered virtual scene with a preset evaluation coefficient threshold;

[0063] When the rendering quality evaluation coefficient corresponding to the rendered virtual scene is lower than the preset evaluation coefficient threshold, re-render.

[0064] Further, obtaining the rendering quality evaluation coefficient corresponding to the rendered virtual scene by using the scene parameters of the rendered virtual scene includes:

[0065] Retrieve the resolution included in the scene parameters;

[0066] Compare the resolution with a preset resolution threshold;

[0067] When the resolution is lower than the preset resolution threshold, obtain the rendering quality evaluation coefficient by using the frame rate and dynamic range included in the scene parameters;

[0068] Among them, the rendering quality evaluation coefficient is obtained through the following formula:

[0069]

[0070] Among them, Q represents the rendering quality evaluation coefficient; G represents the frame rate; K represents the dynamic range; α 、 β and γ represent the first adjustment coefficient, the second adjustment coefficient, and the third adjustment coefficient respectively, and the value ranges of the first adjustment coefficient, the second adjustment coefficient, and the third adjustment coefficient are: 0.50 - 2.00, 1.21 - 1.82, and 0.34 - 0.63;

[0071] When the resolution is not lower than the preset resolution threshold, obtain the rendering quality evaluation coefficient by using the frame rate, dynamic range, and resolution included in the scene parameters;

[0072] Among them, the rendering quality evaluation coefficient is obtained through the following formula:

[0073]

[0074] Among them, Q represents the rendering quality evaluation coefficient; G represents the frame rate; K represents the dynamic range; Yrepresents the resolution; Y 0 represents a preset resolution threshold; Y max represents the desired resolution; θ and δ respectively represent a first adjustment factor and a second adjustment factor, and the value ranges of the first adjustment factor and the second adjustment factor are 0.48 - 0.73 and 0.17 - 0.42 respectively.

[0075] Further, when the rendered virtual scene meets the requirements of the rendering instruction, a virtual scene with cultural relic data is synthesized using the cultural relic data corresponding to the target cultural relic information and the rendered virtual scene, and visual display is performed, including:

[0076] When the rendered virtual scene meets the requirements of the rendering instruction, the cultural relic data corresponding to the target cultural relic information is retrieved from the database;

[0077] The cultural relic data corresponding to the target cultural relic information is fused with the rendered virtual scene corresponding to the target cultural relic information to generate a virtual scene with cultural relic data;

[0078] The virtual scene is visually displayed.

[0079] Further, fusing the cultural relic data corresponding to the target cultural relic information with the rendered virtual scene corresponding to the target cultural relic information to generate a virtual scene with cultural relic data includes:

[0080] Converting the cultural relic data corresponding to the target cultural relic information into a data format matching the rendered virtual scene corresponding to the target cultural relic information;

[0081] Defining an anchor point in the rendered virtual scene corresponding to the target cultural relic information;

[0082] Mapping the cultural relic data corresponding to the target cultural relic information to the anchor point corresponding to the rendered virtual scene corresponding to the target cultural relic information.

[0083] Further, the interaction method between the virtual digital cultural relic and the audience further includes:

[0084] Real - time receiving of user's QR - code scanning information, entering the time - line corresponding to the QR - code scanning information according to the user's QR - code scanning information, and displaying the cultural relics, historical eras, relevant historical events and cultural stories corresponding to the time - line;

[0085] Real - time receiving of user's QR - code scanning information, entering the cultural story corresponding to the QR - code scanning information according to the user's QR - code scanning information, and automatically telling the cultural story;

[0086] Receive the user's QR code scanning information in real time, and enter the expert lecture live platform corresponding to the QR code information according to the user's QR code scanning information to play the expert online lecture or seminar online;

[0087] Set up a cultural relic interaction platform for users to interact and ask questions on the cultural relic interaction platform.

[0088] An interactive system between virtual digital cultural relics and audiences, the interactive system between virtual digital cultural relics and audiences includes:

[0089] A target cultural relic information acquisition module, which is used to monitor the user's gesture and voice input in real time through a gesture capture device and a voice collection device, and obtain the target cultural relic information required by the user currently through the user's gesture and voice input;

[0090] A virtual scene quality detection module, which is used to retrieve the rendered virtual scene corresponding to the target cultural relic information according to the target cultural relic information required by the user, and perform rendering quality detection on the rendered virtual scene;

[0091] A virtual scene visualization display module, which is used to synthesize a virtual scene with cultural relic data by using the cultural relic data corresponding to the target cultural relic information and the rendered virtual scene when the rendered virtual scene meets the requirements of the rendering instruction, and perform visual display.

[0092] Advantages of the present invention:

[0093] An interactive method and system between virtual digital cultural relics and audiences provided by the present invention enable audiences to interact with virtual digital cultural relics in a more natural and intuitive way through gesture capture and voice recognition technologies, thereby greatly improving the audience's participation and experience quality. High-quality rendering technology and visual display enable audiences to view cultural relics as if they were on the spot, enhancing the audience's sense of immersion and substitution. Virtual digital cultural relic technology can provide rich cultural relic information and viewing experiences for audiences without damaging physical cultural relics, thereby reducing the difficulty and cost of cultural relic protection. This technical solution can be applied to cultural venues such as museums and libraries, as well as fields such as education and tourism, providing broader channels and possibilities for the protection and dissemination of cultural heritage. Description of the Drawings

[0094] Figure 1 Is the flowchart of the method described in the present invention;

[0095] Figure 2 Is the system block diagram of the system described in the present invention. Detailed Embodiments

[0096] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only for the purpose of illustrating and explaining the present invention, and are not intended to limit the present invention.

[0097] An embodiment of the present invention provides an interaction method between virtual digital cultural relics and audiences, as Figure 1 shown. The interaction method between the virtual digital cultural relics and the audiences includes:

[0098] S1. Real-time monitor the user's gesture and voice inputs through a gesture capture device and a voice collection device, and obtain the target cultural relic information required by the user currently through the user's gesture and voice inputs; wherein, the gesture capture device includes but is not limited to VR controllers or gloves, etc.; the voice collection device includes but is not limited to microphones, etc.;

[0099] S2. Retrieve the already-rendered virtual scene corresponding to the target cultural relic information according to the target cultural relic information required by the user, and perform a rendering quality detection on the already-rendered virtual scene;

[0100] S3. When the already-rendered virtual scene meets the requirements of the rendering instruction, synthesize a virtual scene with cultural relic data by using the cultural relic data corresponding to the target cultural relic information and the already-rendered virtual scene, and perform a visual display.

[0101] The working principle of the above technical solution is as follows: The gesture capture device (such as VR controllers, gloves, etc.) captures the user's hand movements in real time through built-in sensors and converts these movements into digital signals. The voice collection device (such as a microphone) is responsible for capturing the user's voice input and converting it into text or instructions through voice recognition technology. The system analyzes the user's intention based on the captured gestures and recognized voice content, so as to determine the target cultural relic information required by the user currently. Once the target cultural relic information is determined, the system retrieves the already-rendered virtual scene corresponding to the cultural relic from the database. Before the display, the system performs a rendering quality detection on these virtual scenes to ensure that they meet the requirements of the rendering instruction, including the performance in aspects such as scene details, lighting effects, and color restoration. If the rendering quality of the virtual scene does not meet the requirements, the system may perform necessary optimizations or re-renderings to ensure the high quality of the final display effect. When the rendering quality of the virtual scene meets the requirements, the system synthesizes the cultural relic data corresponding to the target cultural relic information with the already-rendered virtual scene. The synthesized virtual scene will contain rich cultural relic information, such as the shape, texture, color, etc. of the cultural relic, as well as the related historical background, manufacturing process, etc. Finally, the system presents the synthesized virtual scene to the audience through visual display technology (such as virtual reality headsets, large-screen displays, etc.), enabling the audience to watch and understand the cultural relics immersive.

[0102] The effects of the above technical solution are as follows: Through gesture capture and speech recognition technologies, audiences can interact with virtual digital cultural relics in a more natural and intuitive way, thus greatly enhancing the audience's participation and experience quality. High-quality rendering technologies and visual displays enable audiences to view cultural relics as if they were on the spot, enhancing the audience's sense of immersion and substitution. The virtual digital cultural relics technology can provide rich cultural relic information and viewing experiences for audiences without damaging the physical cultural relics, thereby reducing the difficulty and cost of cultural relic protection. This technical solution can be applied to cultural venues such as museums and libraries, as well as fields such as education and tourism, providing broader channels and possibilities for the protection and dissemination of cultural heritage.

[0103] In summary, by combining advanced technologies such as gesture capture, speech recognition, and rendering quality detection, this technical solution realizes the in-depth interaction and high-quality display between virtual digital cultural relics and audiences, providing strong support for the digital protection and inheritance of cultural heritage.

[0104] In one embodiment of the present invention, a gesture capture device and a voice acquisition device are used to monitor the user's gestures and voice inputs in real time, and the target cultural relic information required by the user is obtained through the user's gestures and voice inputs, including:

[0105] S101. Initialize the gesture capture device and the voice acquisition device;

[0106] S102. Capture the user's hand movements through the accelerometer and gyroscope set inside the gesture capture device;

[0107] S103. Use a predefined gesture recognition algorithm by the data processing unit set inside the gesture capture device to perform gesture recognition on the captured user's hand movements to determine the user's hand sliding position; wherein, the gesture recognition algorithm includes but is not limited to traditional gesture recognition algorithms such as decision trees, support vector machines, K-nearest neighbors, random forests, and hidden Markov models, and, gesture recognition algorithms based on deep learning such as convolutional neural networks, recurrent neural networks, long short-term memory networks, and 3D convolutional neural networks;

[0108] S104. Obtain the cultural relic information corresponding to the hand sliding position according to the user's hand sliding position, and use the cultural relic information corresponding to the hand sliding position as the first cultural relic data information;

[0109] S105. Real-time collect the user's voice command information through the voice acquisition device;

[0110] S106. Convert the user's voice command information into a voice digital signal, and perform noise filtering and sound enhancement processing on the voice digital signal corresponding to the voice command information to obtain the processed voice digital signal;

[0111] S107. Convert the voice digital signal into text data, perform text recognition on the text data, and obtain the second cultural relic data information required by the user currently;

[0112] S108. Determine the target cultural relic information from the first cultural relic data information and the second cultural relic data information.

[0113] The working principle of the above technical solution is as follows: Initialize the gesture capture device and the voice collection device to ensure that the devices are in a normal working state and can accurately capture and collect the user's gestures and voice inputs. Utilize sensors such as the accelerometer and gyroscope inside the gesture capture device to capture the user's hand movements in real time, including hand movements and rotations. Through the data processing unit inside the gesture capture device, use predefined gesture recognition algorithms (including traditional algorithms and deep learning-based algorithms) to recognize the captured hand movements. Determine the user's hand sliding position, that is, the position indicated by the user in the virtual space through gestures. According to the user's hand sliding position, retrieve the cultural relic information corresponding to this position from the database. Take the retrieved cultural relic information as the first cultural relic data information. Collect the user's voice command information in real time through the voice collection device. Convert the collected voice command information into a voice digital signal. Perform noise filtering and sound enhancement processing on the voice digital signal to improve the accuracy of voice recognition. Convert the processed voice digital signal into text data. Perform text recognition on the text data and parse out the cultural relic information required by the user currently. Take the parsed cultural relic information as the second cultural relic data information. Combine the first cultural relic data information and the second cultural relic data information to determine the target cultural relic information required by the user currently.

[0114] The effects of the above technical solution are as follows: By combining gesture capture and voice recognition technologies, it can capture the user's input intention more accurately, improve the accuracy and reliability of interaction. The user can interact with virtual cultural relics in a more natural and intuitive gesture and voice manner, enhancing the user's sense of participation and immersion. Through the dual input methods of gestures and voices, the user can locate the required cultural relic information more quickly, improving the efficiency of information retrieval. This technical solution supports a variety of gesture recognition algorithms and voice recognition algorithms, and can be flexibly configured and optimized according to different application scenarios and user requirements. This technical solution provides strong technical support for the digital display and interaction of cultural heritage, and helps to promote the protection and inheritance of cultural heritage.

[0115] In summary, through the combination of gesture capture and voice recognition technologies, this technical solution realizes the natural and intuitive interaction between the user and virtual cultural relics, improves the accuracy of interaction and the user experience, and at the same time promotes the development of digital display and interaction technologies for cultural heritage.

[0116] In an embodiment of the present invention, determining target artifact information from the first artifact data information and the second artifact data information includes:

[0117] S1081. When the artifact information included in the first artifact data information and the second artifact data information is the same, the artifact information jointly determined by the first artifact data information and the second artifact data information is used as the target artifact information;

[0118] S1082. When the artifact information included in the first artifact data information and the second artifact data information is different, the target artifact information is determined according to the generation times corresponding to the first artifact data information and the second artifact data information.

[0119] The working principle of the above technical solution is as follows: When the artifact information included in the first artifact data information and the second artifact data information is the same, the system believes that both types of information accurately reflect the target artifact information required by the user. In this case, the system uses the artifact information jointly determined by the first artifact data information and the second artifact data information as the target artifact information. This means that if both input methods (gesture and voice) point to the same artifact information, the system regards this information as the final target artifact information. When the artifact information included in the first artifact data information and the second artifact data information is different, the system needs to make a further judgment. In this case, the system determines the target artifact information according to the generation times corresponding to the first artifact data information and the second artifact data information. The generation time usually refers to the time point when the information is captured or recorded by the system. The system may adopt strategies such as "latest information first" or "preset rule first" for judgment. For example, if the system is set to "latest information first", it will select the information with the latest generation time as the target artifact information; if the system has preset rules (such as giving priority to gesture input or voice input), it will make a judgment according to these rules.

[0120] The effects of the above technical solution are as follows: By comparing the first artifact data information and the second artifact data information, the system can more accurately determine the target artifact information required by the user. When both input methods point to the same information, the judgment of the system is more reliable. This technical solution allows the user to input through both gesture and voice methods, improving the flexibility of interaction. The user can choose the input method according to their own preferences and habits, or use different input methods in different scenarios. When there is a conflict between the first artifact data information and the second artifact data information, the system can make a judgment according to the generation time or preset rules, thus solving the problem of information conflict. This helps to improve the stability and reliability of the system. By providing multiple input methods and an intelligent information processing mechanism, this technical solution can enhance the user experience. The user can interact with the system more easily and quickly obtain the required information.

[0121] In summary, this technical solution determines the target cultural relic information by comparing and judging the content and generation time of the first cultural relic data information and the second cultural relic data information, improving the accuracy of information and the flexibility of interaction. At the same time, it solves the problem of information conflict and enhances the user experience.

[0122] In one embodiment of the present invention, when the cultural relic information contained in the first cultural relic data information and the second cultural relic data information is different, the target cultural relic information is determined according to the generation time corresponding to the first cultural relic data information and the second cultural relic data information, including:

[0123] Step 1: Extract the generation time of the first cultural relic data information;

[0124] Step 2: Extract the starting acquisition time of the hand movement corresponding to the first cultural relic data information;

[0125] Step 3: Retrieve the virtual scene data and cultural relic background data corresponding to the first cultural relic data information;

[0126] Step 4: Extract the generation time of the second cultural relic data information;

[0127] Step 5: Extract the starting acquisition time of the voice command information corresponding to the second cultural relic data information;

[0128] Step 6: Retrieve the virtual scene data and cultural relic background data corresponding to the second cultural relic data information;

[0129] Step 7: Obtain the generation time index coefficient corresponding to the first cultural relic data information by using the generation time of the first cultural relic data information and the starting acquisition time of the hand movement corresponding to the first cultural relic data information;

[0130] Among them, the generation time index coefficient corresponding to the first cultural relic data information is obtained through the following formula:

[0131]

[0132] Among them, S 01 represents the generation time index coefficient corresponding to the first cultural relic data information; I 01 represents the operation intention intensity corresponding to the first cultural relic data information; C 01 represents the cultural relic data complexity corresponding to the first cultural relic data information; t q01 represents the starting acquisition time of the hand movement corresponding to the first cultural relic data information; t s01Indicates the generation time of the first cultural relic data information; I 01 Indicates the operation intention intensity corresponding to the first cultural relic data information;

[0133] Among them, the operation intention intensity corresponding to the first cultural relic data information is obtained through the following formula:

[0134]

[0135] Among them, C 01 Indicates the complexity of the cultural relic data corresponding to the first cultural relic data information; w 01 and w 02 Indicates the first weight coefficient and the second weight coefficient corresponding to the first cultural relic data information; F 01 Indicates the data volume of the virtual scene data corresponding to the first cultural relic data information; F c Indicates a preset data volume reference value; T 01 Indicates the virtual scene video duration of the virtual scene data corresponding to the first cultural relic data information; T c Indicates a preset duration reference value; M 01 Indicates the number of pictures included in the cultural relic background data corresponding to the first cultural relic data information; M c Indicates a preset number of pictures reference value;

[0136] And, the operation intention intensity corresponding to the first cultural relic data information is obtained through the following formula:

[0137]

[0138] Among them, I 01 Indicates the operation intention intensity corresponding to the first cultural relic data information; w 03 、 w 04 and w 05 respectively indicate the third weight coefficient, the fourth weight coefficient and the fifth weight coefficient corresponding to the first cultural relic data information; f 01 Indicates the generated access frequency of the user for the first cultural relic data information; D 01 Indicates the generated browsing duration of the user for the first cultural relic data information; R 01Indicates the proportion of the number of times the user repeatedly selects the first cultural relic data information in the total number of times of all cultural relics selected by the user; f x Indicates the overall access frequency of the first cultural relic data information; D x Indicates the total browsing duration of the first cultural relic data information; R x Indicates the proportion of the first cultural relic data information that is repeatedly selected by the same user;

[0139] Step 8, obtain the generation time index coefficient corresponding to the second cultural relic data information by using the generation time of the second cultural relic data information and the starting acquisition time of the hand movement corresponding to the second cultural relic data information;

[0140] Among them, the generation time index coefficient corresponding to the second cultural relic data information is obtained through the following formula:

[0141]

[0142] Among them, S 02 Indicates the generation time index coefficient corresponding to the second cultural relic data information; I 02 Indicates the operation intention intensity corresponding to the second cultural relic data information; C 02 Indicates the cultural relic data complexity corresponding to the second cultural relic data information; t q02 Indicates the starting acquisition time of the voice command information corresponding to the second cultural relic data information; t s02 Indicates the generation time of the second cultural relic data information; I 02 Indicates the operation intention intensity corresponding to the second cultural relic data information;

[0143] Among them, the operation intention intensity corresponding to the second cultural relic data information is obtained through the following formula:

[0144]

[0145] Among them, C 02 Indicates the cultural relic data complexity corresponding to the first cultural relic data information; k 01 and k 02 Indicates the first weight coefficient and the second weight coefficient corresponding to the second cultural relic data information; F 02 Indicates the data volume of the virtual scene data corresponding to the second cultural relic data information; Fc represents a preset reference value of the data volume; T 02 represents the virtual scene video duration of the virtual scene data corresponding to the second cultural relic data information; T c represents a preset reference value of the duration; M 02 represents the number of pictures included in the cultural relic background data corresponding to the second cultural relic data information; M c represents a preset reference value of the number of pictures;

[0146] Moreover, the operation intention intensity corresponding to the second cultural relic data information is obtained through the following formula:

[0147]

[0148] wherein, I 02 represents the operation intention intensity corresponding to the second cultural relic data information; k 03 , k 04 and k 05 respectively represent the third weight coefficient, the fourth weight coefficient and the fifth weight coefficient corresponding to the second cultural relic data information; f 02 represents the generated access frequency of the user for the second cultural relic data information; D 02 represents the generated browsing duration of the user for the second cultural relic data information; R 02 represents the proportion of the number of times the second cultural relic data information is repeatedly selected by the user in the total number of times all cultural relics selected by the user; f x represents the overall access frequency of the second cultural relic data information; D x represents the total browsing duration of the second cultural relic data information; R x represents the proportion of the second cultural relic data information being repeatedly selected by the same user;

[0149] Step 9: Compare the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information to obtain a comparison result;

[0150] Step 10: Determine the target cultural relic information according to the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information.

[0151] The working principle of the above technical solution is as follows: The generation times of the first cultural relic data information and the second cultural relic data information are extracted respectively (i.e., the time points when the information is recorded by the system). At the same time, the starting acquisition time of the hand movement associated with these two types of cultural relic data information (for the first cultural relic data information) and the starting acquisition time of the voice command information (for the second cultural relic data information) are extracted. These times reflect the starting points of user operations. According to the identifiers of the cultural relic data information, the corresponding virtual scene data and cultural relic background data are retrieved from the database. These data provide a basis for evaluating the complexity of the cultural relic data information and the intensity of the user's operation intention. The generation time index coefficients corresponding to the first cultural relic data information and the second cultural relic data information are calculated using a formula. This coefficient synthesizes the complexity of the cultural relic data information, the intensity of the user's operation intention, and the time factor (the difference between the starting acquisition time and the generation time). The complexity of the cultural relic data information is evaluated based on the data volume of the virtual scene data, the duration of the virtual scene video, and the number of pictures in the cultural relic background data. The intensity of the user's operation intention is measured by the access frequency, browsing duration, and the proportion of the number of repeated selections in the total number of all cultural relics selected by the user. The generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information are compared. According to the comparison results, the cultural relic data information with a higher generation time index coefficient is selected as the target cultural relic information. This means that, considering the complexity, operation intention intensity, and time factor comprehensively, this information is more likely to accurately reflect the target cultural relic information required by the user.

[0152] The effects of the above technical solution are as follows: By comprehensively considering the complexity of the cultural relic data information, the intensity of the user's operation intention, and the time factor, this technical solution can more accurately determine the target cultural relic information. This helps to reduce misjudgment cases caused by information conflicts. This technical solution introduces the concept of the generation time index coefficient and evaluates the value of different cultural relic data information through a complex calculation formula. This reflects the system's in-depth understanding of user behavior and the characteristics of cultural relic data information, enhancing the intelligence of the system. By more accurately determining the target cultural relic information, this technical solution can provide more accurate and personalized services for users. This helps to improve user satisfaction and loyalty and enhance users' trust in the system. This technical solution provides new ideas and methods for cultural relic data management. By introducing the time factor and multiple dimensions of consideration, this solution provides a more comprehensive perspective and a more scientific basis for the processing, analysis, and utilization of cultural relic data information.

[0153] On the other hand, this technical solution extracts multiple key elements of the first cultural relic data information and the second cultural relic data information (such as generation time, start collection time of hand movements, start collection time of voice commands, virtual scene data, cultural relic background data, etc.), and conducts complex calculations and analyses based on these elements to ensure the accuracy and comprehensiveness of data processing. By introducing the concept of operation intention intensity and designing a detailed calculation formula for it, this technical solution can quantitatively evaluate the operation intention intensity of users for cultural relic data information. This helps to more accurately understand users' behaviors and needs, so as to provide cultural relic information that better meets users' expectations. The calculation of the generation time index coefficient takes into account multiple factors such as the generation time of cultural relic data information, the start collection time of hand movements or voice commands, and the operation intention intensity. The introduction of this index enables the technical solution to more comprehensively evaluate the timeliness and importance of cultural relic data information. This technical solution can dynamically adjust the calculation methods and parameters according to different situations of the first cultural relic data information and the second cultural relic data information to adapt to different application scenarios and data characteristics. This dynamic adjustment and adaptability make the technical solution more flexible and practical. By comparing the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information, this technical solution can accurately determine the target cultural relic information. This helps to quickly screen out the information that best meets users' needs and expectations from multiple cultural relic data information. The operation intention intensity calculation formula in the technical solution takes into account multiple factors such as users' access frequency, browsing duration, and number of repeated selections, which helps to deeply analyze users' behavior patterns and preferences. This in-depth analysis of users' behaviors can provide strong support for subsequent cultural relic information recommendation and personalized services. The above-mentioned technical solution can process large-scale data sets and shows good performance in practical applications.

[0154] In summary, this technical solution can achieve multiple technical effects such as the accuracy and comprehensiveness of data processing, the quantitative evaluation of operation intention intensity, the introduction of the generation time index coefficient, dynamic adjustment and adaptability, the accurate determination of target cultural relic information, the in-depth analysis of users' behaviors, and calculation efficiency and scalability in terms of performance indicators. These effects act together in the process of processing and analyzing cultural relic data information, helping to improve the overall data processing efficiency and accuracy, and providing users with higher-quality cultural relic information services. At the same time, by comprehensively considering multiple dimensions and time factors of cultural relic data information, this technical solution improves the accuracy of information determination, enhances the intelligence of the system, and provides users with a better service experience. At the same time, this solution also provides new ideas and methods for cultural relic data management, and has broad application prospects and promotion value.

[0155] An embodiment of the present invention determines target cultural relic information according to the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information, including:

[0156] Step 1001: Compare the generation time corresponding to the first cultural relic data information with the generation time corresponding to the second cultural relic data information to obtain a generation time difference;

[0157] Step 1002: Compare the generation time difference with a preset time difference threshold;

[0158] Step 1003: When the generation time difference exceeds the preset time difference threshold, extract the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information;

[0159] Step 1004: Compare the coefficient difference corresponding to the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information with a preset coefficient difference threshold;

[0160] Step 1005: When the coefficient difference between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information is less than the preset coefficient difference threshold, determine the cultural relic data information with the later generation time among the generation time corresponding to the first cultural relic data information and the generation time corresponding to the second cultural relic data information as the target cultural relic information;

[0161] Step 1006: When the coefficient difference between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information is not less than the preset coefficient difference threshold, determine the cultural relic data information corresponding to the maximum coefficient value among the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information as the target cultural relic information;

[0162] Step 1007: When the generation time difference does not exceed the preset time difference threshold, determine the cultural relic data information corresponding to the minimum coefficient value among the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information as the target cultural relic information.

[0163] The working principle of the above technical solution is as follows: First, compare the generation times of the first cultural relic data information and the second cultural relic data information, and calculate the obtained generation time difference. Compare the generated generation time difference with a preset generation time difference threshold. This threshold is used to determine whether the two pieces of cultural relic data information are close enough in time to decide whether more complex comparison logic needs to be considered. If the generation time difference exceeds the preset generation time difference threshold, it indicates that the two pieces of cultural relic data information are far apart in time. At this time, it is necessary to extract the generation time index coefficients corresponding to the first cultural relic data information and the second cultural relic data information and compare them. Compare the difference between the generation time index coefficients with a preset coefficient difference threshold. This threshold is used to determine the closeness of the two pieces of cultural relic data information in terms of the generation time index coefficients. If the coefficient difference is less than the preset coefficient difference threshold and the generation time difference exceeds the preset generation time difference threshold, it indicates that although the two pieces of cultural relic data information are far apart in time, they are very close in terms of the generation time index coefficients. At this time, select the cultural relic data information with the later generation time as the target cultural relic information because it may represent the user's latest intention or operation. If the coefficient difference is not less than the preset coefficient difference threshold and the generation time difference exceeds the preset generation time difference threshold, it indicates that there are significant differences in the generation time index coefficients between the two pieces of cultural relic data information. At this time, select the cultural relic data information with the larger generation time index coefficient as the target cultural relic information because it may more accurately reflect the user's intention or operation. If the generation time difference does not exceed the preset generation time difference threshold, it indicates that the two pieces of cultural relic data information are very close in time. At this time, select the cultural relic data information with the smaller generation time index coefficient as the target cultural relic information, perhaps based on the assumption that within a similar time, users are more inclined to choose content with simpler operations or more intuitive information.

[0164] The effects of the above technical solution are as follows: By comprehensively considering the generation time and the generation time index coefficient, this technical solution can more accurately determine the target cultural relic information and reduce misjudgment situations caused by information conflicts. This technical solution provides multiple judgment logics and can be flexibly selected according to the actual situation of the cultural relic data information, so as to adapt to different application scenarios and user needs. By more accurately determining the target cultural relic information, this technical solution can provide more accurate and personalized services for users, improving user satisfaction and loyalty. This technical solution makes quick judgments through preset thresholds, avoiding unnecessary complex calculations and improving data processing efficiency.

[0165] In summary, by comprehensively considering the generation time and the generation time index coefficient, this technical solution improves the accuracy of information determination, enhances the flexibility of the system, optimizes the user experience, and improves data processing efficiency. These technical effects make this technical solution have broad application prospects and promotion value in the field of cultural relic data information management and processing.

[0166] In an embodiment of the present invention, the virtual scene that has been rendered corresponding to the target cultural relic information required by the user is retrieved, and the rendering quality of the rendered virtual scene is detected, including:

[0167] S201. Retrieve the virtual scene that has been rendered corresponding to the target cultural relic information required by the user;

[0168] S202. Retrieve the scene parameters of the rendered virtual scene; wherein, the scene parameters include frame rate, dynamic range value, and resolution;

[0169] S203. Obtain the rendering quality evaluation coefficient corresponding to the rendered virtual scene by using the scene parameters of the rendered virtual scene;

[0170] S204. Compare the rendering quality evaluation coefficient corresponding to the rendered virtual scene with a preset evaluation coefficient threshold;

[0171] S205. When the rendering quality evaluation coefficient corresponding to the rendered virtual scene is lower than the preset evaluation coefficient threshold, re-render.

[0172] The working principle of the above technical solution is as follows: According to the target cultural relic information required by the user, the system first retrieves the virtual scene that has been rendered corresponding to the cultural relic information. This step is the basis for subsequent detection, ensuring the consistency between the detected object and the user's requirements. Then, the system retrieves the scene parameters of the rendered virtual scene. These parameters include frame rate, dynamic range value, resolution, etc., which together constitute the basic quality indicators of the virtual scene. By using the above scene parameters, the system further calculates the rendering quality evaluation coefficient corresponding to the virtual scene. This coefficient is a quantitative evaluation of the rendering quality of the virtual scene, which can intuitively reflect its quality level. Compare the calculated rendering quality evaluation coefficient with the preset evaluation coefficient threshold. The purpose of this step is to determine whether the rendering quality of the virtual scene meets the requirements of the user or the system. If the rendering quality evaluation coefficient is lower than the preset evaluation coefficient threshold, it means that the rendering quality of the virtual scene does not meet the standard. At this time, the system needs to decide to re-render the virtual scene to improve its quality level.

[0173] The effects of the above technical solution are as follows: By performing a rendering quality inspection on the virtual scene corresponding to the target cultural relic information required by the user, it is ensured that the user obtains a high-quality, clear, and smooth virtual scene experience. This helps to improve user satisfaction and loyalty. By performing a quality inspection on the rendered virtual scene, unnecessary repeated rendering is avoided, thus saving computing resources and time costs. When the quality of the virtual scene meets the standard, no additional rendering is required, reducing resource waste. This technical solution makes a quick judgment through a preset evaluation coefficient threshold, avoiding a complex manual inspection process and improving the rendering efficiency. At the same time, for the virtual scene that needs to be re-rendered, the system can locate the problem faster and perform optimization processing. This technical solution can flexibly adjust the evaluation coefficient threshold according to user needs and system requirements to adapt to different application scenarios and rendering requirements. This helps to improve the flexibility and adaptability of the system. In the field of digital protection of cultural relics, the application of this technical solution helps to ensure the accuracy and authenticity of the virtual cultural relic scene. Through high-quality rendering and inspection, cultural relic information can be displayed and inherited more effectively, providing strong support for the digital protection of cultural relics.

[0174] In summary, this technical solution performs a rendering quality inspection on the virtual scene corresponding to the target cultural relic information required by the user, and decides whether to re-render according to the inspection result, effectively improving the user experience, optimizing resource utilization, increasing the rendering efficiency, enhancing the system flexibility, and promoting the development of digital protection of cultural relics.

[0175] In an embodiment of the present invention, the rendering quality evaluation coefficient corresponding to the rendered virtual scene is obtained by using the scene parameters of the rendered virtual scene, including:

[0176] S2031. Retrieve the resolution included in the scene parameters;

[0177] S2032. Compare the resolution with a preset resolution threshold;

[0178] S2033. When the resolution is lower than the preset resolution threshold, the rendering quality evaluation coefficient is obtained by using the frame rate and dynamic range included in the scene parameters;

[0179] Wherein, the rendering quality evaluation coefficient is obtained through the following formula:

[0180]

[0181] Wherein, Q represents the rendering quality evaluation coefficient; G represents the frame rate; K represents the dynamic range; α 、 β and γrespectively represent a first adjustment coefficient, a second adjustment coefficient, and a third adjustment coefficient, and the value ranges of the first adjustment coefficient, the second adjustment coefficient, and the third adjustment coefficient are: 0.50 - 2.00, 1.21 - 1.82, and 0.34 - 0.63;

[0182] S2034. When the resolution is not lower than a preset resolution threshold, obtain a rendering quality evaluation coefficient by using the frame rate, dynamic range, and resolution included in the scene parameters;

[0183] Among them, the rendering quality evaluation coefficient is obtained through the following formula:

[0184]

[0185] Among them, Q represents the rendering quality evaluation coefficient; G represents the frame rate; K represents the dynamic range; Y represents the resolution; Y 0 represents the preset resolution threshold; Y max represents the desired resolution; θ and δ respectively represent a first adjustment factor and a second adjustment factor, and the value ranges of the first adjustment factor and the second adjustment factor are 0.48 - 0.73 and 0.17 - 0.42 respectively.

[0186] The working principle of the above technical solution is as follows: First, retrieve the resolution information from the scene parameters. Resolution is a key indicator for measuring image clarity and detail performance. Compare the retrieved resolution with the preset resolution threshold. This threshold is set according to system requirements or user expectations and is used to determine whether the resolution meets the standard. If the resolution is lower than the preset resolution threshold, it indicates insufficient image clarity. At this time, use the frame rate and dynamic range information to calculate the rendering quality evaluation coefficient through a specific formula (involving the first adjustment coefficient α, the second adjustment coefficient β, and the third adjustment coefficient γ). These adjustment coefficients are used to balance the impact of the frame rate and dynamic range on the rendering quality. If the resolution is not lower than the preset resolution threshold, it indicates that the image clarity meets or exceeds the standard. At this time, in addition to using the frame rate and dynamic range information, resolution information is also introduced (while considering the preset resolution threshold Y0 and the desired resolution Y max ) to calculate the rendering quality evaluation coefficient through another specific formula (involving the first adjustment factor θ and the second adjustment factor δ). This formula more comprehensively considers the impact of resolution on the rendering quality and introduces the expected value of the resolution for adjustment.

[0187] The effects of the above technical solution are as follows: By comprehensively considering multiple factors such as resolution, frame rate, and dynamic range, and introducing adjustment coefficients and adjustment factors for quantitative evaluation, this technical solution can more accurately reflect the rendering quality of virtual scenes. This technical solution can select different calculation formulas according to different resolution situations, and allows the adjustment coefficients and adjustment factors to take values within a certain range, thereby enhancing the flexibility and adaptability of the system, making it applicable to different application scenarios and rendering requirements. Through accurate rendering quality evaluation, the system can more effectively determine which virtual scenes need to be re-rendered and which can be retained, thus avoiding unnecessary repeated rendering and optimizing the utilization of computing resources. High-quality rendering and accurate rendering quality evaluation help to improve the user experience, enabling users to enjoy a clearer, smoother, and more realistic virtual scene experience. In the field of digital cultural heritage protection, the application of this technical solution helps to ensure the rendering quality of virtual cultural relic scenes, thus more accurately displaying and inheriting cultural relic information, providing strong support for digital cultural heritage protection.

[0188] On the other hand, by comprehensively considering key parameters such as the resolution, frame rate, and dynamic range of virtual scenes, this technical solution can more accurately evaluate the rendering quality of rendered virtual scenes. This comprehensive evaluation method is more comprehensive and objective than single-parameter evaluation. The technical solution calculates the rendering quality evaluation coefficient using different formulas according to whether the resolution reaches a preset threshold. This design enables the technical solution to flexibly adapt to virtual scenes with different resolutions, ensuring the accuracy and effectiveness of the evaluation. By introducing adjustment coefficients (α, β, γ) and adjustment factors (θ, δ), the technical solution allows users to adjust the calculation method of the evaluation coefficient according to actual needs. This adjustability and configurability enable the technical solution to be more widely applied to different virtual scenes and rendering quality evaluation requirements. The formulas in the technical solution are relatively simple and the calculation amount is moderate, which can achieve high calculation efficiency while ensuring accuracy. This helps to quickly obtain the rendering quality evaluation coefficient in real-time rendering and dynamic evaluation scenarios. The steps and formulas in the technical solution are clear and easy to implement and integrate into existing virtual scene rendering and evaluation systems. This helps to reduce the implementation difficulty and cost of the technical solution. By obtaining the rendering quality evaluation coefficient, the technical solution can provide guidance for the rendering optimization of virtual scenes. For example, when the evaluation coefficient is low, the rendering parameters can be adjusted specifically (such as increasing the resolution, increasing the frame rate, etc.) to improve the rendering quality. The technical solution is not only applicable to current virtual scene rendering technologies, but also has certain scalability and compatibility. With the continuous development of virtual scene rendering technologies, the technical solution can be further expanded and improved to adapt to new rendering parameters and evaluation requirements.

[0189] In summary, the technical solution can achieve multiple technical effects in terms of performance indicators, such as the accuracy, flexibility and adaptability, adjustability and configurability, computational efficiency and real-time performance, ease of implementation and integration, guidance for rendering optimization, and scalability and compatibility of the rendering quality evaluation. These effects work together in the process of evaluating and optimizing the rendering quality of the virtual scene, contributing to improving the overall rendering quality and user experience. At the same time, by comprehensively considering multiple factors and introducing adjustment coefficients and adjustment factors for quantitative evaluation, the technical solution improves the accuracy of the rendering quality evaluation, enhances the flexibility and adaptability of the system, optimizes resource utilization, improves the user experience, and promotes the development of digital cultural heritage protection.

[0190] In one embodiment of the present invention, when the rendered virtual scene meets the requirements of the rendering instruction, a virtual scene with cultural relic data is synthesized using the cultural relic data corresponding to the target cultural relic information and the rendered virtual scene, and visual display is performed, including:

[0191] S301. When the rendered virtual scene meets the requirements of the rendering instruction, the cultural relic data corresponding to the target cultural relic information is retrieved from the database, where the cultural relic data includes but is not limited to data information such as the history of the cultural relic and the cultural relic background.

[0192] S302. The cultural relic data corresponding to the target cultural relic information is fused with the rendered virtual scene corresponding to the target cultural relic information to generate a virtual scene with cultural relic data.

[0193] S303. The virtual scene is visually displayed.

[0194] The working principle of the above technical solution is as follows: When the rendered virtual scene meets the requirements of the rendering instruction (such as parameters such as resolution, frame rate, and dynamic range are all up to standard), the system retrieves the cultural relic data corresponding to the target cultural relic information from the database. These data include but are not limited to detailed information such as the historical background, manufacturing process, and cultural connotation of the cultural relic, which provide rich background and content for the virtual scene. Next, the system fuses the retrieved cultural relic data with the rendered virtual scene. This step may involve complex operations such as unifying data formats, matching coordinate systems, and invoking the rendering engine to ensure that the cultural relic data can be accurately and naturally embedded in the virtual scene. Finally, the system visually displays the generated virtual scene with cultural relic data. This can be achieved through various display platforms (such as VR / AR devices, web browsers, mobile applications, etc.), enabling users to experience the virtual scene immersively and obtain detailed information about the target cultural relic.

[0195] The effects of the above technical solution are as follows: By combining cultural relic data with virtual scenes, users can not only see the appearance of cultural relics but also understand the historical and cultural background behind them. This immersive experience method greatly enhances users' sense of participation and interest, improving the user experience. As an intuitive and vivid display method, virtual scenes can more effectively convey cultural relic information. Compared with traditional display methods such as text and pictures, virtual scenes can stimulate users' senses such as vision and hearing simultaneously, making the information easier to understand and remember. This technical solution has broad application prospects in the fields of cultural relic protection and education. By displaying cultural relics through virtual scenes, it is possible to reduce the risk of direct contact and damage to physical objects while increasing the visibility and influence of cultural relics. In addition, virtual scenes can also be used as educational tools to help students more intuitively understand cultural relics and history and culture. The implementation of this technical solution promotes the application and development of digital technology in the fields of cultural relic protection and display. Through continuous technological innovation and optimization, the realism and interactivity of virtual scenes can be further improved, providing users with a richer experience.

[0196] In summary, this technical solution enhances the user experience, improves the information dissemination efficiency, promotes cultural relic protection and education, and drives the development of digital technology by integrating cultural relic data with virtual scenes and performing visual display.

[0197] In an embodiment of the present invention, the cultural relic data corresponding to the target cultural relic information is integrated with the already-rendered virtual scene corresponding to the target cultural relic information to generate a virtual scene with cultural relic data, including:

[0198] S3021. Convert the cultural relic data corresponding to the target cultural relic information into a data format that matches the already-rendered virtual scene corresponding to the target cultural relic information;

[0199] S3022. Define anchor points in the already-rendered virtual scene corresponding to the target cultural relic information, where the anchor points are the positions where the cultural relic data will be placed. These positions should be hotspots for user interaction or visual focal points to enhance the user experience;

[0200] S3023. Map the cultural relic data corresponding to the target cultural relic information to the anchor points corresponding to the already-rendered virtual scene corresponding to the target cultural relic information.

[0201] The working principle of the above technical solution is as follows: First, convert the cultural relic data corresponding to the target cultural relic information into a data format that matches the already rendered virtual scene. Since the cultural relic data may come from different data sources, their formats and encoding methods may vary. To ensure that the cultural relic data can be correctly displayed in the virtual scene, it needs to be converted into a data format compatible with the virtual scene. Then, define anchor points in the already rendered virtual scene. Anchor points are the positions where the cultural relic data will be placed, and they are usually hotspots for user interaction or visual focuses. By defining anchor points, it can be ensured that the position and layout of the cultural relic data in the virtual scene meet the expectations and interaction habits of users, thereby enhancing the user experience. Finally, map the cultural relic data corresponding to the target cultural relic information to the anchor points corresponding to the virtual scene. This step is the key step to associate the converted cultural relic data with the virtual scene. Through mapping, the cultural relic data can be correctly displayed in the virtual scene and interact with other elements of the virtual scene.

[0202] The effects of the above technical solution are as follows: Through data format conversion, it can be ensured that the cultural relic data can be correctly displayed in the virtual scene, improving the compatibility and usability of the data. By defining anchor points in the virtual scene and mapping the cultural relic data to these anchor points, it can be ensured that the position and layout of the cultural relic data in the virtual scene meet the expectations and interaction habits of users. This helps to improve user participation and satisfaction and enhance the user experience. This technical solution enables the cultural relic data to be effectively displayed and utilized in the virtual scene. Through the virtual scene, users can more intuitively understand the historical and cultural background of the cultural relics, increasing the dissemination range and influence of the cultural relic data. The implementation of this technical solution promotes the application and development of digital technology in the field of cultural relic protection and display. By displaying cultural relic data through the virtual scene, it is possible to reduce the direct contact and damage risk to physical objects while increasing the visibility and influence of cultural relics.

[0203] In summary, through steps such as data format conversion, defining anchor points, and data mapping, this technical solution realizes the integration of cultural relic data and the virtual scene, and brings technical effects such as improving data compatibility, enhancing the user experience, promoting the effective utilization of cultural relic data, and promoting the application of digital technology.

[0204] In one embodiment of the present invention, the method for the virtual digital cultural relic to interact with the audience further includes:

[0205] Real-time receive the user's scanned code information, enter the timeline corresponding to the scanned code information according to the user's scanned code information, and display the cultural relics, historical eras, and related historical events and cultural stories corresponding to the timeline;

[0206] Real-time receive the user's scanned code information, enter the cultural story corresponding to the scanned code information according to the user's scanned code information, and automatically tell the cultural story;

[0207] Receive user's QR code scanning information in real time, and enter the expert lecture live platform corresponding to the QR code scanning information according to the user's QR code scanning information, and play the expert online lecture or seminar online;

[0208] Set up a cultural relic interaction platform for users to interact and ask questions on the cultural relic interaction platform.

[0209] The working principle of the above technical solution is as follows: When a user scans the QR code or bar code of a specific cultural relic through a mobile device (such as a smart phone), the system receives this QR code scanning information in real time. The system analyzes the QR code scanning information and identifies the corresponding cultural relic, timeline, cultural story, expert lecture, etc. Timeline display and cultural relic information presentation: According to the QR code scanning information, the system enters the timeline related to this cultural relic. On the timeline, the system displays the historical era, historical events, and cultural stories related to this cultural relic. Automatic narration of cultural stories: The system can identify the cultural stories that users want to know and automatically narrate them in the form of voice, text, video, etc. The narration content may include the historical background, production process, artistic value, etc. of the cultural relic. Access to the expert lecture live platform: Users can directly enter the expert lecture live platform related to the cultural relic by scanning the QR code. On the platform, users can watch the expert's online lecture or seminar and learn about the latest research results or interpretations of the cultural relic in real time. Setting up and interaction of the cultural relic interaction platform: The system sets up a cultural relic interaction platform for users to perform interactive operations. Users can ask questions, post comments, participate in discussions, etc. on the platform to interact and communicate with other users or experts. It should be noted that the "question" mentioned in the original text may be a typo or omission. Normally, it should refer to "asking questions" or other functions related to interaction.

[0210] The technical effects of the above technical solution are as follows: Through the interaction between virtual digital cultural relics and the audience, the audience can more intuitively understand the historical background and cultural connotations of cultural relics. Functions such as automatic narration and expert lectures enable the audience to learn cultural relic knowledge more deeply and improve the interest and educational value of the visit. Through digital means, cultural relic information can be more widely spread and shared. The audience can understand cultural relic information anytime and anywhere through devices such as mobile phones, breaking the limitations of time and space. By showing the historical value and artistic value of cultural relics, the audience can more profoundly recognize the importance of cultural relic protection. Discussions and exchanges on the interaction platform also contribute to the formation of a social consensus on cultural relic protection. The interaction between virtual digital cultural relics and the audience provides new ideas and means for cultural innovation. Through digital technology and Internet platforms, more novel and interesting cultural products and services can be created.

[0211] In summary, this technical solution realizes the deep interaction between virtual digital cultural relics and audiences by receiving real-time user scanning information and providing relevant cultural relic information, cultural stories, expert lectures, etc. according to the information, and setting up a cultural relic interaction platform for users to interact, improving the audience's visiting experience and learning effect, and at the same time promoting cultural dissemination and innovation.

[0212] An embodiment of the present invention proposes an interaction system between virtual digital cultural relics and audiences, as Figure 2 shown. The interaction system between virtual digital cultural relics and audiences includes:

[0213] A target cultural relic information acquisition module, configured to monitor the user's gesture and voice inputs in real time through a gesture capture device and a voice collection device, and obtain the target cultural relic information required by the user currently through the user's gesture and voice inputs; wherein, the gesture capture device includes but is not limited to VR handles or gloves, etc.; the voice collection device includes but is not limited to microphones, etc.;

[0214] A virtual scene quality detection module, configured to retrieve the rendered virtual scene corresponding to the target cultural relic information according to the target cultural relic information required by the user, and perform rendering quality detection on the rendered virtual scene;

[0215] A virtual scene visualization display module, configured to synthesize a virtual scene with cultural relic data by using the cultural relic data corresponding to the target cultural relic information and the rendered virtual scene when the rendered virtual scene meets the requirements of the rendering instruction, and perform visualization display.

[0216] The working principle of the above technical solution is as follows: A gesture capture device (such as a VR controller, glove, etc.) captures the user's hand movements in real time through built-in sensors and converts these movements into digital signals. A voice collection device (such as a microphone) is responsible for capturing the user's voice input and converting it into text or instructions through voice recognition technology. The system analyzes the user's intention based on the captured gestures and recognized voice content, so as to determine the target cultural relic information required by the user at present. Once the target cultural relic information is determined, the system retrieves the already-rendered virtual scene corresponding to the cultural relic from the database. Before the display, the system performs a rendering quality detection on these virtual scenes to ensure that they meet the requirements of the rendering instructions, including the performance in aspects such as scene details, lighting effects, and color restoration. If the rendering quality of the virtual scene does not meet the requirements, the system may perform necessary optimizations or re-renderings to ensure the high quality of the final display effect. When the rendering quality of the virtual scene meets the requirements, the system synthesizes the cultural relic data corresponding to the target cultural relic information with the already-rendered virtual scene. The synthesized virtual scene will contain rich cultural relic information, such as the shape, texture, color, etc. of the cultural relic, as well as the related historical background, manufacturing process, etc. Finally, the system presents the synthesized virtual scene to the audience through visualization display technologies (such as virtual reality head-mounted devices, large-screen displays, etc.), enabling the audience to view and understand the cultural relics as if they were on the spot.

[0217] The effects of the above technical solution are as follows: Through gesture capture and voice recognition technologies, the audience can interact with virtual digital cultural relics in a more natural and intuitive way, thus greatly enhancing the audience's participation and experience quality. High-quality rendering technologies and visualization displays enable the audience to view cultural relics as if they were on the spot, enhancing the audience's sense of immersion and substitution. The virtual digital cultural relic technology can provide rich cultural relic information and viewing experiences for the audience without damaging the physical cultural relics, thus reducing the difficulty and cost of cultural relic protection. This technical solution can be applied to cultural places such as museums and libraries, as well as fields such as education and tourism, providing a broader channel and possibility for the protection and dissemination of cultural heritage.

[0218] In summary, this technical solution realizes the in-depth interaction and high-quality display between virtual digital cultural relics and the audience by combining advanced technologies such as gesture capture, voice recognition, and rendering quality detection, providing strong support for the digital protection and inheritance of cultural heritage.

[0219] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these changes and modifications.

Claims

1. A method for the interaction between virtual digital cultural relics and audiences, characterized in that The method for the interaction between the virtual digital cultural relic and the audience includes: S1: Real-time monitor the user's gestures and voice inputs through a gesture capture device and a voice collection device, and obtain the target cultural relic information required by the user currently through the user's gestures and voice inputs; S2: Retrieve the rendered virtual scene corresponding to the target cultural relic information according to the target cultural relic information required by the user, and perform a rendering quality detection on the rendered virtual scene; S3: When the rendered virtual scene meets the requirements of the rendering instruction, synthesize a virtual scene with cultural relic data by using the cultural relic data corresponding to the target cultural relic information and the rendered virtual scene, and perform a visual display; Among them, step S1 includes: taking the cultural relic information corresponding to the hand sliding position obtained by the gesture capture device as the first cultural relic data information, identifying the second cultural relic data information by converting the text data of the voice instruction information collected by the voice collection device, when the cultural relic information contained in the first cultural relic data information and the second cultural relic data information is the same, determining the cultural relic information jointly determined by the two as the target cultural relic information; when the cultural relic information contained in the first cultural relic data information and the second cultural relic data information is different, respectively retrieve the generation time and the starting collection time of the information of the first cultural relic data information and the second cultural relic data information, and then obtain the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information, and determine the target cultural relic information based on the comparison result between the two generation time index coefficients, where the generation time index coefficient is obtained according to the complexity of the cultural relic data information, the intensity of the user operation intention, and the difference between the starting collection time of the hand movement or voice instruction information and the generation time of the corresponding cultural relic data information, where the complexity of the cultural relic data information is obtained according to the data volume of the virtual scene data, the virtual scene video duration, and the number of pictures contained in the cultural relic background data; the intensity of the user operation intention is obtained according to the access frequency, the browsing duration, and the proportion of the number of repeated selections in the total number of all cultural relics selected by the user; Among them, step S2 includes: retrieving the scene parameters of the rendered virtual scene, where the scene parameters include frame rate, dynamic range value, and resolution; obtaining the rendering quality evaluation coefficient corresponding to the rendered virtual scene by using the scene parameters; comparing the rendering quality evaluation coefficient with a preset evaluation coefficient threshold; when the rendering quality evaluation coefficient is lower than the preset evaluation coefficient threshold, perform a re-rendering.

2. The interactive method between virtual digital cultural relics and audiences according to claim 1, wherein Real-time monitor the user's gestures and voice inputs through a gesture capture device and a voice collection device, and obtain the target cultural relic information required by the user currently, including: Initialize the gesture capture device and the voice collection device; Capture the user's hand movements through the accelerometer and gyroscope set inside the gesture capture device; The data processing unit set inside the gesture capture device uses a predefined gesture recognition algorithm to perform gesture recognition on the captured hand movements of the user and determine the hand sliding position of the user; Obtain the cultural relic information corresponding to the hand sliding position according to the hand sliding position of the user, and use the cultural relic information corresponding to the hand sliding position as the first cultural relic data information; Real-time collect the voice command information of the user through the voice collection device; Convert the voice command information of the user into a voice digital signal, and perform noise filtering and sound enhancement processing on the voice digital signal corresponding to the voice command information to obtain the processed voice digital signal; Convert the voice digital signal into text data, and perform text recognition on the text data to obtain the second cultural relic data information required by the user currently; Determine the target cultural relic information from the first cultural relic data information and the second cultural relic data information.

3. The interactive method between virtual digital cultural relics and audiences according to claim 2, wherein Determining the target cultural relic information from the first cultural relic data information and the second cultural relic data information includes: When the cultural relic information contained in the first cultural relic data information and the second cultural relic data information is the same, the cultural relic information jointly determined by the first cultural relic data information and the second cultural relic data information is used as the target cultural relic information; When the cultural relic information contained in the first cultural relic data information and the second cultural relic data information is different, the target cultural relic information is determined according to the generation time corresponding to the first cultural relic data information and the second cultural relic data information.

4. The interactive method between the virtual digital cultural relic and the audience according to claim 3, characterized in that When the cultural relic information contained in the first cultural relic data information and the second cultural relic data information is different, determining the target cultural relic information according to the generation time corresponding to the first cultural relic data information and the second cultural relic data information includes: Extract the generation time of the first cultural relic data information; Extract the start collection time of the hand movement corresponding to the first cultural relic data information; Retrieve the virtual scene data and cultural relic background data corresponding to the first cultural relic data information; Extract the generation time of the second cultural relic data information; Extract the start collection time of the voice command information corresponding to the second cultural relic data information; Retrieve the virtual scene data and cultural relic background data corresponding to the second cultural relic data information; Use the generation time of the first cultural relic data information and the start collection time of the hand movement corresponding to the first cultural relic data information to obtain the generation time index coefficient corresponding to the first cultural relic data information; Among them, the generation time index coefficient corresponding to the first cultural relic data information is obtained through the following formula: Among them, S 01 represents the generation time index coefficient corresponding to the first cultural relic data information; I 01 represents the operation intention intensity corresponding to the first cultural relic data information; C 01 represents the cultural relic data complexity corresponding to the first cultural relic data information; t q01 represents the starting acquisition moment of the hand movement corresponding to the first cultural relic data information; t s01 represents the generation moment of the first cultural relic data information; Among them, the cultural relic data complexity corresponding to the first cultural relic data information is obtained through the following formula: Among them, C 01 represents the complexity of the cultural relic data corresponding to the first cultural relic data information; w 01 and w 02 represent the first weight coefficient and the second weight coefficient corresponding to the first cultural relic data information; F 01 represents the data volume of the virtual scene data corresponding to the first cultural relic data information; F c represents a preset reference value of the data volume; T 01 represents the virtual scene video duration of the virtual scene data corresponding to the first cultural relic data information; T c represents a preset reference value of the duration; M 01 represents the number of pictures included in the cultural relic background data corresponding to the first cultural relic data information; M c represents a preset reference value of the number of pictures; And, the operation intention intensity corresponding to the first cultural relic data information is obtained through the following formula: Among them, I 01 represents the intensity of the operation intention corresponding to the first cultural relic data information; w 03 , w 04 and w 05 respectively represent the third weight coefficient, the fourth weight coefficient, and the fifth weight coefficient corresponding to the first cultural relic data information; f 01 represents the generated access frequency of the user to the first cultural relic data information; D 01 represents the generated browsing duration of the user to the first cultural relic data information; R 01 represents the proportion of the number of times the first cultural relic data information is repeatedly selected by the user in the total number of times all cultural relics selected by the user; f x represents the overall access frequency of the first cultural relic data information; D x represents the total browsing duration of the first cultural relic data information; R x represents the proportion of the first cultural relic data information being repeatedly selected by the same user; Use the generation time of the second cultural relic data information and the start collection time of the hand movement corresponding to the second cultural relic data information to obtain the generation time index coefficient corresponding to the second cultural relic data information; Among them, the generation time index coefficient corresponding to the second cultural relic data information is obtained through the following formula: Among them, S 02 represents the generation time index coefficient corresponding to the second cultural relic data information; I 02 represents the operation intention intensity corresponding to the second cultural relic data information; C 02 represents the cultural relic data complexity corresponding to the second cultural relic data information; t q02 represents the starting acquisition moment of the voice command information corresponding to the second cultural relic data information; t s02 represents the generation moment of the second cultural relic data information; Among them, the cultural relic data complexity corresponding to the second cultural relic data information is obtained through the following formula: Among them, C 02 represents the complexity of the cultural relic data corresponding to the first cultural relic data information; k 01 and k 02 represent the first weight coefficient and the second weight coefficient corresponding to the second cultural relic data information; F 02 represents the data volume of the virtual scene data corresponding to the second cultural relic data information; F c represents a preset data volume reference value; T 02 represents the virtual scene video duration of the virtual scene data corresponding to the second cultural relic data information; T c represents a preset duration reference value; M 02 represents the number of pictures included in the cultural relic background data corresponding to the second cultural relic data information; M c represents a preset reference value for the number of pictures; And, the operation intention intensity corresponding to the second cultural relic data information is obtained through the following formula: Among them, I 02 represents the intensity of the operation intention corresponding to the second cultural relic data information; k 03 , k 04 and k 05 respectively represent the third weight coefficient, the fourth weight coefficient, and the fifth weight coefficient corresponding to the second cultural relic data information; f 02 represents the generated access frequency of the user to the second cultural relic data information; D 02 represents the generated browsing duration of the user to the second cultural relic data information; R 02 represents the proportion of the number of times the second cultural relic data information is repeatedly selected by the user in the total number of times all cultural relics selected by the user; f x represents the overall access frequency of the second cultural relic data information; D x represents the total browsing duration of the second cultural relic data information; R x represents the proportion of the second cultural relic data information being repeatedly selected by the same user; Compare the generation time index coefficients corresponding to the first cultural relic data information and the generation time index coefficients corresponding to the second cultural relic data information to obtain a comparison result; Determine the target cultural relic information according to the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information.

5. The interactive method between virtual digital cultural relics and audiences according to claim 4, wherein Determining the target cultural relic information according to the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information includes: Compare the generation time corresponding to the first cultural relic data information and the generation time corresponding to the second cultural relic data information to obtain a generation time difference; Compare the generation time difference with a preset time difference threshold; When the generation time difference exceeds the preset time difference threshold, extract the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information; Compare the coefficient difference corresponding to the comparison result between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information with a preset coefficient difference threshold; When the coefficient difference between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information is less than the preset coefficient difference threshold, determine the cultural relic data information with the later generation time among the generation time corresponding to the first cultural relic data information and the generation time corresponding to the second cultural relic data information as the target cultural relic information; When the coefficient difference between the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information is not less than the preset coefficient difference threshold, determine the cultural relic data information corresponding to the maximum coefficient among the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information as the target cultural relic information; When the generation time difference does not exceed the preset time difference threshold, determine the cultural relic data information corresponding to the minimum coefficient among the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information as the target cultural relic information.

6. The interactive method between virtual digital cultural relics and the audience according to claim 1, wherein Obtain the rendering quality evaluation coefficient corresponding to the virtual scene that has been rendered by using the scene parameters of the virtual scene that has been rendered, including: Retrieve the resolution included in the scene parameters; Compare the resolution with a preset resolution threshold; When the resolution is lower than the preset resolution threshold, obtain the rendering quality evaluation coefficient by using the frame rate and dynamic range included in the scene parameters; Among them, the rendering quality evaluation coefficient is obtained through the following formula: Among them, Q represents the rendering quality evaluation coefficient; G represents the frame rate; K represents the dynamic range; α , β and γ respectively represent the first adjustment coefficient, the second adjustment coefficient, and the third adjustment coefficient, and the value ranges of the first adjustment coefficient, the second adjustment coefficient, and the third adjustment coefficient are respectively: 0.50 - 2.00, 1.21 - 1.82, and 0.34 - 0.63; When the resolution is not lower than the preset resolution threshold, obtain the rendering quality evaluation coefficient by using the frame rate, dynamic range and resolution included in the scene parameters; Among them, the rendering quality evaluation coefficient is obtained through the following formula: Among them, Q represents the rendering quality evaluation coefficient; G represents the frame rate; K represents the dynamic range; Y represents the resolution; Y 0 represents a preset resolution threshold; Y max represents the expected resolution; θ and δ respectively represent a first adjustment factor and a second adjustment factor, and the value ranges of the first adjustment factor and the second adjustment factor are 0.48 - 0.73 and 0.17 - 0.42 respectively.

7. The interactive method between virtual digital cultural relics and audiences according to claim 1, characterized in that, When the rendered virtual scene meets the requirements of the rendering instruction, synthesize a virtual scene with cultural relic data using the cultural relic data corresponding to the target cultural relic information and the rendered virtual scene, and perform visual display, including: When the rendered virtual scene meets the requirements of the rendering instruction, retrieve the cultural relic data corresponding to the target cultural relic information from the database; Fuse the cultural relic data corresponding to the target cultural relic information with the rendered virtual scene corresponding to the target cultural relic information to generate a virtual scene with cultural relic data; Perform visual display of the virtual scene.

8. The interactive method between virtual digital cultural relics and the audience according to claim 7, wherein, Fuse the cultural relic data corresponding to the target cultural relic information with the rendered virtual scene corresponding to the target cultural relic information to generate a virtual scene with cultural relic data, including: Convert the cultural relic data corresponding to the target cultural relic information into a data format that matches the rendered virtual scene corresponding to the target cultural relic information; Define an anchor point in the rendered virtual scene corresponding to the target cultural relic information; Map the cultural relic data corresponding to the target cultural relic information to the anchor point corresponding to the rendered virtual scene corresponding to the target cultural relic information.

9. The interactive method between virtual digital cultural relics and audiences according to claim 1, wherein The interactive method between the virtual digital cultural relic and the audience further includes: Real-time receive the user's QR code scanning information, enter the timeline corresponding to the QR code scanning information according to the user's QR code scanning information, and display the cultural relics, historical eras, relevant historical events and cultural stories corresponding to the timeline; Real-time receive the user's QR code scanning information, enter the cultural story corresponding to the QR code scanning information according to the user's QR code scanning information, and automatically tell the cultural story; Real-time receive the user's QR code scanning information, enter the expert lecture live broadcast platform corresponding to the QR code scanning information according to the user's QR code scanning information, and play the expert online lecture or seminar online; Set up a cultural relic interaction platform for users to interact and ask questions on the cultural relic interaction platform.

10. An interactive system between virtual digital cultural relics and audiences, characterized in that, The interactive system between the virtual digital cultural relic and the audience includes: A target cultural relic information acquisition module, which is used to monitor the user's gesture and voice inputs in real time through a gesture capture device and a voice acquisition device, and obtain the target cultural relic information required by the user currently through the user's gesture and voice inputs; A virtual scene quality detection module, which is used to retrieve the rendered virtual scene corresponding to the target cultural relic information according to the target cultural relic information required by the user, and perform rendering quality detection on the rendered virtual scene; A virtual scene visual display module, which is used to synthesize a virtual scene with cultural relic data using the cultural relic data corresponding to the target cultural relic information and the rendered virtual scene when the rendered virtual scene meets the requirements of the rendering instruction, and perform visual display; Among them, the target cultural relic information acquisition module includes: obtaining the cultural relic information corresponding to the hand sliding position acquired by the gesture capture device as the first cultural relic data information, and identifying the second cultural relic data information by converting the voice command information collected by the voice acquisition device into text data. When the cultural relic information contained in the first cultural relic data information and the second cultural relic data information is the same, the cultural relic information jointly determined by the two is used as the target cultural relic information; when the cultural relic information contained in the first cultural relic data information and the second cultural relic data information is different, the generation time and the starting acquisition time of the information of the first cultural relic data information and the second cultural relic data information are respectively retrieved, and then the generation time index coefficient corresponding to the first cultural relic data information and the generation time index coefficient corresponding to the second cultural relic data information are obtained. The target cultural relic information is determined based on the comparison result between the two generation time index coefficients. Among them, the generation time index coefficient is obtained according to the complexity of the cultural relic data information, the intensity of the user operation intention, and the difference between the starting acquisition time of the hand movement or voice command information and the generation time of the corresponding cultural relic data information. Among them, the complexity of the cultural relic data information is obtained according to the data volume of the virtual scene data, the virtual scene video duration, and the number of pictures contained in the cultural relic background data; the intensity of the user operation intention is obtained according to the access frequency of the user to the cultural relic data information, the browsing duration generated, and the proportion of the number of repeated selections in the total number of all cultural relics selected by the user; Among them, the virtual scene quality detection module includes: retrieving the scene parameters of the virtual scene that has been rendered, and the scene parameters include frame rate, dynamic range value, and resolution; obtaining the rendering quality evaluation coefficient corresponding to the virtual scene that has been rendered by using the scene parameters; comparing the rendering quality evaluation coefficient with a preset evaluation coefficient threshold; when the rendering quality evaluation coefficient is lower than the preset evaluation coefficient threshold, re-rendering is performed.

Citation Information

Patent Citations

  • User intention identification method and apparatus, electronic device and storage medium

    CN108230007A

  • Digital human real-time interaction system and digital human real-time interaction method

    CN119440254A