Three-dimensional cultural creative digital interactive experience system

Abstract

The invention discloses a three-dimensional cultural creativity digital interaction experience system, and relates to the technical field of three-dimensional digital and cultural creativity, and the system comprises a data collection module which is used for collecting user interaction data and environment parameters; the three-dimensional modeling module constructs a three-dimensional scene model based on the user interaction data and the environmental parameters; a dynamic rendering engine adopts a self-adaptive illumination model and a dynamic texture mapping algorithm to render the three-dimensional scene model in real time, and dynamic visual experience is generated; the interaction logic processing module predicts the next possible interaction action of the user through a behavior prediction algorithm based on deep learning according to the user interaction data, and adjusts the element state in the three-dimensional scene model accordingly; and the output display module outputs the rendered three-dimensional scene model to a display device for user experience. The method is beneficial to enhancing user experience and improving creative expression.

Description

Technical Field

[0001] The present invention mainly relates to the technical field of three-dimensional digital and cultural creativity, and specifically provides a three-dimensional cultural creativity digital interactive experience system. Background Art

[0002] With the continuous progress of digital technology, technologies such as three-dimensional modeling, virtual reality (VR), augmented reality (AR), and interactive interfaces are becoming increasingly mature, providing a solid technical foundation for the development of three-dimensional cultural creativity digital interactive experience systems. These technologies enable objects, products, or scenes to be reproduced in a virtual environment in the form of three-dimensional models, bringing an unprecedented sense of reality and immersion to users. The purchasing methods and consumption habits of consumers are accelerating the process of industry digitization and intelligence. They are increasingly inclined to obtain information through online channels and expect to obtain more personalized and interactive experiences. Three-dimensional cultural creativity digital interactive experience systems are widely used in cultural exhibitions, product exhibitions, education and training, tourism, and other fields. For example, art institutions can use this system to display artworks in a virtual space and provide interactive appreciation and experience; enterprises can use this system to display products and provide functions such as virtual tours and interactive operations.

[0003] According to the public number CN115543095B, a public safety digital interactive experience method and system, the method includes: generating a public safety experience scene image based on the public safety experience scene text using a diffusion model; reconstructing a three-dimensional public safety experience scene based on the generated public safety experience scene image; enhancing the edge structure of the three-dimensional public safety experience scene; using a user behavior monitoring algorithm to monitor the user's position and actions in real time; and if it is detected that the user has an interaction action with an item in the three-dimensional public safety experience scene, performing real-time interactive rendering on the interactive item.

[0004] Existing traditional exhibition halls have problems such as long display content time, single display method, and poor interactivity, making it difficult to establish effective communication with the audience. Summary of the Invention

[0005] Based on this, the purpose of the present invention is to provide a three-dimensional cultural creativity digital interactive experience system to solve the technical problems proposed in the above background art.

[0006] To achieve the above purpose, the present invention provides the following technical solutions:

[0007] A three-dimensional cultural creativity digital interactive experience system includes a data acquisition module, a three-dimensional modeling module, a dynamic rendering engine, an interactive logic processing module, and an output display module. The data acquisition module is used to collect user interaction data and environmental parameters;

[0008] The 3D modeling module constructs a 3D scene model based on the user interaction data and environmental parameters;

[0009] The dynamic rendering engine uses an adaptive lighting model and a dynamic texture mapping algorithm to render the 3D scene model in real time, generating a dynamic visual experience;

[0010] The interactive logic processing module predicts the possible next interaction actions of the user through a behavior prediction algorithm based on deep learning according to the user interaction data, and adjusts the element states in the 3D scene model accordingly;

[0011] The output display module outputs the rendered 3D scene model to a display device for the user to experience;

[0012] Among them, the adaptive lighting model dynamically adjusts the light source parameters according to the environmental parameters, and the dynamic texture mapping algorithm updates the texture information in the scene in real time according to the user interaction data.

[0013] Preferably, the user interaction data includes preset cultural and creative content and user behavior data;

[0014] The environmental parameters include ambient light intensity and temperature.

[0015] Preferably, the data acquisition module further includes a biometric sub-module for collecting the biometric data of the user.

[0016] Preferably, the 3D modeling module uses physics-based modeling technology to simulate the dynamic behavior of objects according to the physical properties of the objects, improving the realism of the 3D scene.

[0017] Preferably, the operation logic of the adaptive lighting model includes:

[0018]

[0019] Among them, L is the total light intensity;

[0020] L a is the ambient light intensity;

[0021] L i is the intensity of the i-th light source;

[0022] N is the surface normal vector;

[0023] l i is the direction vector of the i-th light source;

[0024] n is the number of light sources.

[0025] Preferably, the dynamic texture mapping algorithm includes:

[0026] Capture the texture changes in the user interaction area;

[0027] Apply texture synthesis technology to generate a new texture that matches the user interaction;

[0028] Real-time update the corresponding texture in the 3D scene model.

[0029] Preferably, the interactive logic processing module further includes an emotion recognition sub-module, which is used to recognize the user's emotional state by analyzing the user's facial expressions and speech intonations, and adjust the atmosphere and interactive content of the 3D scene accordingly.

[0030] Preferably, the system further includes a multi-sensory feedback module, which is used to provide feedback to the user through multiple sensory channels such as sound, vibration, and smell according to the changes in the 3D scene.

[0031] Preferably, the system further includes a cloud data processing center, which is used to store, analyze, and optimize user interaction data, as well as update the 3D scene model and interactive logic processing algorithm.

[0032] Preferably, the system supports cross-platform operation and can provide a consistent user experience on different operating systems and hardware devices.

[0033] In summary, the present invention mainly has the following beneficial effects:

[0034] In the present invention, through high-precision data acquisition and real-time rendering technology, the present invention can provide users with a highly realistic 3D interactive experience, making users feel as if they are in a real scene, greatly enhancing the sense of immersion and participation; the interactive logic processing module can intelligently predict user behavior and make corresponding responses, making the interaction more smooth and natural, and improving the satisfaction of the user experience.

[0035] The present invention provides a new expression form for the cultural and creative industry, enabling designers to display creative content in the form of 3D interaction, enriching the expression forms and dissemination channels of creativity. Through advanced technologies such as dynamic texture mapping and adaptive lighting, the present invention makes the scene elements more vivid and delicate, helping to improve the artistic value and ornamental value of creative works.

[0036] The implementation of the present invention involves the integration and innovation of a number of cutting-edge technologies, such as deep learning, physics engines, cross-platform frameworks, etc., which promotes the research and application process of related technologies; through the intelligent analysis of the cloud data processing center, the present invention can provide users with a personalized interactive experience, providing strong support for the development of intelligent services. Brief Description of the Drawings

[0037] Figure 1 It is the overall structural framework diagram of the present invention.

[0038] Description of the Drawings: 10, data acquisition module; 11, biometric sub-module; 20, 3D modeling module; 30, dynamic rendering engine; 40, interactive logic processing module; 41, emotion recognition sub-module; 50, output display module; 60, multi-sensory feedback module; 70, cloud data processing center. Detailed Implementation Manner

[0039] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention.

[0040] As Figure 1 shown, a 3D cultural and creative digital interactive experience system includes a data acquisition module 10, a 3D modeling module 20, a dynamic rendering engine 30, an interactive logic processing module 40, and an output display module 50. The data acquisition module 10 is used to collect user interaction data and environmental parameters;

[0041] The 3D modeling module 20 constructs a 3D scene model based on the user interaction data and environmental parameters;

[0042] The dynamic rendering engine 30 uses an adaptive lighting model and a dynamic texture mapping algorithm to render the 3D scene model in real time and generate a dynamic visual experience;

[0043] The interactive logic processing module 40 predicts the possible next interaction actions of the user through a behavior prediction algorithm based on deep learning according to the user interaction data, and adjusts the element states in the 3D scene model accordingly;

[0044] The output display module 50 outputs the rendered 3D scene model to a display device for the user to experience;

[0045] Among them, the adaptive lighting model dynamically adjusts the light source parameters according to the environmental parameters, and the dynamic texture mapping algorithm updates the texture information in the scene in real time according to the user interaction data.

[0046] The user interaction data includes preset cultural and creative content and user behavior data;

[0047] The environmental parameters include environmental light intensity and temperature.

[0048] The data acquisition module 10 further includes a biometric sub-module 11 for collecting the biometric data of the user.

[0049] The 3D modeling module uses physics-based modeling technology to simulate the dynamic behavior of objects according to the physical properties of the objects, improving the realism of the 3D scene.

[0050] The operation logic of the adaptive lighting model includes:

[0051]

[0052] Among them, L is the total light intensity;

[0053] L a is the ambient light intensity;

[0054] L i is the intensity of the i-th light source;

[0055] N is the surface normal vector;

[0056] l i is the direction vector of the i-th light source;

[0057] n is the number of light sources.

[0058] The dynamic texture mapping algorithm includes:

[0059] Capturing the texture changes in the user interaction area;

[0060] Applying texture synthesis technology to generate a new texture that conforms to the user interaction;

[0061] Updating the corresponding texture in the 3D scene model in real time.

[0062] The interaction logic processing module 40 further includes an emotion recognition sub-module 41, which is used to recognize the user's emotional state by analyzing the user's facial expressions and speech intonations, and adjust the atmosphere and interaction content of the 3D scene accordingly.

[0063] The system further includes a multi-sensory feedback module 60, which is used to provide feedback to the user through multiple sensory channels such as sound, vibration, and smell according to the changes in the 3D scene.

[0064] The system further includes a cloud data processing center 70, which is used to store, analyze, and optimize user interaction data, as well as update the 3D scene model and interaction logic processing algorithm.

[0065] The system supports cross-platform operation and can provide a consistent user experience on different operating systems and hardware devices.

[0066] Example 1:

[0067] It should be noted that in this embodiment, it is used to illustrate the construction and operation process of this 3D cultural and creative digital interactive experience system;

[0068] First, the data acquisition module 10 collects the user's interaction data, such as gestures, voices, and facial expressions, through devices such as cameras, microphones, and biometric sensors; and environmental parameters, such as light intensity and temperature.

[0069] This data is transmitted to the 3D modeling module 20, which uses physics-based modeling technology to construct a 3D scene model according to preset cultural and creative content, such as ancient palaces, future cities, etc.

[0070] The dynamic rendering engine 30 adopts an adaptive lighting model and a dynamic texture mapping algorithm to render the 3D scene model in real time.

[0071] The adaptive lighting model adjusts the light source parameters according to the environmental parameters, making the lighting effect in the scene more realistic and natural.

[0072] The dynamic texture mapping algorithm updates the texture information in the scene in real time according to the user interaction data. For example, when the user touches the wall, the wall texture will change.

[0073] The interactive logic processing module 40 predicts the possible next interaction actions of the user through a behavior prediction algorithm based on deep learning, and adjusts the element states in the 3D scene model accordingly; for example, when the user approaches a virtual door, the door will automatically open.

[0074] In addition, the emotion recognition sub-module 41 recognizes the user's emotional state by analyzing the user's facial expressions and speech intonations, and adjusts the atmosphere and interactive content of the scene accordingly.

[0075] Finally, the rendered 3D scene model is output to a display device, such as a VR headset, a large screen monitor, etc., for the user to experience.

[0076] At the same time, the multi-sensory feedback module 60 provides feedback to the user through multiple sensory channels such as sound, vibration, smell, etc., enhancing the immersion of the user experience.

[0077] Embodiment 2:

[0078] It should be noted that in this embodiment, it is used to further illustrate the optimization process;

[0079] Cloud data processing center: Establish a cloud data processing center for storing, analyzing and optimizing user interaction data. By analyzing the user behavior patterns, the 3D scene model and the interactive logic processing algorithm can be continuously optimized to improve the intelligence level of the system.

[0080] Cross-platform operation support: Develop a cross-platform operation framework so that the system can provide a consistent user experience on different operating systems and hardware devices. This helps to expand the application scope and user group of the system.

[0081] Multi-sensory feedback technology: Introduce more types of sensory feedback technologies, such as temperature sensing, smell release, etc., to further enrich the dimension and depth of the user experience. These technologies can be linked with the elements in the 3D scene. For example, when the user enters a virtual forest, the system can release a fresh forest smell.

[0082] Through the implementation of the above improvement measures, the user experience of this system will be significantly improved, and at the same time, the intelligence level and scalability of the system will also be enhanced.

[0083] The above embodiments are only for illustrating the technical idea of the present invention, and the protection scope of the present invention cannot be limited thereby. Any changes made on the basis of the technical solution according to the technical idea proposed by the present invention shall fall within the protection scope of the present invention.

Claims

1. A three-dimensional cultural creative digital interactive experience system, comprising a data acquisition module (10), a three-dimensional modeling module (20), a dynamic rendering engine (30), an interactive logic processing module (40), and an output display module (50), characterized in that , the data acquisition module (10) is used to collect user interaction data and environmental parameters; The three-dimensional modeling module (20) constructs a three-dimensional scene model based on the user interaction data and environmental parameters; The dynamic rendering engine (30) uses an adaptive illumination model and a dynamic texture mapping algorithm to render the three-dimensional scene model in real time to generate a dynamic visual experience; The interactive logic processing module (40) predicts the user's next possible interactive action based on the user interaction data by using a behavior prediction algorithm based on deep learning, and adjusts the element state in the three-dimensional scene model accordingly; The output display module (50) outputs the rendered three-dimensional scene model to a display device for user experience; The adaptive illumination model dynamically adjusts light source parameters according to environmental parameters, and the dynamic texture mapping algorithm updates texture information in the scene in real time according to user interaction data.

2. A three-dimensional cultural creative digital interactive experience system according to claim 1, characterized in that: The user interaction data includes preset cultural and creative content and user behavior data; The environmental parameters include ambient light intensity and temperature.

3. A three-dimensional cultural creative digital interactive experience system according to claim 1, characterized in that: The data collection module (10) also includes a biometric identification submodule (11) for collecting biometric characteristic data of a user.

4. A three-dimensional cultural creative digital interactive experience system according to claim 1, characterized in that: The three-dimensional modeling module adopts a physics-based modeling technology to simulate the dynamic behavior of an object according to its physical properties, thereby improving the realism of the three-dimensional scene.

5. A three-dimensional cultural creative digital interactive experience system according to claim 1, characterized in that: The operation logic of the adaptive illumination model includes: Where, L is the total light intensity; L a is the ambient light intensity; L i is the intensity of the i-th light source; N is the surface normal vector; is the direction vector of the i-th light source; n is the number of light sources.

6. A three-dimensional cultural creative digital interactive experience system according to claim 1, characterized in that: The dynamic texture mapping algorithm includes: Capture texture changes in user interaction areas; Apply texture synthesis techniques to generate new textures that match user interactions; Update the corresponding texture in the 3D scene model in real time.

7. A three-dimensional cultural creative digital interactive experience system according to claim 1, characterized in that: The interactive logic processing module (40) also includes an emotion recognition submodule (41) for identifying the user's emotional state by analyzing the user's facial expressions and voice intonation, and adjusting the atmosphere and interactive content of the three-dimensional scene accordingly.

8. A three-dimensional cultural creative digital interactive experience system according to claim 1, characterized in that: The system also includes a multi-sensory feedback module (60) for providing feedback to the user through multiple sensory channels such as sound, vibration, and smell according to changes in the three-dimensional scene.

9. A three-dimensional cultural creative digital interactive experience system according to claim 1, characterized in that: The system also includes a cloud data processing center (70) for storing, analyzing and optimizing user interaction data, and updating three-dimensional scene models and interactive logic processing algorithms.

10. A three-dimensional cultural creative digital interactive experience system according to claims 1 to 9, characterized in that: The system supports cross-platform operation and can provide a consistent user experience on different operating systems and hardware devices.

Images