Virtual reality visualization system based on digital twin driving

Abstract

The invention relates to the technical field of virtual reality systems, and discloses a virtual reality visualization system based on digital twinning drive, which comprises a three-dimensional modeling module used for presenting entities of a physical world in a digital form; the three-dimensional rendering module is used for presenting the three-dimensional model to a user in a highly realistic manner; and the three-dimensional scene interaction module is used for realizing interaction operation between the user and the three-dimensional scene. According to the virtual reality visualization system based on the digital twinning drive, high reduction and simulation of an entity system can be realized through a digital twinning technology, and changes and states of a physical world can be captured in real time, so that after the digital twinning drive is added to the virtual reality visualization system, data presented by the system can be ensured to be more accurate and real; the actual state of the physical world is reflected, a user can make a more intelligent decision, and the practicability and reliability of the system are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of virtual reality systems, and in particular to a virtual reality visualization system driven by digital twins. Background Art

[0002] Virtual reality visualization system is a high-tech that has emerged in the field of graphics and images in recent years. It uses computer technology to simulate a three-dimensional virtual world, providing users with simulations of multiple senses such as vision, hearing, and touch, making users feel as if they are in the scene and can observe things in this virtual world in real time and without restrictions.

[0003] Virtual reality visualization system has a wide range of application areas, including entertainment and games, education and training, design and architecture, tourism and cultural experience, etc. In summary, virtual reality visualization system is a high-tech technology that uses computer technology to simulate and generate a virtual world, which has broad application prospects and huge market potential.

[0004] However, the current virtual reality visualization system that lacks digital twin drive may not be able to accurately obtain and reflect the real state of the physical world, resulting in distortion of simulation results. This distortion may affect the user's judgment and decision-making and reduce the practicality of the system. If the virtual reality visualization system is not based on digital twin drive, it may need to build and maintain complex virtual models separately, which not only increases the complexity and cost of the system, but also may cause the deviation between the model and the actual physical world to gradually increase, reducing the accuracy and reliability of the system. At the same time, if the virtual reality visualization system is not based on digital twin drive, it may face limitations in scalability and interoperability, which may make it difficult for the system to seamlessly connect and share data with other systems or devices, reducing the overall performance and flexibility of the system. Summary of the invention

[0005] In view of the above-mentioned existing virtual reality visualization systems but lacking digital twin drive, a virtual reality visualization system may not be able to accurately obtain and reflect the real state of the physical world, resulting in distortion of simulation results. This distortion may affect the user's judgment and decision-making and reduce the practicality of the system. If the virtual reality visualization system is not based on digital twin drive, it may be necessary to separately build and maintain complex virtual models, which not only increases the complexity and cost of the system, but may also cause the deviation between the model and the actual physical world to gradually increase, reducing the accuracy and reliability of the system. At the same time, if the virtual reality visualization system is not based on digital twin drive, it may face limitations in scalability and interoperability, which may make it difficult for the system to seamlessly connect and share data with other systems or devices, reducing the overall performance and flexibility of the system. The present invention is proposed.

[0006] Therefore, the purpose of the present invention is to provide a virtual reality visualization system based on digital twin drive, the purpose of which is to achieve a high degree of restoration and simulation of the physical system through digital twin technology, and capture the changes and status of the physical world in real time. Therefore, when the virtual reality visualization system adds digital twin drive, it can ensure that the data presented by the system is more accurate and real, reflecting the actual state of the physical world, helping users to make more informed decisions, and improving the practicality and reliability of the system. By utilizing the real-time nature of digital twin technology, it can reflect the changes in the physical world in real time. Combined with the virtual reality visualization system, users can see the dynamic changes of the physical world in real time and interact in real time in the virtual environment. This real-time and dynamic nature enhances the user's sense of immersion and reality in the virtual environment, allowing users to understand the dynamic changes of the physical world more accurately.

[0007] In order to solve the above technical problems, the present invention provides the following technical solutions: a virtual reality visualization system driven by digital twins, including a three-dimensional modeling module responsible for presenting entities in the physical world in a digital form;

[0008] The 3D rendering module is responsible for presenting the 3D model to the user in a realistic manner;

[0009] The 3D scene interaction module is responsible for realizing the interaction between the user and the 3D scene;

[0010] Spatial GIS fusion module, responsible for the deep integration of geographic information system (GIS) and 3D visualization platform;

[0011] The data integration and processing module is responsible for integrating, cleaning, converting and storing data from different data sources;

[0012] The platform management and maintenance module is responsible for the operation monitoring, performance optimization and security assurance of the entire platform.

[0013] As a preferred solution of the virtual reality visualization system driven by digital twins described in the present invention, the three-dimensional modeling module includes a modeling tool and technology module, a model optimization and processing module, and a data format module, and the modeling tool and technology module includes three-dimensional scanning equipment, camera measurement technology, and three-dimensional modeling software.

[0014] As a preferred solution of the virtual reality visualization system driven by digital twins described in the present invention, the three-dimensional rendering module includes a rendering engine module, a light and shadow calculation and texture mapping module, a rendering and detail processing module, a rendering style and effect module, a real-time rendering and performance optimization module, and a compatibility and extensibility module.

[0015] As a preferred solution of the virtual reality visualization system driven by digital twins described in the present invention, the three-dimensional scene interaction module includes an interactive device module, an interactive function module, an interactive interface and feedback module, and an interactive logic and process module.

[0016] As a preferred solution of the virtual reality visualization system driven by digital twins described in the present invention, the spatial GIS fusion module includes a GIS data integration and processing module, a GIS spatial analysis and visualization module, a digital twin and GIS fusion module, an interaction and decision support module, and a data security and privacy protection module.

[0017] As a preferred solution of the virtual reality visualization system driven by digital twins described in the present invention, the data integration and processing module includes a data integration module, a data processing module, a data storage and management module, a monitoring and improvement module, and a collaborative module.

[0018] As a preferred solution of the virtual reality visualization system driven by digital twins described in the present invention, the platform management and maintenance module includes an operation monitoring module, a performance optimization module, a security assurance module and a daily maintenance module.

[0019] The beneficial effects of the present invention are as follows: through the digital twin technology, it is possible to achieve a high degree of restoration and simulation of the physical system, and capture the changes and states of the physical world in real time. Therefore, when the virtual reality visualization system adds a digital twin driver, it can ensure that the data presented by the system is more accurate and real, reflecting the actual state of the physical world, helping users to make more informed decisions, and improving the practicality and reliability of the system. In addition, the real-time nature of the digital twin technology can reflect the changes in the physical world in real time. Combined with the virtual reality visualization system, users can see the dynamic changes of the physical world in real time and interact in real time in the virtual environment. This real-time and dynamic nature improves the user's immersion and sense of reality in the virtual environment, allowing users to understand the dynamic changes of the physical world more accurately. The construction of the digital twin model requires the collection of a large amount of physical world data and simulation and analysis through complex algorithms. Once the model is established, it can be easily updated and maintained. In contrast, the traditional virtual reality visualization system may need to separately build and maintain complex virtual models, which increases the complexity and cost of the system. The virtual reality visualization system based on digital twins can make full use of the advantages of the digital twin model, simplify the process of model construction and maintenance, and reduce the complexity and cost of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. Among them:

[0021] Figure 1 This is a schematic diagram of the process framework of the virtual reality visualization system driven by digital twins in the present invention. DETAILED DESCRIPTION

[0022] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the accompanying drawings.

[0023] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0024] Reference Figure 1 , is an embodiment of the present invention, and provides a virtual reality visualization system driven by digital twins, and the virtual reality visualization system driven by digital twins includes:

[0025] The 3D modeling module is the basic module of the digital twin 3D visualization platform, which is responsible for presenting entities in the physical world in a digital form;

[0026] The 3D rendering module is one of the core modules of the digital twin 3D visualization platform. It is responsible for presenting the 3D model to the user in a realistic way. Through light and shadow calculation, texture mapping, material rendering and other technical means, it simulates various lighting conditions, material properties and surface details in the physical world, so that the 3D model presents a realistic visual effect in the digital environment.

[0027] The 3D scene interaction module is an important part of the digital twin 3D visualization platform. It is responsible for realizing the interactive operation between users and 3D scenes, allowing users to interact with the digital world more conveniently.

[0028] The spatial GIS fusion module is one of the key modules of the digital twin 3D visualization platform. It is responsible for deeply integrating the geographic information system (GIS) with the 3D visualization platform, allowing users to directly query, analyze and process geographic information data in the 3D scene, so as to more intuitively understand the spatial distribution and geographical characteristics of the physical world.

[0029] The data integration and processing module is an important supporting module of the digital twin 3D visualization platform, responsible for integrating, cleaning, converting and storing data from different data sources;

[0030] The platform management and maintenance module is an auxiliary module of the digital twin 3D visualization platform, which is responsible for the operation monitoring, performance optimization and security assurance of the entire platform.

[0031] The three-dimensional modeling module includes a modeling tool and technology module, a model optimization and processing module, and a data format module;

[0032] Modeling tools and technology modules:

[0033] 3D scanning equipment, using 3D scanners and other equipment to scan physical entities with high precision to obtain data such as their geometric shape and texture information;

[0034] Photogrammetry technology takes multiple photos of a physical entity and uses the principles of photogrammetry to perform three-dimensional reconstruction to obtain a three-dimensional model of the entity;

[0035] 3D modeling software is the use of professional 3D modeling software (such as Pro / ENGINEER, 3D Max, Maya, etc.) for manual or semi-automatic 3D modeling to create a virtual 3D model of a physical entity based on data obtained from scanning or photogrammetry.

[0036] Model optimization and processing module:

[0037] Geometry optimization: Optimize the geometry of the initially established 3D model, including adjusting the size, proportion, shape, etc. of the model to ensure its high consistency with the physical entity;

[0038] Texture mapping and material processing: Add textures and materials to 3D models to make them look more realistic. This includes mapping scanned or photographed texture images to the model surface and setting the model's material properties (such as reflectivity, transparency, etc.);

[0039] Simplification and lightweighting: Under the premise of ensuring model accuracy and visual effects, the 3D model is simplified and lightweight to reduce the complexity of the model and the rendering burden.

[0040] Data format module:

[0041] Support multiple data formats: The 3D modeling module needs to support the input and output of multiple data formats, including common 3D model formats (such as OBJ, STL, FBX, etc.) and image formats (such as JPEG, PNG, etc.)

[0042] Data compatibility: Ensure that the generated 3D model can seamlessly connect and interact with other modules (such as 3D rendering module, data analysis module, etc.) to achieve data sharing and collaborative work.

[0043] The three-dimensional rendering module includes a rendering engine module, a light and shadow calculation and texture mapping module, a rendering and detail processing module, a rendering style and effect module, a real-time rendering and performance optimization module, and a compatibility and extensibility module;

[0044] The rendering engine module is the core of the 3D rendering module. It is responsible for processing the rendering tasks of the 3D model. It provides a wealth of rendering functions and optimization options, and can simulate various lighting conditions, material properties and surface details in the physical world, so that the 3D model presents realistic visual effects in the digital environment.

[0045] The light and shadow calculation and texture mapping module includes light and shadow calculation and texture mapping;

[0046] Light and shadow calculation: The rendering engine enhances the three-dimensional sense and realism of the three-dimensional scene by simulating light and shadow effects such as sunlight, ambient light, and shadows. This includes calculating parameters such as the position, color, and intensity of the light source, as well as the reflection, refraction, and shadow effects on the surface of the object.

[0047] Texture mapping: Mapping a two-dimensional texture image onto the surface of a three-dimensional model to increase the details and realism of the model. This includes operations such as loading, cropping, scaling, and rotating texture images, as well as calculating and mapping texture coordinates.

[0048] The rendering and detail processing module includes material rendering and surface detail processing;

[0049] Material rendering: Render different material effects according to the material properties of the model (such as reflectivity, refractive index, transparency, etc.), including simulation of various materials such as metal, plastic, glass, wood, etc.;

[0050] Surface detail processing: Enhance the details and realism of the model surface by adding detail textures, normal maps, highlight maps, etc.; maps can simulate tiny bumps, scratches, gloss and other effects on the surface of objects

[0051] The rendering style and effects module includes a variety of rendering styles and special rendering effects;

[0052] Multiple rendering styles: The rendering engine supports multiple rendering styles, such as realistic style, cartoon style, ink style, etc., to meet the aesthetic needs of different users;

[0053] Special rendering effects: such as depth of field effect, motion blur effect, global illumination effect, etc. These effects can further enhance the realism and immersion of 3D scenes;

[0054] Real-time rendering and performance optimization modules include:

[0055] Real-time rendering: The rendering engine needs to be able to complete rendering tasks under real-time conditions, that is, users can see smooth and continuous 3D scenes during the interaction process; the rendering engine is required to have efficient rendering algorithms and optimized rendering pipelines;

[0056] Performance optimization: In order to improve rendering efficiency and reduce system burden, the rendering module needs to be optimized, including reducing unnecessary rendering calculations, optimizing the rendering pipeline, and using hardware acceleration.

[0057] Compatibility and extensibility modules include:

[0058] Compatibility: The rendering module needs to support multiple 3D model formats and data interfaces to ensure seamless docking and interaction with other modules in the digital twin system;

[0059] Extensibility: The rendering module needs to have good extensibility so that new rendering functions can be added or existing functions can be optimized when needed.

[0060] The three-dimensional scene interaction module includes an interaction device module, an interaction function module, an interaction interface and feedback module, an interaction logic and process module, and a compatibility and extensibility module;

[0061] The interactive device module includes input devices, voice interaction and gesture recognition;

[0062] The interactive function modules include roaming and navigation, zooming and rotating, selection and operation, and information query;

[0063] The interactive interface and feedback module includes:

[0064] Interactive interface: Provide a user-friendly interactive interface, including menus, toolbars, prompt boxes, etc., so that users can easily call various interactive functions;

[0065] Visual feedback: Feedback the results and status of interactive operations to users through visual changes such as color, brightness, and transparency;

[0066] Sound feedback: Deliver interactive operation information and feedback to users through sound effects or voice prompts;

[0067] The interactive logic and process modules include event processing, state management, and process control;

[0068] The spatial GIS fusion module includes a GIS data integration and processing module, a GIS spatial analysis and visualization module, a digital twin and GIS fusion module, an interaction and decision support module, and a data security and privacy protection module.

[0069] The GIS data integration and processing module includes data acquisition, data format conversion, and data cleaning and integration;

[0070] GIS spatial analysis and visualization module includes spatial query, spatial analysis and visualization display;

[0071] The fusion modules of digital twin and GIS include:

[0072] Digital twin model construction: Build a digital twin model based on GIS data to achieve real-time mapping and interaction between the physical world and the digital world;

[0073] Real-time monitoring and updating: The digital twin model monitors changes in the physical world in real time and updates GIS data to ensure the timeliness and accuracy of spatial information;

[0074] Simulation and optimization: Use the simulation and optimization functions of digital twin technology to simulate and optimize spatial data, such as traffic congestion analysis and facility layout optimization, to provide a scientific basis for urban planning and traffic management;

[0075] The interaction and decision support module includes the interaction interface and decision support;

[0076] The data security and privacy protection module includes:

[0077] Data encryption: Encrypt spatial data to ensure data security during transmission and storage;

[0078] Access control: Set access control policies based on user permissions to prevent unauthorized access and operations;

[0079] Privacy protection: When processing and analyzing spatial data, strictly abide by privacy protection regulations to ensure that user privacy is not leaked.

[0080] The data integration and processing module includes a data integration module, a data processing module, a data storage and management module, a monitoring and improvement module, and a collaboration module;

[0081] The data integration module includes multi-source data access and data format standardization;

[0082] The data processing module includes:

[0083] Data cleaning: remove redundant, duplicate and erroneous data, improve data quality, identify and process outliers and missing values ​​in the data;

[0084] Data conversion: Convert data as needed, such as data type conversion, data format conversion, etc. Convert data into a form suitable for digital twin system analysis and visualization;

[0085] Data integration: Integrate data from different data sources to form a complete data set, ensuring the consistency and accuracy of the data set;

[0086] The data storage and management module includes database design, data backup and recovery, and data security and privacy protection;

[0087] The monitoring and improvement modules include:

[0088] Data quality monitoring: real-time monitoring of data quality, including data integrity, accuracy, consistency, and timeliness, timely detection and handling of data quality issues;

[0089] Improve data quality: Use technical means such as data cleaning, data conversion and data integration to improve data quality, and continuously optimize data processing processes and methods to improve the efficiency and accuracy of data processing;

[0090] The collaboration module includes collaboration with the 3D modeling module, collaboration with the 3D rendering module and collaboration with the 3D scene interaction module.

[0091] The platform management and maintenance module includes an operation monitoring module, a performance optimization module, a security assurance module and a daily maintenance module;

[0092] The operation monitoring module includes:

[0093] Real-time monitoring: Real-time monitoring of the platform's operating status, including server status, network status, data status, etc., through a visual monitoring interface, to display various performance indicators of the platform in real time;

[0094] Abnormal detection and alarm: set abnormal thresholds. When the platform operation indicators exceed the thresholds, the alarm mechanism is automatically triggered. Multiple alarm methods are provided, such as email, SMS, sound, etc., to ensure that administrators can detect and handle abnormal situations in a timely manner;

[0095] Performance optimization modules include:

[0096] Resource scheduling: Dynamically adjust server resources according to the platform load to ensure the stable operation of the platform and provide resource scheduling strategies such as load balancing and resource reservation;

[0097] Cache management: effectively manage the platform's cache, improve data access speed, provide cache cleaning, cache update and other functions, and ensure the accuracy and timeliness of cache data;

[0098] Log management: collects and stores the platform's operation logs, including system logs, application logs, etc., and provides log query and analysis functions to help administrators understand the platform's operation status;

[0099] The security modules include:

[0100] Access control: strictly control access to the platform to ensure that only authorized users can access the platform, and provide multiple authentication methods, such as username and password, fingerprint recognition, facial recognition, etc.;

[0101] Data encryption: Encrypt the data transmitted and stored on the platform to ensure data security, and provide a variety of encryption algorithms and key management methods to meet different security requirements;

[0102] Firewall and intrusion detection: deploy firewalls to prevent external attacks and illegal access, provide intrusion detection functions, and promptly detect and handle potential security threats;

[0103] Daily maintenance modules include:

[0104] Data backup and recovery: Back up the platform data regularly to ensure data security and recoverability; provide data recovery function to quickly restore data when it is lost or damaged;

[0105] Software updates and upgrades: Regularly update and upgrade the platform's software, fix known vulnerabilities, and improve system stability and security; provide software update notifications and automatic upgrade functions to ensure that administrators can obtain the latest software version in a timely manner;

[0106] User authority management: Manage the authority of platform users to ensure that different users have different operating authorities. Provide functions such as user authority query and modification to facilitate administrators to flexibly manage user authorities.

[0107] By using digital twin technology, it is possible to achieve a high degree of restoration and simulation of the physical system and capture the changes and status of the physical world in real time. Therefore, when the virtual reality visualization system adds a digital twin driver, it can ensure that the data presented by the system is more accurate and real, reflecting the actual state of the physical world, helping users make more informed decisions, and improving the practicality and reliability of the system. In addition, the real-time nature of digital twin technology can reflect changes in the physical world in real time. Combined with the virtual reality visualization system, users can see the dynamic changes of the physical world in real time and interact in real time in the virtual environment. This real-time and dynamic nature improves the user's immersion and sense of reality in the virtual environment, allowing users to understand the dynamic changes of the physical world more accurately. The construction of the digital twin model requires the collection of a large amount of physical world data and simulation and analysis through complex algorithms. Once the model is established, it can be easily updated and maintained. In contrast, traditional virtual reality visualization systems may need to separately build and maintain complex virtual models, which increases the complexity and cost of the system. The virtual reality visualization system based on digital twins can make full use of the advantages of digital twin models, simplify the process of model construction and maintenance, and reduce the complexity and cost of the system.

[0108] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A virtual reality visualization system driven by digital twins, characterized in that: include: The 3D modeling module is responsible for presenting entities in the physical world in digital form; The 3D rendering module is responsible for presenting the 3D model to the user in a realistic manner; The 3D scene interaction module is responsible for realizing the interaction between the user and the 3D scene; Spatial GIS fusion module, responsible for the deep integration of geographic information system (GIS) and 3D visualization platform; The data integration and processing module is responsible for integrating, cleaning, converting and storing data from different data sources; The platform management and maintenance module is responsible for the operation monitoring, performance optimization and security assurance of the entire platform.

2. The virtual reality visualization system based on digital twin drive according to claim 1, characterized in that: The three-dimensional modeling module includes a modeling tool and technology module, a model optimization and processing module, and a data format module. The modeling tool and technology module includes a three-dimensional scanning device, a camera measurement technology, and a three-dimensional modeling software.

3. The virtual reality visualization system based on digital twin drive according to claim 2 is characterized in that: The three-dimensional rendering module includes a rendering engine module, a light and shadow calculation and texture mapping module, a rendering and detail processing module, a rendering style and effect module, a real-time rendering and performance optimization module, and a compatibility and extensibility module.

4. The virtual reality visualization system based on digital twin drive according to claim 3 is characterized in that: The three-dimensional scene interaction module includes an interaction device module, an interaction function module, an interaction interface and feedback module, and an interaction logic and process module.

5. The virtual reality visualization system based on digital twin drive according to claim 4 is characterized in that: The spatial GIS fusion module includes a GIS data integration and processing module, a GIS spatial analysis and visualization module, a digital twin and GIS fusion module, an interaction and decision support module, and a data security and privacy protection module.

6. The virtual reality visualization system based on digital twin drive according to claim 5 is characterized in that: The data integration and processing module includes a data integration module, a data processing module, a data storage and management module, a monitoring and improvement module and a coordination module.

7. The virtual reality visualization system based on digital twin drive according to claim 6 is characterized in that: The platform management and maintenance module includes an operation monitoring module, a performance optimization module, a security assurance module and a daily maintenance module.

Images