Multi-party cooperation and intelligent decision support digital sand table system based on UE

Abstract

The invention relates to the technical field of information processing, and discloses a multi-party cooperation and intelligent decision support digital sand table system based on UE, and the system comprises a data layer, a rendering layer, an interaction layer, an analysis layer and a cooperation and decision layer, and achieves the seamless connection with building information model data through a BIM data integration module. A realistic virtual scene is presented by utilizing an Unreal Engine 5 real-time rendering technology, immersive interactive experience is provided, parameters such as construction progress and material consumption are analyzed in real time, and support is provided for project management and decision making. In addition, the system also has multi-party cooperation and information sharing functions, so that a project team can make a decision efficiently, and the project management efficiency is improved. According to the invention, a brand new digital sand table solution is provided for the construction industry, and the planning, management and decision-making processes of modern construction projects are assisted.

Description

Technical Field

[0001] The present invention relates to the field of information processing technology, and in particular to a UE-based multi-party collaboration and intelligent decision support digital sandbox system. Background Art

[0002] With the rapid development of information technology and the continuous progress of the construction industry, digital sandbox technology has emerged to better carry out project planning, management and decision-making, and has gradually been widely used in the construction industry.

[0003] Traditional sandbox models can no longer meet the complex needs of modern construction project management. Specifically, existing digital sandbox technology has the following deficiencies:

[0004] Data integration issues: When processing Building Information Modeling (BIM) data, traditional digital sandbox systems often have problems such as incompatible data formats and untimely updates, which affect the consistency and accuracy of the data.

[0005] Limited visualization effects: Some existing digital sandbox systems have difficulty achieving highly realistic effects when rendering architectural models, which affects users’ intuitive perception of the project.

[0006] Insufficient interactivity: Traditional digital sandbox systems usually provide only limited interactive functions, making it difficult for users to explore and understand the details of the project in depth.

[0007] Lack of intelligent decision support: Existing systems rarely provide data analysis and decision support capabilities, and cannot meet the needs of project management teams in complex decision-making processes.

[0008] In order to solve the above problems, we propose a UE-based multi-party collaboration and intelligent decision support digital sandbox system. Summary of the invention

[0009] The purpose of the present invention is to provide a UE-based multi-party collaboration and intelligent decision support digital sandbox system to solve the problems raised in the above background technology.

[0010] To achieve the above-mentioned object, the present invention provides the following technical solutions: a UE-based multi-party collaboration and intelligent decision-making support digital sandbox system, comprising a data layer, a rendering layer, an interaction layer, an analysis layer, and a collaboration and decision-making layer;

[0011] The data layer is responsible for data integration, storage and management; the data layer includes a BIM data integration module and a data center module; the BIM data integration module is used to achieve docking with building information model data; the data center module is responsible for storing and managing the building structure data, material data and construction progress data required for the digital sandbox;

[0012] The rendering layer uses the real-time rendering technology of Unreal Engine 5 to achieve architectural simulation and visualization effects. The rendering layer includes a real-time rendering module and a visual effect module. The real-time rendering module is responsible for real-time rendering based on the data provided by the data layer to generate realistic virtual scenes. The visual effect module is responsible for optimizing the rendering effect and providing fine adjustment of light, shadow, and material details.

[0013] The interaction layer provides users with an immersive interactive experience through virtual reality and augmented reality technologies; the interaction layer includes a VR / AR interaction module and a user interface module; the VR / AR interaction module is responsible for realizing the interaction function between users and virtual scenes, and the interaction function includes scene roaming and object operation; the user interface module is used to provide an easy-to-use operation interface so that users can intuitively perform various operations and controls;

[0014] The analysis layer is responsible for analyzing the process parameters to provide support for project management and decision-making; the analysis layer includes a process parameter analysis module and a machine learning module; the process parameter analysis module is responsible for real-time acquisition and analysis of construction progress and material consumption parameters, and generating corresponding analysis reports; the machine learning module is responsible for predicting future construction progress and material requirements based on the analysis results of the process parameter analysis module;

[0015] The collaboration and decision-making layer provides multi-party collaboration and decision-making support functions, and the collaboration and decision-making layer includes a collaboration and communication module and a decision support module; the collaboration and communication module is responsible for realizing real-time collaboration and information sharing functions among project teams, so that all parties can obtain the latest information at any time and communicate effectively; the decision support module provides users with decision support functions based on real-time data and analysis results.

[0016] Preferably, the BIM data integration module is connected to the building information model data source through a preset data interface to achieve data docking; the BIM data integration module includes a format processing submodule and a data synchronization submodule; the format processing submodule is used to read and parse the format of BIM data, and convert the parsed data into a format recognizable by the digital sandbox system; the data synchronization submodule is used to receive and update changes in the BIM data source in real time, so that the data in the digital sandbox system is consistent with the BIM data source.

[0017] Preferably, the real-time rendering module receives building structure data, material data and construction progress data provided by the data layer; uses the graphics rendering engine of Unreal Engine 5 to perform real-time rendering of the building model according to the received data; and during the rendering process, generates a three-dimensional building scene image in combination with visual information, wherein the visual information includes light and shadow, texture and material of the object.

[0018] Preferably, the visual effects module receives the architectural scene image rendered by the real-time rendering module; and performs post-processing on the received architectural scene image, including light and shadow adjustment, color correction and material detail enhancement; the light and shadow adjustment optimizes the lighting effect of the scene by adjusting the light source parameters in the scene; the color correction makes the image more realistic and natural by adjusting the color balance, contrast and brightness of the image; the material detail enhancement performs fine adjustments to the texture, reflection and refraction properties of the material.

[0019] Preferably, during the rendering process of the real-time rendering module, the specific algorithm of the illumination model for calculating the illumination intensity is:

[0020] I=I a K a +I d (K d ·(L·N))+I s ·(K s ·(R·V) n )

[0021] Where I is the final light intensity, I a is the ambient light intensity, K a The reflection coefficient of the object surface to the ambient light, I d is the direct light intensity, K d is the reflection coefficient of the object surface to direct light, L is the direction of the light source, N is the normal direction of the object surface, and I s is the specular reflection intensity of the light source, K s is the reflection coefficient of the object surface to the specular reflected light, R is the direction of the specular reflected light, V is the line of sight direction, and n is the sharpness index of the specular reflected light. These parameters are dynamically adjusted according to the light source and object material properties in the scene.

[0022] Preferably, the VR / AR interaction module receives virtual scene data generated from the rendering layer; uses virtual reality and augmented reality technology to present the virtual scene data in front of the user to create an immersive three-dimensional environment; updates the user's perspective and position in the virtual scene in real time by tracking the user's head, hands or other body parts; and implements selection, movement, rotation and scaling operations on objects in the virtual scene according to the user's interactive instructions, including clicks, drags and gesture recognition;

[0023] The user interface module includes menu, toolbar, property window and status bar components; the menu and toolbar provide various functional operation entrances of the digital sandbox system, including scene loading, perspective adjustment, object selection and property editing; the property window is used to display and edit the detailed property information of the currently selected object, including position, rotation angle, scaling and material mapping; the status bar is used to display system status information, including the current scene name, selected object information and operation prompts; receive user operation instructions, including clicks, drags and keyboard input, and update and feedback the operation results in real time on the interface according to specific instructions, so that the user can clearly understand the current system status and the properties of the selected object.

[0024] Preferably, the process parameter analysis module receives the construction progress and material consumption data provided by the data layer; pre-processes the received data, including data cleaning, format conversion and data standardization; uses statistical analysis methods to process the construction progress data, and calculates the construction period, progress deviation and key path indicators of each construction stage; analyzes the material consumption data, and calculates the actual material consumption, consumption rate and comparison with the budget; and outputs the analysis results in the form of a report.

[0025] Preferably, the collaboration and communication module builds a multi-party collaboration platform to support real-time online collaboration among project management team members, specifically including:

[0026] i) Real-time update and synchronization of project information to enable all team members to obtain the latest project data;

[0027] ii) Providing communication tools such as text chat, file sharing and online conferencing;

[0028] iii) Record and store the communication content and collaboration history of team members.

[0029] Preferably, the decision support module receives reports from the analysis layer, obtains analysis reports on material consumption, including actual consumption, consumption rate and expected consumption trend of various materials; integrates construction progress information with material consumption to provide users with a comprehensive project progress view; at the same time, users can intuitively understand the layout, construction progress and details of the construction site in a three-dimensional virtual environment through the VR / AR interaction module to assist users in making decisions.

[0030] Compared with the prior art, the present invention has the following beneficial effects:

[0031] 1. Efficiency and accuracy of data integration: Through the BIM data integration module, this system achieves seamless connection with the building information model data, effectively solving the problems of incompatible data formats and untimely updates in the traditional digital sandbox system. It not only improves the efficiency of data integration, but also ensures the consistency and accuracy of the data, providing a solid data foundation for subsequent project planning, management and decision-making.

[0032] 2. Realistic visualization effects: Using the real-time rendering technology of Unreal Engine 5, this system can generate highly realistic virtual scenes. The realistic visualization effects greatly enhance the user's intuitive perception of the project, allowing project managers and decision makers to grasp the overall situation and details of the project more accurately, thereby improving the quality and efficiency of decision-making.

[0033] 3. Immersive interactive experience: Through virtual reality and augmented reality technology, this system provides users with an immersive interactive experience. Users can operate directly in the virtual scene, which is as intuitive and natural as in the real world. This interactive method not only improves users' perception and understanding of the project, but also helps the project management team to better plan and make decisions.

[0034] 4. Data analysis and decision support: The analysis layer of this system can acquire and analyze key parameters such as construction progress and material consumption in real time, and generate corresponding analysis reports. These reports provide strong data support for the project management team, helping them make more informed choices in complex decision-making processes. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is the overall structure diagram of the present invention;

[0036] Figure 2 This is the sub-module structure diagram included in the BIM data integration module;

[0037] Figure 3 This is the functional structure diagram of the interaction layer. DETAILED DESCRIPTION

[0038] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0039] See also Figure 1-3The present invention provides a technical solution: a UE-based multi-party collaboration and intelligent decision-making support digital sandbox system, including a data layer, a rendering layer, an interaction layer, an analysis layer, and a collaboration and decision-making layer.

[0040] The data layer is the foundation of this system and is mainly responsible for data integration, storage and management. The data layer includes BIM data integration module and data center module.

[0041] BIM Data Integration Module: This module can achieve seamless connection with Building Information Model (BIM) data. Through standardized data interfaces, the BIM Data Integration Module can read and parse data exported by various BIM software to ensure data accuracy and consistency.

[0042] Data center module: This module is responsible for storing and managing the building structure data, material data and construction progress data required for the digital sandbox. Through efficient data storage and retrieval mechanisms, the data center module can quickly respond to data requests from upper-level applications.

[0043] The rendering layer uses the real-time rendering technology of Unreal Engine 5 to achieve realistic architectural simulation and visualization effects; the rendering layer includes a real-time rendering module and a visual effects module.

[0044] Real-time rendering module: Based on the data provided by the data layer, this module can generate realistic virtual building scenes in real time; through efficient rendering algorithms and optimization technologies, it ensures a smooth visual experience and high-quality image output.

[0045] Visual Effects Module: This module is responsible for optimizing rendering effects and providing fine-tuning of details such as light, shadow, and materials. By adjusting lighting conditions, material properties, and environmental parameters, the visual effects module can further enhance the realism and immersion of rendering.

[0046] The interaction layer provides users with an immersive interactive experience through virtual reality (VR) and augmented reality (AR) technologies; the interaction layer includes a VR / AR interaction module and a user interface module.

[0047] VR / AR interaction module: This module enables users to interact with virtual scenes, including scene roaming, object manipulation, etc. Users can use VR devices to explore architectural scenes in an immersive way and perform operations such as moving, rotating and scaling objects.

[0048] User interface module: provides an intuitive and easy-to-use operating interface, allowing users to easily perform various operations and controls; the user interface is concise and clear, conforms to the principles of human-computer interaction design, and reduces user learning costs.

[0049] The analysis layer is responsible for analyzing process parameters and providing support for project management and decision-making; the analysis layer includes a process parameter analysis module and a machine learning module.

[0050] Process parameter analysis module: This module can obtain and analyze parameters such as construction progress and material consumption in real time, and generate corresponding analysis reports; through data mining and statistical analysis techniques, it helps the project management team to promptly identify problems, optimize processes and improve efficiency.

[0051] The machine learning module is responsible for predicting future construction progress and material requirements based on the analysis results of the process parameter analysis module, so as to optimize resource allocation and improve construction efficiency.

[0052] The collaboration and decision-making layer provides multi-party collaboration and decision-making support functions, including collaboration and communication modules and decision support modules.

[0053] Collaboration and Communication Module: Realizes real-time collaboration and information sharing among project teams; through tools such as instant messaging, file sharing and task management, ensures that all parties can obtain the latest information and communicate effectively at any time.

[0054] Decision support module: Provides users with decision support functions based on real-time data and analysis results; helps project management teams make wise decisions and reduce potential risks through technical means such as data visualization, trend prediction and risk assessment.

[0055] The present invention will be further described below in conjunction with Examples 1 to 3:

[0056] Embodiment 1:

[0057] The BIM data integration module is connected to the building information model data source through a preset data interface to achieve data docking; the module includes a format processing submodule and a data synchronization submodule; the format processing submodule is used to read and parse the format of BIM data, and convert the parsed data into a format recognizable by the digital sandbox system; the data synchronization submodule is used to receive and update changes in the BIM data source in real time, so that the data in the digital sandbox system is consistent with the BIM data source.

[0058] During the system development process, the corresponding data interface is preset according to the type and format of the BIM data source. The interface can support mainstream BIM data formats, such as IFC and Revit RVT, and establish a stable connection with the BIM data source through API calls or data exchange protocols.

[0059] The format processing submodule implements: a. Data reading and parsing. Using a specialized library or API, the format processing submodule reads raw data from the BIM data source. For different BIM data formats, it is necessary to write corresponding parsing logic to correctly extract the geometric information, attribute data, etc. of the building model. b. Data format conversion. After the parsing is completed, the data is converted into the standard format used within the digital sandbox system. This usually involves mapping the elements in the BIM data to the data structure of the digital sandbox system to ensure the integrity and accuracy of the information. c. Error handling and logging. During the data reading, parsing and conversion process, a strict error handling mechanism is implemented. If any exceptions or errors are encountered, the format processing submodule should be able to record detailed error logs to facilitate subsequent problem troubleshooting and repair.

[0060] Data synchronization submodule implementation: a. Establish a monitoring mechanism. The data synchronization submodule detects changes in the BIM data source in real time by implementing a monitoring mechanism. This can be achieved by integrating with the API of the BIM software or using the monitoring function of the file system. b. Incremental update. When the BIM data source changes, the data synchronization submodule can identify the specific changes and synchronize only these changes to the digital sandbox system instead of reloading the entire model, which helps to improve the efficiency and response speed of data synchronization. c. Data consistency check. After the data synchronization is completed, a data consistency check is performed to ensure that the data in the digital sandbox system fully matches the BIM data source. If any inconsistency is found, a warning or error handling process should be triggered.

[0061] The BIM data integration module can efficiently connect with various BIM data sources to achieve accurate data reading, format conversion and real-time synchronization, providing a reliable data foundation for the digital sandbox system.

[0062] The real-time rendering module receives the building structure data, material data and construction progress data provided by the data layer; uses the graphics rendering engine of Unreal Engine 5 to perform real-time rendering of the building model according to the received data; during the rendering process, a three-dimensional building scene image is generated in combination with visual information, and the visual information includes the light and shadow, texture and material of the object. The specific implementation method is as follows:

[0063] The real-time rendering module first receives building structure data, material data and construction progress data from the data layer through a preset interface. These data have been processed by the BIM data integration module before transmission to ensure the consistency and accuracy of the data format. The received data will undergo necessary preprocessing, such as data cleaning and format conversion, to meet the needs of the UE5 rendering engine; using the UE5 scene editor, a virtual building scene is constructed based on the received building structure data, including the creation of building models, terrain, vegetation and other environmental elements; at the same time, the corresponding materials and textures are configured for the objects in the scene according to the material data; the real-time rendering parameters are set in UE5, including lighting model, shadow calculation, reflection and refraction, etc. These settings will ensure that the rendered image has realistic light and shadow effects and material performance. In addition, the camera parameters need to be configured to simulate different viewing angles and scene depths. In order to improve rendering efficiency and image quality, the rendering process needs to be optimized. This includes using LOD (Level of Detail) technology to adjust the level of detail of the model according to the distance, and using UE5's GPU particle system to optimize the rendering performance of large-scale scenes. As the construction progress data is updated, the real-time rendering module needs to dynamically adjust the state of the building model in the scene to reflect the latest construction progress; at the same time, in order to support user interaction, the module also needs to process input signals from the interaction layer, such as user perspective changes, object selection and other operations, and update the rendering results in real time to respond to these interactions.

[0064] During the rendering process of the real-time rendering module, the specific algorithm for calculating the illumination intensity by the illumination model is:

[0065] I=I a K a +I d (K d ·(L·N))+I s ·(K s ·(R·V) n )

[0066] Where I is the final light intensity, I a is the ambient light intensity, K a The reflection coefficient of the object surface to the ambient light, I d is the direct light intensity, K d is the reflection coefficient of the object surface to direct light, L is the direction of the light source, N is the normal direction of the object surface, and I s is the specular reflection intensity of the light source, K s is the reflection coefficient of the object surface to the specular reflected light, R is the direction of the specular reflected light, V is the line of sight direction, n is the sharpness index of the specular reflected light, and the final light intensity is equal to the sum of the contributions of ambient light, direct light and specular reflected light, that is, I = I 环境光 +I直射光 +I 镜面反射光 .

[0067] The contribution of ambient light to the surface of an object is calculated as the product of the ambient light intensity and the reflection coefficient of the object surface to the ambient light: I 环境光 =I a K a .

[0068] The contribution of direct light to the surface of an object is first determined by calculating the dot product of the light source direction and the normal direction of the object surface to determine the angle of illumination, and then multiplying it by the direct light intensity and the reflection coefficient of the object surface to the direct light: I 直射光 =I d (K d ·(L·N)).

[0069] The specular contribution is determined by calculating the dot product of the specular direction and the line of sight to determine the angle of specular light seen by the observer, and then multiplying it by the specular intensity of the light source and the reflectivity of the object surface: I 镜面反射光 =I s ·(K s ·(R·V) n ).

[0070] By comprehensively considering the contribution of multiple light sources, the algorithm can simulate more realistic and delicate lighting effects, enhancing the visual realism and immersion of the digital sandbox system. At the same time, since the parameters involved in the algorithm can be dynamically adjusted according to the scene and object material, it has high flexibility and adaptability. For example, in a construction site scene, various objects are given real material properties, such as concrete, metal, glass, etc. At the same time, according to the actual situation of the construction site, ambient light, direct light and possible specular reflection light sources, such as sunlight and surrounding reflective surfaces, are set. The illumination model algorithm described above is applied to dynamically calculate the illumination intensity of each object according to the light source and object material in the scene, including the overall illumination of the object by ambient light, the shadows and light and dark changes caused by direct light (such as sunlight), and the highlight effect brought by specular reflection light.

[0071] Embodiment 2:

[0072] The VR / AR interaction module receives virtual scene data generated by the rendering layer; uses virtual reality and augmented reality technology to present the virtual scene data in front of the user to create an immersive three-dimensional environment; updates the user's perspective and position in the virtual scene in real time by tracking the user's head, hands or other body parts; and implements the selection, movement, rotation and scaling of objects in the virtual scene according to the user's interactive instructions, including clicks, drags and gesture recognition. The specific implementation method includes the following five steps:

[0073] 1. Receiving virtual scene data: The VR / AR interaction module first receives the virtual scene data generated by the rendering layer. The data includes 3D models, textures, lighting information, etc., which are used to build an immersive virtual environment.

[0074] 2. Virtual environment creation: Using VR / AR technology, the received virtual scene data is presented to the user to create a realistic three-dimensional environment, which involves the use of specialized VR / AR hardware devices such as head-mounted displays and tracking devices.

[0075] 3. User motion tracking and updating: By tracking the movements of the user's head, hands or other body parts, the user's perspective and position in the virtual scene can be updated in real time. This can be achieved by using sensors and cameras built into VR / AR devices to ensure that the user's movements and perspective changes in the virtual environment are consistent with the movements in the real world.

[0076] 4. Interaction command processing: The VR / AR interaction module can recognize and process user interaction commands, which may include clicks, drags, gesture recognition, etc., to implement operations such as selection, movement, rotation, and scaling of objects in the virtual scene. In order to provide a smooth interactive experience, the module needs to efficiently process these commands and update the status of the virtual scene in a timely manner.

[0077] 5. Feedback and response: Based on the user's interactive operations, the VR / AR interaction module will provide corresponding feedback and response. For example, when the user selects and moves an object, the module will update the position of the object and display it in real time in the virtual scene. In addition, the module can also provide tactile feedback or sound feedback to enhance the user's interactive experience.

[0078] The VR / AR interaction module can provide users with an immersive interactive experience. Users can operate directly in the virtual scene, which is as intuitive and natural as in the real world. This interaction method not only improves users' perception and understanding of the project, but also helps the project management team to better plan and make decisions.

[0079] The user interface module includes menu, toolbar, property window and status bar components; the menu and toolbar provide various functional operation entrances of the digital sandbox system, including scene loading, viewing angle adjustment, object selection and property editing; the property window is used to display and edit the detailed property information of the currently selected object, including position, rotation angle, scaling and material mapping; the status bar is used to display system status information, including the current scene name, selected object information and operation prompts; receive user operation instructions, including click, drag and keyboard input, and update and feedback the operation results in real time on the interface according to specific instructions, so that the user can clearly understand the current system status and the properties of the selected object. The user interface module captures the user's operation instructions through the event monitoring mechanism. When the user performs an operation (such as clicking, dragging, etc.), the corresponding event will be triggered, and the event processing function inside the module will perform corresponding logical processing according to the type and parameters of the event.

[0080] Users can easily load different building scenes through the menu or toolbar of the user interface module. After loading, users can use the perspective adjustment tools in the toolbar, such as rotation, zooming, and panning, to observe the building model from different angles, so as to better understand the spatial layout and design details of the project. In the digital sandbox system, users may need to edit or view the properties of a specific building object. Through the user interface module, users can easily select objects in the scene. After selection, the property window will automatically display the detailed property information of the object, such as position, rotation angle, scaling, and material mapping. Users can edit directly in the property window and view the editing effect in real time. When performing various operations, the status bar of the user interface module will be updated in real time to display the current system status and the selected object information. For example, when the user selects an object and rotates it, the status bar will display prompts such as "the object has been rotated". The status bar will also display the system's operating status, such as memory usage, rendering frame rate, etc., to help users better understand the system performance.

[0081] The toolbar and menu of the user interface module provide a rich set of functional operation entrances. Users can quickly access common functions through the toolbar, such as saving scenes, undoing operations, redoing operations, etc. The menu provides a more detailed function classification, including scene management, object editing, view adjustment, etc., to meet the user's operation needs in different scenarios.

[0082] Embodiment 3:

[0083] The process parameter analysis module receives the construction progress and material consumption data provided by the data layer; pre-processes the received data, including data cleaning, format conversion and data standardization; uses statistical analysis methods to process the construction progress data, calculates the construction period, progress deviation and key path indicators of each construction stage; analyzes the material consumption data, calculates the actual material consumption, consumption rate and comparison with the budget; and outputs the analysis results in the form of a report. The process parameter analysis module first receives the construction progress and material consumption data from the data layer through a preset data interface. These data come from a variety of sensors, construction management systems or other data sources. After receiving the data, the module performs data pre-processing, including data cleaning to remove outliers and duplicate data, format conversion to ensure the consistency of data format, and data standardization for subsequent analysis. For the construction progress data, the process parameter analysis module uses statistical analysis methods for processing. First, according to the construction stage division, the actual construction period of each construction stage is calculated, and compared with the planned construction period to analyze the progress deviation. Secondly, the critical path method (CPM) is used to identify the critical path of the project and the possible risk points of construction period delay. Finally, a construction progress report is generated, which lists in detail the start time, end time, actual construction period, progress deviation and critical path of each stage.

[0084] For material consumption data, the process parameter analysis module first calculates the actual material consumption and compares it with the budget to analyze the overspending or savings. At the same time, based on the construction progress data, the material consumption rate is calculated to evaluate the efficiency of material use. Finally, a material consumption report is generated, detailing the actual consumption of each type of material, the consumption rate, and the comparison with the budget.

[0085] In the construction scenario, the machine learning module uses historical data to train the prediction model, and then predicts future construction progress and material requirements based on real-time data, thereby helping the project team optimize resource allocation and improve construction efficiency; through the analysis of the machine learning model, it can reduce waste and make the construction process more accurate and efficient. As the project progresses, the continuously optimized machine learning model will further improve the accuracy of the prediction, forming a virtuous feedback loop and bringing innovative changes to construction management.

[0086] The process parameter analysis module outputs the analysis results in the form of a report for reference by the project management team. The report can be provided in PDF, Excel or other common formats for easy viewing and sharing by team members. In addition, the module can also visualize the analysis results, such as drawing a Gantt chart of the construction progress, material consumption curve, etc., to help team members understand the analysis results more intuitively.

[0087] The collaboration and communication module builds a multi-party collaboration platform to support real-time online collaboration among project management team members. In order to ensure that all team members can obtain the latest project data, the collaboration and communication module implements real-time update and synchronization of project information. When a team member modifies or updates project information, these changes will be immediately synchronized to the platform for other team members to view. The module also provides version control for project data so that team members can track and compare different versions of project data.

[0088] The collaboration and communication module provides team members with a variety of communication tools to meet different communication needs. Specifically, it includes:

[0089] Text chat: Team members can communicate in real time and discuss project-related issues through the text chat function on the platform.

[0090] File Sharing: The module supports team members to upload and share project-related files, such as design drawings, construction plans, etc. Other team members can download or view these files online to better understand the project progress and details.

[0091] Online meeting: To meet the needs of more in-depth discussion and collaboration, the module also provides online meeting functions. Team members can communicate in real time through video conferencing to discuss and solve problems together.

[0092] The collaboration and communication module automatically records and stores the communication content and collaboration history of team members, including chat records, file sharing history, and online meeting recordings. Team members can view these records at any time to review and understand previous discussions and decision-making processes.

[0093] The decision support module receives reports from the analysis layer and obtains analysis reports on material consumption, including actual consumption, consumption rate and expected consumption trend of various materials; integrates construction progress information with material consumption to provide users with a comprehensive view of project progress; the module integrates the received construction progress information with material consumption, calculates deviations by comparing actual data and planned data of construction progress and material consumption, and analyzes possible causes;

[0094] Based on the integrated data, the decision support module generates a comprehensive view of the project progress. The view includes not only the overall situation of construction progress and material consumption, but also detailed data and analysis of each construction stage. Users can use this view to quickly understand the overall progress of the project and potential problems.

[0095] At the same time, users can intuitively understand the layout, construction progress and details of the construction site in a three-dimensional virtual environment through the VR / AR interactive module, assisting users in making decisions.

[0096] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0097] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A UE-based multi-party collaboration and intelligent decision support digital sandbox system, characterized by: Includes data layer, rendering layer, interaction layer, analysis layer, and collaboration and decision-making layer; The data layer is responsible for data integration, storage and management; the data layer includes a BIM data integration module and a data center module; the BIM data integration module is used to achieve docking with building information model data; the data center module is responsible for storing and managing the building structure data, material data and construction progress data required for the digital sandbox; The rendering layer uses the real-time rendering technology of Unreal Engine 5 to achieve building simulation and visualization effects. The rendering layer includes a real-time rendering module and a visual effect module. The real-time rendering module is responsible for real-time rendering based on the data provided by the data layer to generate realistic virtual scenes; the visual effects module is responsible for optimizing the rendering effect and providing fine adjustment of light, shadow, and material details; The interaction layer provides users with an immersive interactive experience through virtual reality and augmented reality technologies; the interaction layer includes a VR / AR interaction module and a user interface module; the VR / AR interaction module is responsible for realizing the interaction function between users and virtual scenes, and the interaction function includes scene roaming and object operation; The user interface module is used to provide an easy-to-use operating interface so that users can perform various operations and controls intuitively; The analysis layer is responsible for analyzing process parameters and providing support for project management and decision-making; the analysis layer includes a process parameter analysis module and a machine learning module; The process parameter analysis module is responsible for acquiring and analyzing the construction progress and material consumption parameters in real time and generating corresponding analysis reports; The machine learning module is responsible for predicting future construction progress and material requirements based on the analysis results of the process parameter analysis module; The collaboration and decision-making layer provides multi-party collaboration and decision-making support functions, and the collaboration and decision-making layer includes a collaboration and communication module and a decision support module; the collaboration and communication module is responsible for realizing real-time collaboration and information sharing functions among project teams, so that all parties can obtain the latest information at any time and communicate effectively; the decision support module provides users with decision support functions based on real-time data and analysis results.

2. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 1 is characterized by: The BIM data integration module is connected to the building information model data source through a preset data interface to achieve data docking; the BIM data integration module includes a format processing submodule and a data synchronization submodule; The format processing submodule is used to read and parse the format of BIM data, and convert the parsed data into a format recognizable by the digital sandbox system; The data synchronization submodule is used to receive and update the changes of the BIM data source in real time to keep the data in the digital sandbox system consistent with the BIM data source.

3. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 2 is characterized by: The real-time rendering module receives building structure data, material data and construction progress data provided by the data layer; uses the graphics rendering engine of Unreal Engine 5 to perform real-time rendering of the building model according to the received data; during the rendering process, a three-dimensional building scene image is generated in combination with visual information, and the visual information includes light and shadow, texture and material of the object.

4. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 3 is characterized by: The visual effects module receives the architectural scene image rendered by the real-time rendering module; post-processes the received architectural scene image, including light and shadow adjustment, color correction and material detail enhancement; the light and shadow adjustment optimizes the lighting effect of the scene by adjusting the light source parameters in the scene; the color correction makes the image more realistic and natural by adjusting the color balance, contrast and brightness of the image; the material detail enhancement finely adjusts the texture, reflection and refraction properties of the material.

5. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 4 is characterized by: During the rendering process of the real-time rendering module, the specific algorithm for calculating the illumination intensity by the illumination model is: I=I a K a +I d (K d ·(L·N))+I s ·(K s ·(R·V) n ) Among them, I is the final light intensity, I a is the ambient light intensity, K a The reflection coefficient of the object surface to the ambient light, I d is the direct light intensity, K d is the reflection coefficient of the object surface to direct light, L is the direction of the light source, N is the normal direction of the object surface, and I s is the specular reflection intensity of the light source, K s is the reflection coefficient of the object surface to the specular reflected light, R is the direction of the specular reflected light, V is the line of sight direction, and n is the sharpness index of the specular reflected light. These parameters are dynamically adjusted according to the light source and object material properties in the scene.

6. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 5, characterized in that: The VR / AR interaction module receives virtual scene data generated from the rendering layer; uses virtual reality and augmented reality technology to present the virtual scene data in front of the user to create an immersive three-dimensional environment; updates the user's perspective and position in the virtual scene in real time by tracking the user's head, hands or other body parts; and implements selection, movement, rotation and scaling operations on objects in the virtual scene according to the user's interactive instructions, including clicks, drags and gesture recognition; The user interface module includes menus, toolbars, property windows and status bar components; the menus and toolbars provide various functional operation entrances of the digital sandbox system, including scene loading, perspective adjustment, object selection and property editing; The property window is used to display and edit the detailed property information of the currently selected object, including position, rotation angle, scale and material map; the status bar is used to display system status information, including the current scene name, selected object information and operation prompts; it receives user operation instructions, including clicks, drags and keyboard input, and updates and feedbacks the operation results in real time on the interface according to specific instructions, so that the user can clearly understand the current system status and the properties of the selected object.

7. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 6, characterized in that: The process parameter analysis module receives the construction progress and material consumption data provided by the data layer; pre-processes the received data, including data cleaning, format conversion and data standardization; uses statistical analysis methods to process the construction progress data and calculate the construction period, progress deviation and key path indicators of each construction stage; analyzes the material consumption data and calculates the actual material consumption, consumption rate and comparison with the budget; and outputs the analysis results in the form of a report.

8. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 7, characterized in that: The collaboration and communication module builds a multi-party collaboration platform to support real-time online collaboration among project management team members, including: i) Real-time update and synchronization of project information to enable all team members to obtain the latest project data; ii) Providing communication tools such as text chat, file sharing and online conferencing; iii) Record and store the communication content and collaboration history of team members.

9. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 8, characterized in that: The decision support module receives reports from the analysis layer and obtains analysis reports on material consumption, including the actual consumption, consumption rate and expected consumption trend of various materials; integrates construction progress information with material consumption to provide users with a comprehensive project progress view; at the same time, users can intuitively understand the layout, construction progress and details of the construction site in a three-dimensional virtual environment through the VR / AR interaction module to assist users in making decisions.

Images