UE-based multi-party collaboration and intelligent decision support digital sand table system
By using a UX-based multi-party collaboration and intelligent decision support digital sand table system, the problems of insufficient data integration, visualization, and interactivity in traditional digital sand table systems are solved. It achieves high efficiency in data integration and realistic visualization effects, provides an immersive interactive experience and intelligent decision support, and improves the efficiency and quality of project management and decision-making.
Patent Information
- Application Number
- CN202410893827.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-04
- Publication Date
- 2025-12-16
- Estimated Expiration
- 2044-07-04
AI Technical Summary
Traditional digital sand table systems suffer from incompatible data formats and untimely updates during data integration, making it difficult to achieve highly realistic visualization effects. They also lack interactivity, intelligent decision support, and the ability to meet the complex needs of modern construction project management.
The system employs a UE-based multi-party collaboration and intelligent decision support digital sandbox system, comprising a data layer, rendering layer, interaction layer, analysis layer, and collaboration and decision layer. It achieves data integration through a BIM data integration module, utilizes Unreal Engine 5's real-time rendering technology to generate realistic virtual scenes, provides an immersive interactive experience, and supports project management and decision-making through the analysis and collaboration and decision layers.
It achieves high efficiency and accuracy in data integration, generates highly realistic visualizations, provides an immersive interactive experience, supports data analysis and decision support, and improves the efficiency and quality of project management and decision-making.
Smart Images

Figure CN119417373B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of information processing, in particular to a UE-based multi-party collaboration and intelligent decision support digital sand table system. BACKGROUND
[0002] With the rapid development of information technology and the continuous progress of the construction industry, in order to better plan, manage and make decisions on projects, digital sand table technology has emerged and gradually been widely used in the construction industry.
[0003] Traditional sand table models have been unable to meet the complex needs of modern construction project management. Specifically, existing digital sand table technology has the following shortcomings:
[0004] Data integration issues: Traditional digital sand table systems often have problems such as incompatible data formats and outdated updates when processing Building Information Modeling (BIM) data, which affects the consistency and accuracy of the data.
[0005] Limited visualization: Some existing digital sand table systems have difficulty achieving highly realistic rendering of building models, affecting users' intuitive perception of the project.
[0006] Insufficient interactivity: Traditional digital sand table systems usually only provide limited interactive functions, making it difficult for users to explore and understand the details of the project in depth.
[0007] Lack of intelligent decision support: Existing systems rarely provide data analysis and decision support functions, failing to meet the needs of project management teams in complex decision-making processes.
[0008] To solve the above problems, we propose a UE-based multi-party collaboration and intelligent decision support digital sand table system. SUMMARY
[0009] The purpose of the present application is to provide a UE-based multi-party collaboration and intelligent decision support digital sand table system to solve the problems raised in the background.
[0010] To achieve the above purpose, the present application provides the following technical solution: a UE-based multi-party collaboration and intelligent decision support digital sand table system, including a data layer, a rendering layer, an interaction layer, an analysis layer and a collaboration and decision layer;
[0011] The data layer is responsible for the integration, storage and management of data; the data layer includes a BIM data integration module and a data center module; the BIM data integration module is used to interface with building information model data; the data center module is responsible for storing and managing building structure data, material data and construction progress data required by the digital sand table;
[0012] The rendering layer utilizes the real-time rendering technology of Unreal Engine 5 to realize building simulation and visualization effects, and includes a real-time rendering module and a visual effect module; the real-time rendering module is responsible for real-time rendering according to the data provided by the data layer to generate realistic virtual scenes; the visual effect module is responsible for optimizing the rendering effect and providing fine adjustment of light and shadow, material details.
[0013] The interaction layer provides an immersive interactive experience for users through virtual reality and augmented reality technology; the interaction layer includes a VR / AR interaction module and a user interface module; the VR / AR interaction module is responsible for implementing user interaction with the virtual scene, and the interaction function includes scene roaming and object operation; the user interface module is used to provide an easy-to-use operation interface to enable users to intuitively perform various operations and controls.
[0014] The analysis layer is responsible for analyzing process parameters to provide support for project management and decision-making; the analysis layer includes a process parameter analysis module and a machine learning module; the process parameter analysis module is responsible for real-time acquisition and analysis of construction progress and material consumption parameters to generate corresponding analysis reports; the machine learning module is responsible for predicting future construction progress and material requirements based on the analysis results of the process parameter analysis module.
[0015] The collaboration and decision-making layer provides multi-party collaboration and decision-making support functions; the collaboration and decision-making layer includes a collaboration and communication module and a decision support module; the collaboration and communication module is responsible for implementing real-time collaboration and information sharing functions between project teams, enabling all parties to obtain the latest information and communicate effectively at any time; the decision support module provides decision support functions for users based on real-time data and analysis results.
[0016] Preferably, the BIM data integration module connects with the building information model data source through a pre-set data interface to realize data docking; the BIM data integration module includes a format processing submodule and a data synchronization submodule; the format processing submodule is used to read and parse the format of BIM data and convert the parsed data into a format recognizable by the digital sand table system; the data synchronization submodule is used to receive and update changes in the BIM data source in real time to ensure that the data in the digital sand table system is consistent with the BIM data source.
[0017] Preferably, the real-time rendering module receives building structure data, material data, and construction progress data provided by the data layer; utilizes the graphics rendering engine of Unreal Engine 5 to perform real-time rendering of the building model according to the received data; during the rendering process, a three-dimensional building scene image is generated in combination with visual information, including the light and shadow, texture, and material of objects.
[0018] Preferably, the visual effect module receives the building scene image rendered by the real-time rendering module; post-processes the received building scene image, including light and shadow adjustment, color correction and material detail enhancement; the light and shadow adjustment optimizes the lighting effect of the scene by adjusting the light source parameters in the scene; the color correction makes the image more realistic and natural by adjusting the color balance, contrast and brightness of the image; the material detail enhancement finely adjusts the texture, reflection and refraction properties of the material.
[0019] Preferably, in the rendering process, the specific algorithm for calculating the light intensity by the light model of the real-time rendering module is:
[0020] I = I a K a + I d (K d ·(L·N) + I s ·(K s ·(R·V) n )
[0021] Wherein, I is the final light intensity, I a is the ambient light intensity, K a is the reflection coefficient of the object surface to the ambient light, I d is the direct light intensity, K d is the reflection coefficient of the object surface to the direct light, L is the light source direction, N is the object surface normal direction, I s is the mirror reflection light intensity of the light source, K s is the reflection coefficient of the object surface to the mirror reflection light, R is the mirror reflection light direction, V is the line of sight direction, and n is the sharpness index of the mirror reflection light. These parameters are dynamically adjusted according to the light source and object material properties in the scene.
[0022] Preferably, the VR / AR interaction module receives virtual scene data generated from the rendering layer; uses virtual reality and augmented reality technology to present the virtual scene data in front of the user, creating an immersive three-dimensional environment; by tracking the user's head, hand or other body movements, real-time updates the user's perspective and position in the virtual scene; according to the user's interactive instructions, including clicking, dragging and gesture recognition, realizes the selection, movement, rotation and scaling operations of the objects in the virtual scene.
[0023] The user interface module includes menu, toolbar, property window and status bar components; through the menu and toolbar, the user can access the functions of the digital sand table system, including scene loading, view adjustment, object selection and property editing; the property window is used to display and edit the detailed property information of the currently selected object, including position, rotation angle, zoom ratio and material map; the status bar is used to display system status information, including the current scene name, selected object information and operation prompts; the user's operation instructions, including clicking, dragging and keyboard input, are received, and according to the specific instructions, the operation results are updated and fed back in real time on the interface, so that the user can clearly understand the current state of the system and the properties of the selected object.
[0024] Preferably, the process parameter analysis module receives construction progress and material consumption data provided by the data layer; pre-processes the received data, including data cleaning, format conversion and data standardization; uses statistical analysis methods to process the construction progress data, calculates the duration, progress deviation and critical path indicators of each construction stage; analyzes the material consumption data, calculates the actual consumption of materials, consumption rate and comparison with the budget; and outputs the analysis results in the form of a report.
[0025] Preferably, the collaboration and communication module builds a multi-party collaboration platform to support real-time online collaboration of project management team members, specifically including:
[0026] i) Real-time update and synchronization of project information to enable all team members to obtain the latest project data;
[0027] ii) Provide communication tools such as text chat, file sharing and online meetings;
[0028] iii) Record and store the communication content and collaboration history of team members.
[0029] Preferably, the decision support module receives reports from the analysis layer, obtains analysis reports of material consumption, including the actual consumption of various materials, consumption rate and predicted consumption trend; integrates construction progress information and material consumption to provide a comprehensive project progress view for the user; at the same time, the user can intuitively understand the layout, construction progress and details of the construction site in the three-dimensional virtual environment through the VR / AR interaction module, assisting the user in making decisions.
[0030] Compared with the prior art, the beneficial effects of the present application are:
[0031] 1. High efficiency and accuracy of data integration: Through the BIM data integration module, the system realizes seamless connection with building information model data, effectively solving the problems of data format incompatibility and update timeliness in traditional digital sand table systems, not only improving the efficiency of data integration, but also ensuring the consistency and accuracy of data, providing a solid data foundation for subsequent project planning, management and decision-making.
[0032] 2. Realistic visual effects: Using the real-time rendering technology of Unreal Engine 5, the system can generate highly realistic virtual scenes, and the realistic visual effects greatly enhance users' intuitive perception of the project, enabling project managers and decision-makers to more accurately grasp the overall situation and details of the project, thereby improving the quality and efficiency of decision-making.
[0033] 3. Immersive interactive experience: Through virtual reality and augmented reality technology, the system provides users with an immersive interactive experience, allowing users to directly operate in the virtual scene, just like in the real world, intuitive and natural. This interactive method not only improves users' perception and understanding of the project, but also helps the project management team better plan and make decisions.
[0034] 4. Data analysis and decision support: The analysis layer of the system can obtain and analyze key parameters such as construction progress and material consumption in real time, generating corresponding analysis reports. These reports provide strong data support for the project management team, helping them make more intelligent choices in complex decision-making processes. BRIEF DESCRIPTION OF DRAWINGS
[0035] Fig. 1 is a whole structure diagram of the present application;
[0036] Fig. 2 is a submodule structure diagram of the BIM data integration module;
[0037] Fig. 3 is a functional structure diagram of the interaction layer. DETAILED DESCRIPTION
[0038] The technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.
[0039] Please refer to Figs. 1-3The application provides a technical solution: a multi-party cooperation and intelligent decision support digital sand table system based on UE, which includes a data layer, a rendering layer, an interaction layer, an analysis layer, and a cooperation and decision layer.
[0040] The data layer is the foundation of the system and is mainly responsible for data integration, storage, and management. The data layer includes a BIM data integration module and a data center module.
[0041] BIM data integration module: This module can realize seamless connection with building information model (BIM) data. Through standardized data interfaces, the BIM data integration module can read and analyze data exported by various BIM software, ensuring data accuracy and consistency.
[0042] Data center module: This module is responsible for storing and managing building structure data, material data, and construction progress data required by the digital sand table. Through efficient data storage and retrieval mechanisms, the data center module can quickly respond to data requests from upper-layer applications.
[0043] The rendering layer uses Unreal Engine 5 real-time rendering technology to achieve realistic building simulation and visualization effects; the rendering layer includes a real-time rendering module and a visual effects module.
[0044] Real-time rendering module: Based on the data provided by the data layer, this module can generate realistic virtual building scenes in real time; through efficient rendering algorithms and optimization techniques, it ensures smooth visual experience and high-quality image output.
[0045] Visual effects module: This module is responsible for optimizing rendering effects and providing fine adjustments of details such as light, shadow, and material; by adjusting lighting conditions, material properties, and environmental parameters, the visual effects module can further enhance the realism and immersion of rendering.
[0046] The interaction layer provides an immersive interactive experience for users through virtual reality (VR) and augmented reality (AR) technologies; the interaction layer includes a VR / AR interaction module and a user interface module.
[0047] VR / AR interaction module: This module enables user interaction with virtual scenes, including scene roaming, object manipulation, etc.; users can explore building scenes and perform operations such as moving, rotating, and scaling objects through VR devices.
[0048] User interface module: Provides an intuitive and easy-to-use operation interface, allowing users to easily perform various operations and controls; the user interface is simple and clear, adhering to human-computer interaction design principles and reducing user learning costs.
[0049] The analysis layer is responsible for analyzing process parameters to provide support for project management and decision-making. The analysis layer includes a process parameter analysis module and a machine learning module.
[0050] Process parameter analysis module: This module can acquire and analyze parameters such as construction progress and material consumption in real time, generating corresponding analysis reports. Through data mining and statistical analysis techniques, it helps the project management team to timely discover problems, optimize processes, and improve efficiency.
[0051] Machine learning module: responsible for predicting future construction progress and material requirements based on the analysis results of the process parameter analysis module, to optimize resource allocation and improve construction efficiency.
[0052] The collaboration and decision-making layer provides multi-party collaboration and decision-making support functions, including a collaboration and communication module and a decision support module.
[0053] Collaboration and communication module: Real-time collaboration and information sharing between project teams; through instant messaging, file sharing, and task management tools, ensure that all parties can access the latest information and communicate effectively at any time.
[0054] Decision support module: provides decision support functions based on real-time data and analysis results; through data visualization, trend prediction, and risk assessment techniques, helps the project management team make wise decisions and reduce potential risks.
[0055] The following further illustrates the present application in conjunction with Examples 1 to 3:
[0056] Example 1:
[0057] The BIM data integration module connects with the building information model data source through a pre-set data interface to realize data docking; the module includes a format processing submodule and a data synchronization submodule; the format processing submodule is used to read and analyze the format of BIM data, and convert the parsed data into a format recognizable by the digital sand table system; the data synchronization submodule is used to receive and update changes in the BIM data source in real time, so that the data in the digital sand table system is consistent with the BIM data source.
[0058] During system development, according to the type and format of the BIM data source, the corresponding data interface is pre-set, the interface can support mainstream BIM data formats such as IFC, Revit RVT, through API call or data exchange protocol, to establish a stable connection with the BIM data source.
[0059] The format processing submodule is implemented as follows: a. Data reading and parsing: using specialized libraries or APIs, the format processing submodule reads raw data from the BIM data source. For different BIM data formats, corresponding parsing logic needs to be written to correctly extract the geometric information and attribute data of the building model. b. Data format conversion: after parsing, the data is converted into the standard format used by the digital sand table system. This usually involves mapping elements in the BIM data to the data structure of the digital sand table system, ensuring the integrity and accuracy of the information. c. Error handling and logging: during data reading, parsing and conversion, strict error handling mechanisms are implemented. In the event of any exceptions or errors, the format processing submodule should be able to record detailed error logs to facilitate subsequent problem troubleshooting and repair.
[0060] The data synchronization submodule is implemented as follows: a. Establish a listening mechanism: the data synchronization submodule detects changes in the BIM data source in real time by implementing a listening mechanism. This can be achieved through API integration with BIM software or using file system monitoring functions. b. Incremental update: when the BIM data source changes, the data synchronization submodule can identify the specific changes and only synchronize these changes to the digital sand table system, rather than reloading the entire model, which helps improve data synchronization efficiency and response speed. c. Data consistency check: after data synchronization is complete, a data consistency check is performed to ensure that the data in the digital sand table system matches the BIM data source completely. If any inconsistencies are found, a warning or error handling process should be triggered.
[0061] The BIM data integration module can efficiently interface with various BIM data sources, enabling accurate data reading, format conversion and real-time synchronization, providing a reliable data foundation for the digital sand table system.
[0062] The real-time rendering module receives building structure data, material data and construction progress data provided by the data layer; uses the graphics rendering engine of Unreal Engine 5 to perform real-time rendering of the building model based on the received data; during the rendering process, a three-dimensional building scene image is generated in combination with visual information, including object light and shadow, texture and material. The specific implementation is as follows:
[0063] The real-time rendering module first receives building structure data, material data and construction progress data from the data layer through a pre-set interface. These data have been processed by the BIM data integration module before transmission, ensuring the consistency and accuracy of the data format. The received data will be pre-processed as necessary, such as data cleaning and format conversion, to adapt to the needs of the UE5 rendering engine. Using the scene editor of UE5, a virtual building scene is constructed based on the received building structure data, including creating building models, terrain, vegetation and other environmental elements. At the same time, the materials and textures of the objects in the scene are configured according to the material data. The parameters for real-time rendering are set in UE5, including lighting models, shadow calculation, reflection and refraction, etc. These settings will ensure that the rendered images have realistic lighting effects and material performance. In addition, camera parameters need to be configured to simulate different viewing angles and scene depths. To improve rendering efficiency and image quality, the rendering process needs to be optimized. This includes using LOD (Level of Detail) technology to adjust the level of detail of models according to distance, and using UE5's GPU particle system to optimize the rendering performance of large-scale scenes. As the construction progress data updates, the real-time rendering module needs to dynamically adjust the state of the building models in the scene to reflect the latest construction progress. At the same time, to support user interaction, the module also needs to handle input signals from the interaction layer, such as user's view transformation, object selection and other operations, and update the rendering results in real time to respond to these interactions.
[0064] In the rendering process of the real-time rendering module, the specific algorithm for calculating the lighting intensity of the lighting model is:
[0065] I = I a K a + I d (K d · (L · N)) + I s · (K s · (R · V) n )
[0066] Where I is the final lighting intensity, I a is the ambient light intensity, K a is the reflection coefficient of the object surface to the ambient light, I d is the direct light intensity, K d is the reflection coefficient of the object surface to the direct light, L is the light source direction, N is the object surface normal direction, I s is the specular reflection light intensity of the light source, K s is the reflection coefficient of the object surface to the specular reflection light, R is the specular reflection light direction, V is the viewing direction, and n is the sharpness index of the specular reflection light. The final lighting intensity is equal to the sum of the contributions of ambient light, direct light and specular reflection light, that is, I = I 环境光 + I直射光 +I 镜面反射光 .
[0067] The contribution of ambient light to the object surface is calculated as the product of ambient light intensity and the reflection coefficient of the object surface to ambient light: I 环境光 = I a K a .
[0068] The contribution of direct light to the object surface is first determined by calculating the dot product of the light source direction and the normal direction of the object surface to determine the illumination angle, and then multiplied by the direct light intensity and the reflection coefficient of the object surface to direct light: I 直射光 = I d (K d ·(L·N)).
[0069] The contribution of specular reflection light is determined by calculating the dot product of the specular reflection light direction and the line of sight direction to determine the angle of the specular reflection light seen by the observer, and then multiplied by the specular reflection light intensity of the light source and the reflection coefficient of the object surface to the specular reflection light: I 镜面反射光 = I s ·(K s ·(R·V) n ).
[0070] This algorithm can simulate more realistic and delicate lighting effects by considering the contributions of multiple light sources, enhancing the visual realism and immersion of the digital sand table system. At the same time, since the parameters involved in the algorithm can be dynamically adjusted according to the scene and object material, it has high flexibility and adaptability. For example, in a construction site scene, various objects are given realistic material properties such as concrete, metal, glass, etc., and according to the actual situation of the construction site, environmental light, direct light and possible specular reflection light sources such as sunlight and surrounding reflective surfaces are set. The lighting model algorithm described above is applied to dynamically calculate the lighting intensity of each object in the scene, including the overall illumination of the object by ambient light, the shadow and highlight changes caused by direct light (such as sunlight), and the highlight effects brought by specular reflection light.
[0071] Example 2:
[0072] The VR / AR interaction module receives virtual scene data generated from the rendering layer; using virtual reality and augmented reality technology, it presents virtual scene data to the user, creating an immersive three-dimensional environment; by tracking the user's head, hand or other body movements, it updates the user's perspective and position in the virtual scene in real time; according to the user's interaction instructions, including clicking, dragging and gesture recognition, it realizes the selection, movement, rotation and scaling operations of objects in the virtual scene; the specific implementation includes the following five steps:
[0073] 1. Virtual scene data reception: The VR / AR interaction module first receives virtual scene data generated from the rendering layer, including three-dimensional models, textures, lighting information, etc., to construct an immersive virtual environment.
[0074] 2. Virtual environment creation: Using VR / AR technology, the received virtual scene data is presented to the user, creating a realistic three-dimensional environment, involving the use of specialized VR / AR hardware devices such as head-mounted displays and tracking devices.
[0075] 3. User action tracking and updating: By tracking the user's head, hand, or other body part movements, the user's perspective and position in the virtual scene are updated in real time. This can be achieved by using sensors and cameras built into VR / AR devices, ensuring that the user's movements and perspective changes in the virtual environment are consistent with real-world actions.
[0076] 4. Interaction instruction processing: The VR / AR interaction module can recognize and process user interaction instructions, which may include clicking, dragging, gesture recognition, etc., to implement object selection, movement, rotation, and scaling operations in the virtual scene. To provide a smooth interaction experience, the module needs to efficiently process these instructions and update the virtual scene state in a timely manner.
[0077] 5. Feedback and response: Based on user interaction operations, the VR / AR interaction module provides corresponding feedback and response, such as updating the position of an object and displaying it in real time in the virtual scene when the user selects and moves it. In addition, the module can also provide tactile feedback or sound feedback to enhance the user's interaction experience.
[0078] The VR / AR interaction module can provide users with an immersive interaction experience, allowing them to directly manipulate objects in the virtual scene as if they were in the real world, making the interaction intuitive and natural. This interaction method not only improves users' perception and understanding of the project, but also helps the project management team better plan and make decisions.
[0079] The user interface module includes menu, toolbar, property window and status bar components; through the menu and toolbar, the user can access the various functions of the digital sand table system, including scene loading, view adjustment, object selection and property editing; the property window is used to display and edit the detailed property information of the currently selected object, including position, rotation angle, scaling ratio and material map; the status bar is used to display system status information, including the current scene name, selected object information and operation prompts; it receives user operation instructions, including clicking, dragging and keyboard input, and according to the specific instructions, it updates and feeds back the operation results in real time on the interface, so that the user can clearly understand the current system state and the properties of the selected object. The user interface module captures user operation instructions through an event listening mechanism. When the user performs an operation (such as clicking, dragging, etc.), the corresponding event will be triggered, and the event handling function inside the module will execute the corresponding logic processing according to the type and parameters of the event.
[0080] Through the menu or toolbar of the user interface module, the user can easily load different building scenes. After loading is completed, the user can use the view adjustment tools in the toolbar, such as rotation, scaling and translation, to observe the building model from different angles, so as to better understand the spatial layout and design details of the project. In the digital sand table system, the user may need to edit or view the properties of a specific building object. Through the user interface module, the user can conveniently select the object in the scene. After selection, the property window will automatically display the detailed property information of the object, such as position, rotation angle, scaling ratio and material map, etc. The user can directly edit in the property window and view the editing effect in real time. When performing various operations, the status bar of the user interface module will update in real time to display the current system state and selected object information. For example, when the user selects an object and performs a rotation operation, the status bar will display “object has been rotated” and other prompt information. The status bar also displays the running status of the system, such as memory usage, rendering frame rate, etc., to help the user better understand the system performance.
[0081] The toolbar and menu of the user interface module provide rich function operation entrances. The user can quickly access common functions such as saving the scene, undoing the operation, redoing the operation, etc. through the toolbar. The menu provides more detailed function classification, including scene management, object editing, view adjustment, etc., to meet the user's operation needs in different scenarios.
[0082] Example 3:
[0083] The process parameter analysis module receives construction progress and material consumption data from the data layer; pre-processes the received data, including data cleaning, format conversion and data standardization; uses statistical analysis methods to process the construction progress data, calculates the duration, progress deviation and critical path indicators of each construction stage; analyzes the material consumption data, calculates the actual consumption of materials, consumption rate and comparison with the budget; the analysis results are output in the form of reports. The process parameter analysis module first receives construction progress and material consumption data from the data layer through a pre-set data interface. These data come from various sensors, construction management systems or other data sources. After receiving the data, the module performs data preprocessing, including data cleaning to remove outliers and duplicate data, format conversion to ensure data format consistency, and data standardization to facilitate subsequent analysis. For construction progress data, the process parameter analysis module uses statistical analysis methods for processing. First, according to the construction stage division, the actual duration of each construction stage is calculated, and compared with the planned duration to analyze the progress deviation. Second, using the critical path method (CPM), the critical path of the project and the possible risk points of the duration delay are identified. Finally, a construction progress report is generated, detailing the start time, end time, actual duration, progress deviation and critical path of each stage.
[0084] For material consumption data, the process parameter analysis module first calculates the actual consumption of materials and compares it with the budget to analyze the overbudget or savings. At the same time, according to the construction progress data, the consumption rate of materials is calculated to evaluate the efficiency of material use. Finally, a material consumption report is generated, detailing the actual consumption of each type of material, consumption rate and comparison with the budget.
[0085] In the context of building construction, the machine learning module uses historical data to train prediction models, and then predicts future construction progress and material demand based on real-time data, helping the project team optimize resource allocation and improve construction efficiency. Through the analysis of machine learning models, waste can be reduced, and the construction process can be more precise and efficient. As the project progresses, the continuously optimized machine learning model will further improve the prediction accuracy, forming a virtuous feedback loop and bringing innovative changes to building construction management.
[0086] The process parameter analysis module outputs the analysis results in the form of reports for the project management team to reference. Reports can be provided in PDF, Excel or other common formats for team members to view and share. In addition, the module can also visualize the analysis results, such as drawing construction progress Gantt charts and material consumption curves, to help team members better understand the analysis results.
[0087] The collaboration and communication module builds a multi-party collaboration platform, supporting real-time online collaboration of project management team members. In order to ensure that all team members can obtain the latest project data, the collaboration and communication module realizes the functions of real-time updating and synchronization of project information. When a team member modifies or updates the project information, these changes will be immediately synchronized to the platform for other team members to view. The module also provides version control of project data, so that team members can track and compare different versions of project data.
[0088] The collaboration and communication module provides team members with a variety of communication tools to meet different communication needs. Specifically, it includes:
[0089] Text chat: Team members can communicate in real time through the text chat function on the platform to discuss project-related issues.
[0090] File sharing: The module supports team members to upload and share project-related files such as design drawings, construction plans, etc. Other team members can download or view these files online to better understand the project progress and details.
[0091] Online meetings: To meet the needs of more in-depth discussion and collaboration, the module also provides online meeting functions. Team members can communicate in real time through video conferencing to discuss and solve problems together.
[0092] The collaboration and communication module automatically records and stores the communication content and collaboration history of team members, including chat records, file sharing history, and online meeting videos, etc. Team members can view these records at any time to review and understand the previous discussion and decision-making process.
[0093] The decision support module receives reports from the analysis layer, obtains analysis reports on material consumption, including actual consumption of various materials, consumption rate, and predicted consumption trend; integrates construction progress information and material consumption to provide users with a comprehensive view of project progress; the module integrates the received construction progress information and material consumption, compares the actual data and planned data of construction progress and material consumption, calculates the deviation, and analyzes the possible reasons;
[0094] Based on the integrated data, the decision support module generates a comprehensive view of project progress, which not only includes the overall situation of construction progress and material consumption, but also includes detailed data and analysis of each construction stage, so that users can quickly understand the overall progress and potential problems of the project through this view.
[0095] At the same time, users can intuitively understand the layout, construction progress and detail situation of the construction site in the three-dimensional virtual environment through the VR / AR interaction module, which helps users make decisions.
[0096] It has to be noted that, in the present document, the terms "first", "second", etc. merely serve to identify a subject or action, without necessarily requiring or implying any such actual relationship or order between such subjects or actions. Moreover, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus.
[0097] While embodiments of the present application have been shown and described, it is to be understood that various modifications, substitutions, combinations, and variations of the embodiments can be undertaken without departing from the spirit and scope of the present application, which is defined by the appended claims and their equivalents.
Claims
1. A UE-based multi-party collaboration and intelligent decision support digital sandbox system, characterized by: It includes a data layer, a rendering layer, an interaction layer, an analysis layer, and a collaboration and decision-making layer; The data layer is responsible for the integration, storage, and management of data; the data layer includes a BIM data integration module and a data center module; the BIM data integration module connects to the building information model data source through a preset data interface to achieve data docking; the BIM data integration module includes a format processing submodule and a data synchronization submodule. The format processing submodule is used to read and parse the format of BIM data, and convert the parsed data into a format that the digital sand table system can recognize; The data synchronization submodule is used to receive and update changes in the BIM data source in real time to ensure that the data in the digital sand table system is consistent with the BIM data source. The data center module is responsible for storing and managing the building structure data, material data, and construction progress data required for the digital sand table; The rendering layer utilizes Unreal Engine 5's real-time rendering technology to achieve architectural simulation and visualization effects. The rendering layer includes a real-time rendering module and a visual effects module. The real-time rendering module receives architectural structure data, material data, and construction progress data provided by the data layer. Using Unreal Engine 5's graphics rendering engine, it performs real-time rendering of the architectural model based on the received data. During the rendering process, it combines visual information to generate a three-dimensional architectural scene image, including the object's lighting, texture, and material. The visual effects module receives the architectural scene image rendered by the real-time rendering module; it performs post-processing on the received architectural scene image, including lighting and shadow adjustment, color correction, and material detail enhancement; the lighting and shadow adjustment optimizes the lighting effect of the scene by adjusting the light source parameters in the scene; the color correction makes the image more realistic and natural by adjusting the color balance, contrast, and brightness of the image; the material detail enhancement finely adjusts the texture, reflection, and refraction properties of the material. The interaction layer provides users with an immersive interactive experience through virtual reality and augmented reality technologies. The interaction layer includes a VR or AR interaction module and a user interface module. The VR or AR interaction module receives virtual scene data generated from the rendering layer; it presents the virtual scene data to the user using virtual reality and augmented reality technologies, creating an immersive three-dimensional environment; it updates the user's perspective and position in the virtual scene in real time by tracking the user's head, hands, or other body parts; and it enables the selection, movement, rotation, and scaling of objects in the virtual scene based on user interaction commands, including clicks, drags, and gesture recognition. The user interface module includes menus, toolbars, attribute windows, and a status bar component; it provides entry points for various functions of the digital sandbox system through the menus and toolbars, including scene loading, perspective adjustment, object selection, and attribute editing. The properties window is used to display and edit detailed property information of the currently selected object, including position, rotation angle, scaling ratio and material map; the status bar is used to display system status information, including the current scene name, information of the selected object and operation prompts; it receives user operation commands, including click, drag and keyboard input, and updates and provides feedback on the operation results on the interface in real time according to the specific command, so that the user can clearly understand the current system status and the properties of the selected object; The analysis layer is responsible for analyzing process parameters to provide support for project management and decision-making; the analysis layer includes a process parameter analysis module and a machine learning module. The process parameter analysis module receives construction progress and material consumption data from the data layer; it preprocesses the received data, including data cleaning, format conversion, and data standardization; it uses statistical analysis methods to process the construction progress data, calculates the construction period, schedule deviation, and critical path indicators for each construction stage; it analyzes the material consumption data, calculates the actual material consumption, consumption rate, and comparison with the budget; and it outputs the analysis results in the form of a report. The machine learning module is responsible for predicting future construction progress and material requirements based on the analysis results of the process parameter analysis module. The collaboration and decision-making layer provides multi-party collaboration and decision support functions. The collaboration and decision-making layer includes a collaboration and communication module and a decision support module. The collaboration and communication module is responsible for enabling real-time collaboration and information sharing among project teams, so that all parties can obtain the latest information and communicate effectively at any time. The decision support module provides decision support functions to users based on real-time data and analysis results.
2. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 1, characterized in that, The collaboration and communication module constructs a multi-party collaboration platform that supports real-time online collaboration among project management team members, specifically including: Real-time updates and synchronization of project information ensure that all team members have access to the latest project data. Provides communication tools for text chat, file sharing, and online meetings; Record and store team members' communication content and collaboration history.
3. The UE-based multi-party collaboration and intelligent decision support digital sandbox system according to claim 2, characterized in that: The decision support module receives reports from the analysis layer and obtains an analysis report on material consumption, including the actual consumption, consumption rate, and expected consumption trend of various materials. It integrates construction progress information with material consumption to provide users with a comprehensive view of project progress. At the same time, users can intuitively understand the layout, construction progress, and details of the construction site in a three-dimensional virtual environment through VR or AR interactive modules, assisting users in making decisions.
Citation Information
Patent Citations
Shield tunnel construction display system and method integrating real-time tunneling data
CN110634176A
BIM model-based electronic sand table collaboration platform implementation system, method and device
CN115759806A