Dynamic monitoring generation system assisted by three-dimensional scene based on digital twinning technology

Abstract

The invention belongs to the technical field of nuclear power, and particularly relates to a three-dimensional scene assisted dynamic monitoring generation system based on a digital twinning technology. According to the invention, a set of auxiliary dynamic monitoring system which is developed based on Unity3D and Web technologies and can support rapid formation of a three-dimensional scene is constructed, private deployment is supported, the security of data is ensured, large-scale model rendering, model importing and loading and rapid data point binding under an industrial scene are solved at the same time, and the method is suitable for large-scale model rendering, model importing and loading and rapid data point binding. The problem that a virtual model and a physical model are lack of linkage in the prior art is solved, alarm rule setting is supported, the alarm rule is automatically matched according to real-time data, alarm information is generated, alarm data are displayed at a three-dimensional end, and meanwhile alarm point positions are marked in a three-dimensional model.

Description

Technical Field

[0001] The present invention belongs to the field of nuclear power technology, and specifically relates to a three-dimensional scene-assisted dynamic monitoring generation system based on digital twin technology. Background Art

[0002] In the field of nuclear industry, real-time monitoring and management of equipment is particularly important. Nuclear industry equipment usually has a complex structure, involving multiple subsystems and components, and requires comprehensive monitoring and management. Since the operation of nuclear industry equipment is directly related to production safety, its operating status requires real-time monitoring. Any delay may affect production efficiency and safety, and any failure may lead to serious consequences. Therefore, it must be equipped with a highly reliable monitoring system. In addition, the amount of data generated by nuclear industry equipment is huge, requiring efficient processing and storage capabilities to ensure the real-time and accuracy of the data. However, traditional monitoring systems usually rely on two-dimensional planes and simple data display, which has many limitations. First, the information display is single. The traditional monitoring system can only display limited equipment operating parameters and cannot fully and intuitively reflect the operating status and fault conditions of the equipment. Secondly, the data processing capability is weak. When dealing with high concurrency and large data volumes, traditional systems are prone to performance bottlenecks, affecting the monitoring effect. In addition, the operation is complicated. The operation interface of traditional systems is usually complex and requires special training to be proficient in use, which increases the difficulty of operation and training costs. Finally, the system maintenance is difficult. Due to the old system architecture, maintenance and upgrades are difficult, and various failures are prone to occur, affecting the stability and reliability of the system.

[0003] With the rapid development of information technology, digital twin technology has gradually become an important means to improve equipment management efficiency. By creating digital models of physical equipment in a virtual environment, digital twin technology can comprehensively and intuitively display the operating status and fault conditions of the equipment, and improve the transparency and accuracy of information. At the same time, digital twin technology has strong data processing capabilities, can process large amounts of real-time data and support high concurrent access, ensuring the real-time and accuracy of data. In addition, digital twin systems usually have a user-friendly operating interface and support multiple interaction methods, reducing the difficulty of operation and training costs. Its modern architecture also makes maintenance and upgrades easier, further improving the stability and reliability of the system. Although digital twin technology has broad application prospects in the nuclear industry, the existing digital twin systems still have some shortcomings:

[0004] 1) Insufficient model management capabilities: The existing system has problems with low efficiency and poor compatibility in model import, processing and management, and cannot meet the needs of high-precision and high-efficiency model management.

[0005] 2) The data binding process is cumbersome: The data and model binding process is usually cumbersome and requires manual configuration, making it difficult to achieve fast and accurate data association.

[0006] 3) Poor real-time display effect: The existing system has poor real-time display effect and cannot intuitively display the operating status and fault conditions of the equipment, affecting the monitoring effect.

[0007] 4) Insufficient system stability: The existing system is prone to performance bottlenecks when processing high concurrency and large amounts of data, affecting the stability and reliability of the system.

[0008] Therefore, how to optimize the three-dimensional rendering effect to enhance the real-time monitoring performance of the dynamic monitoring model system based on digital twin technology has become an urgent problem to be solved. Summary of the invention

[0009] In order to overcome the problems existing in related technologies, a three-dimensional scene-assisted dynamic monitoring generation system based on digital twin technology is provided.

[0010] According to one aspect of an embodiment of the present disclosure, a three-dimensional scene-assisted dynamic monitoring generation system based on digital twin technology is provided, the system comprising a physical layer, a background service layer, a background setting layer, and a front-end presentation and application layer;

[0011] The physical layer includes multiple physical hardware devices, each of which is connected to the system, providing the system with the ability to access real-time data of the hardware and reversely control the hardware;

[0012] The backend service layer includes the IoT data collection platform, data management unit, application service unit, and model management unit;

[0013] The IoT data collection platform is used to uniformly access devices and messages from different manufacturers and different types, and realize centralized management of devices and data collection aggregation;

[0014] The application service unit includes the basic backend service module, video control platform, data-driven module and model management module; the basic backend service module provides interface access for the web and Unity3D terminals; the video control platform is used to support the video computing requirements of the front end, and provide cloud computing support for 3D video computing, real-time monitoring and real-time animation calculation; the data-driven module is used to set data rules, data-driven rules, and display animation settings. Through the rule engine mechanism, the data rules in the system are configured and managed, and the correct binding and calculation of data and models, animations and linkage logic are realized;

[0015] The model management module is used for 3D scene management, model format conversion, model reading and model storage, realizing the unified management and scheduling of 3D scenes, while providing lightweight and encapsulated processing of models;

[0016] The background setting layer integrates a number of key configuration capabilities in addition to 3D functions, including user management, authority allocation, message processing, rule setting, alarm monitoring, model import, video configuration, drawing file management and POI point setting;

[0017] The application layer is used to read the background management configuration and draw three-dimensional and two-dimensional models and scenes through the Unity3D engine to complete the model display and interaction functions within the system.

[0018] In one possible implementation, the application layer integrates POI interaction, video playback, virtual tours, data playback, device interaction, alarm management, data-driven presentation, graphic interaction, and two- and three-dimensional linkage;

[0019] The application layer can respond to click events of POI points and conduct user interaction according to the background configuration; read and display video streams in real time; conduct virtual tours along preset routes; reproduce equipment actions in historical data; interact with equipment in a three-dimensional interface and implement reverse control; display alarm information according to alarm rules and real-time data; perform logical judgments based on background configuration and real-time data to drive the state transfer and animation playback of three-dimensional models; add graphic and text interactive content in equipment interaction events; and perform point jumps and associated operations in the three-dimensional interface through a flat map.

[0020] In one possible implementation, the system uses motion visualization technology to use special effects to display the operating data and status of ventilation and cooling water system auxiliary systems, and displays the dynamic trend of data through the platform navigation chart function.

[0021] In a possible implementation, the system realizes real-time interaction between the user and the virtual environment by accessing sensor devices;

[0022] The point entry technology allows users to upload and edit equipment drawing files, enter points and operation and maintenance records, and develop equipment simulation operation and parts disassembly and assembly functions to achieve real-time display of key equipment operation parameters and interlocking display of video monitoring signals;

[0023] The system builds equipment topology through data collection and modeling, generates equipment interconnection diagrams, helps operation and maintenance personnel observe the pipeline flow direction and interconnection relationship between equipment at multiple levels and in all directions, and realizes the classified upload, query and viewing of drawings, documents and technical materials;

[0024] The interconnection diagram is associated with the model and alarm system to realize the electronic display and mutual call of drawings, flow charts and models;

[0025] The system's roaming inspection technology supports users to set or edit roaming routes, browse equipment layout and operation status along the routes, and provide navigation mini-maps and real-time monitoring video screen switching functions.

[0026] In one possible implementation, the system also has an operation training module for engineering personnel training and operation simulation, covering training at the plant, system and equipment levels, including training and assessment of functional data, parameter configuration, and equipment operation.

[0027] In one possible implementation, in the data management unit, the user can set the association between the model, equipment and points. The equipment will capture and provide monitoring data in real time. The system extracts key information from the data captured by the equipment and uses digital twin technology for simulation analysis at the back end. The simulated data is pushed to the corresponding terminal device for display.

[0028] In a possible implementation, the system data in the data management unit is divided into document data, model data, and IoT data, and is managed through the Web end, Unity editor, and the Web end interface respectively. The Unity editing component supports hierarchical data source filtering to achieve the following functions:

[0029] Model management: involves uploading, storing, format conversion and standardized management of model files;

[0030] File management: mainly classifies and manages drawings and manual documents uploaded by users, and provides file management system functions; it is also used for reference management of UI resource names and stores UI content in file form;

[0031] Project configuration data management: structured storage of project configuration information in key-value pairs or XML format, and support for reading and modifying operations;

[0032] IoT data interface: responsible for connecting with the IoT platform, realizing persistent storage of data, and extracting required data from the IoT time series database;

[0033] System data is divided into document data, model data and IoT data. Document data is managed on the Web, model data is managed in Unity, and IoT data interfaces are managed on the Web. The Unity editing component can filter and select data sources in a hierarchical manner.

[0034] Users can add display tags to the scene, and the system will automatically extract and convert relevant data and display it intuitively in the tags.

[0035] In one possible implementation, the system has a data filtering function and supports rule setting for model point data. After customizing the response rules of the device, when new data flows in, the system intelligently filters according to the preset rule set, matches and retains key data, and realizes real-time data storage. In addition, users can also view alarm information in real time on the 3D model to ensure the first-time response to abnormal situations.

[0036] In one possible implementation, the system uses an Excel table containing point association relationships for import. When the system loads the GIS map on the 3D side, it queries the specific point information based on the current layer information, calls the Unity3D API through the BI system, maps the point information according to the preset rules, and automatically points in the 3D scene to mark the location of each point. When the user clicks on a point, a window with related information pops up for the point, displaying detailed data related to the point.

[0037] In a possible implementation, the data management unit includes a metadata management module, a data rights management module, a master data management module, a reference data management module, a data collection log module, and a data storage module;

[0038] The metadata management module is used to edit and manage the original data collected by the Internet of Things, providing clear meaning and processing basis for subsequent system operations; the data permission management module is used to configure access rights to data within the system, protect data security, and prevent unauthorized access; the master data management module is used to store and configure core data in the business system, providing direct and fundamental support for model mapping and alarm functions; the reference data management module is used to save data configured for master data analysis to ensure that the system can correctly parse and analyze master data; the data collection log module is used to record data collection behavior within the system, providing a basis for system auditing and stability improvement; the data storage module is used to store graphics, files, users, permissions and other types of data within the management system to ensure comprehensive and effective data management.

[0039] The beneficial effects of the present disclosure are as follows: the present disclosure constructs a set of auxiliary dynamic monitoring systems based on Unity3D and Web technology, which can support the rapid formation of auxiliary dynamic monitoring systems based on three-dimensional scenes, support private deployment, ensure data security, and solve large-scale model rendering, model import and loading, and rapid data point binding suitable for industrial scenarios. It solves the problem of lack of linkage between virtual models and physical models in the prior art, supports setting alarm rules, automatically matches alarm rules according to real-time data, thereby generating alarm information, and displays alarm data on the three-dimensional end, while marking alarm points in the three-dimensional model. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 It is a schematic diagram of a three-dimensional scene-assisted dynamic monitoring generation system based on digital twin technology shown in an embodiment of the present disclosure.

[0041] Figure 2 It is a flowchart of the interactive configuration of the application layer shown in an embodiment of the present disclosure.

[0042] Figure 3 FIG. 4 is a flowchart of three-dimensional rendering according to an embodiment of the present disclosure.

[0043] Figure 4 It is a functional schematic diagram of three-dimensional modeling shown in an embodiment of the present disclosure.

[0044] Figure 5 It is a flowchart of a user performing model building shown in an embodiment of the present disclosure.

[0045] Figure 6 It is a schematic diagram of data categories of a data management unit shown in an embodiment of the present disclosure.

[0046] Figure 7 The figure is a flow chart of data filtering shown in an embodiment of the present disclosure.

[0047] Figure 8 It is a flow chart of automatic dotting in a three-dimensional loading process shown in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0048] The present disclosure is further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0049] Unless otherwise defined, the technical and scientific terms used in the present disclosure have the same meanings as those generally understood by those skilled in the art to which the present disclosure belongs; the terms used in the present disclosure are only for the purpose of describing specific embodiments and are not intended to limit the present disclosure; the term "including" and any variations thereof in the present disclosure are intended to cover non-exclusive inclusions. Obviously, the embodiments described in the present disclosure are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without making creative efforts are within the scope of protection of the present disclosure.

[0050] Reference to "embodiments" in this disclosure means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the disclosure. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0051] Figure 1 is a schematic diagram of a dynamic monitoring generation system assisted by a three-dimensional scene based on digital twin technology shown in an embodiment of the present disclosure, such as Figure 1 As shown, the system includes a physical layer, a background service layer, a background setting layer (Web) and a front-end display and application layer (3D rendering). The specific implementation methods of each layer are described in detail below. Figure 1 shown.

[0052] The physical layer includes multiple physical hardware devices, each of which is connected to the system through direct device connection, PLC, DCS, SCADA or other forms, providing the system with the ability to access real-time data of hardware and reversely control hardware. The IoT platform included in the system undertakes functions such as data access, protocol management, and message delivery. The animation and model engines provide computing power and are the physical basis for all the capabilities of the system.

[0053] The backend service layer includes the IoT data collection platform, data management unit, application service unit and model management unit.

[0054] The IoT data collection platform is used to uniformly access different types of devices and their messages from different manufacturers to achieve centralized management of devices and data collection aggregation. For example, the IoT data collection platform supports receiving and saving device data through multiple protocols such as OPC, HTTP, TCP, etc. These data will then be passed to other functional units of the system for further management, aggregation and processing, including data analysis, judgment and other processing processes.

[0055] Ultimately, these processed data will provide solid and reliable underlying support for real-time monitoring of the entire system, ensuring that the system can reflect the operating status and data changes of IoT devices in real time and accurately.

[0056] The data management unit includes metadata management module, data rights management module, master data management module, reference data management module, data collection log module and data storage module. The metadata management module is used to edit and manage the original data collected by the Internet of Things data, providing clear meaning and processing basis for subsequent system operations. The data rights management module is used to configure the access rights of data in the system, protect data security and prevent unauthorized access. The master data management module is used to store and configure the core data in the business system, providing direct and fundamental support for functions such as model mapping and alarm. The reference data management module is used to save the data configured for master data parsing to ensure that the system can correctly parse and analyze the master data. The data collection log module is used to record the data collection behavior in the system, providing a basis for system auditing and stability improvement. The data storage module is used to store and manage other types of data such as graphics, files, users, permissions, etc. in the management system to ensure comprehensive and effective management of data.

[0057] The application service unit includes the basic backend service module, video control platform, data drive module and model management module. The basic backend service module provides efficient and complete interface access for the web and Unity3D terminals; the video control platform is used to support the video computing requirements of the front end, and provide cloud computing support for 3D video computing, real-time monitoring and real-time animation calculation. The data drive module is used to set data rules, data drive rules, and display animation settings. Through the rule engine mechanism, the data rules in the system are configured and managed to ensure the correct binding and calculation of data and models, animations and linkage logic.

[0058] The model management module is used for 3D scene management, model format conversion, model reading and model storage, realizing unified management and scheduling of 3D scenes. It supports model format conversion to ensure the compatibility and efficient use of models in different links, and provides model lightweighting, encapsulation and other processing to meet the calling requirements of other modules.

[0059] The background setting layer is the core platform for the interaction between the system and the user configuration. It integrates a number of key configuration capabilities in addition to the three-dimensional function, including user management, authority allocation, message processing, rule setting, alarm monitoring, model import, video configuration, drawing file management and POI point setting. The background setting layer supports custom configuration and real-time judgment of alarms, flexible management of video sources, and also provides intuitive data configuration and secondary processing functions. At the same time, the background setting layer can realize the association management between device models and IoT data, support the association between real-time data display and model response in Debug mode, as well as the upload, download and device binding of graphic materials. In addition, the background setting layer also has functions such as data-driven device model actions and animation triggers, automatic generation of floor plans, model full life cycle management, and detailed management of user information and permissions. Through POI and map settings, users can also easily configure scene key points and path information, laying the foundation for subsequent functions such as virtual patrols and roaming inspections. The background setting layer constitutes a flexible and powerful background management system tool that can fully meet the in-depth configuration and management needs of administrators or technicians for the system, ensuring the stable operation and efficient application of the system.

[0060] The application layer is a functional interface developed through Unity3D, which is the window for the system to interact with the user. The interactive configuration process of the application layer is as follows: Figure 2 As shown in the figure, BI display and interaction as well as 3D scene control are realized through WEB-side interaction; 3D scene display is realized through 3D-side interaction, and 3D scene synchronizes BI display and interaction as well as 3D scene control data through WEB backend service to realize Unity 3D control. The WEB-side control of 3D-side interaction is loaded by WEB browser.

[0061] Among them, the application layer reads the background management configuration, and draws three-dimensional and two-dimensional models and scenes through the Unity3D engine to complete the model display, interaction and other functions within the system. The specific functions of the application layer integrate POI interaction, video playback, virtual patrol, data playback, equipment interaction, alarm management, data-driven display, graphic interaction, and two- and three-dimensional linkage. The application layer can respond to click events of POI points and interact with users according to the background configuration; read and display video streams in real time; conduct virtual patrols according to preset routes; reproduce equipment actions in historical data; interact with equipment in the three-dimensional interface and realize reverse control; display alarm information according to alarm rules and real-time data; perform logical judgment based on background configuration and real-time data to drive the state transfer and animation playback of three-dimensional models; add graphic interaction content in equipment interaction events; and quickly jump to points and perform related operations in the three-dimensional interface through flat maps, providing users with rich and intuitive interactive experience and display effects. The three-dimensional rendering process is as follows: Figure 3As shown in the figure, first, you need to configure the model's material and state transition rules, which lay the foundation for the subsequent rendering process. Then, during the model rendering phase, the system will load the previously configured materials and state transition rules. According to the materials and state transition rules, accurate 3D end rendering is performed to ensure that the rendered model is both accurate and efficient, and meets the expected visual effects.

[0062] like Figure 4 As shown, first of all, 3D modeling technology uses computer graphics technology to generate realistic 3D space, integrates the digital information of the real environment into the virtual environment, and is used to build a virtual environment to improve the operational skills and awareness of engineers.

[0063] The system uses motion visualization technology to display the operating data and status of auxiliary systems such as ventilation and cooling water systems with special effects, and displays dynamic data trends through the platform navigation map function, enhancing the intuitiveness and real-time nature of data display. At the same time, it combines computer vision technology to further enhance the sense of reality in the virtual environment. Graphics processor technology uses the computing power of GPU to accelerate the rendering and calculation of the virtual environment, significantly improve the visual effects of virtual reality, and provide users with a more realistic virtual experience.

[0064] like Figure 5 As shown in the figure, in terms of real-time interaction, the system can achieve real-time interaction between users and the virtual environment by connecting to sensor devices, enhancing the user's immersion and interactive experience, and making the operation more intuitive and timely. The point entry technology allows users to upload and edit equipment drawing files, enter points and run maintenance records, and develop equipment simulation operation and parts disassembly and assembly functions to achieve real-time display of key equipment operating parameters and interlocking display of video monitoring signals, and to show in real time the impact of parts disassembly and assembly activities on key equipment operating parameters.

[0065] The system builds a device topology diagram through data collection and modeling, generates a clear device interconnection diagram, and helps operation and maintenance personnel observe the pipeline flow direction and interconnection relationship between devices at multiple levels and in all directions. The system realizes the classified upload, query and viewing of drawings, documents and technical data, realizes the electronic display and mutual call of drawings, documents, flow charts and models, and improves the convenience of data management. The device interconnection diagram is associated with the alarm system. For each alarm information, the drawings and technical data of the equipment associated with the alarm information are displayed, which helps inspection personnel to obtain technical information to solve the alarm fault in time, and effectively improves the maintenance efficiency and quality of the alarm fault. The system's roaming inspection technology supports users to set or edit roaming routes, browse the equipment layout and operation status along the route, and provide navigation mini-maps and real-time monitoring video screen switching functions, providing a basis for macro command and dispatch in all scenarios, and providing all-weather safety inspection solutions for key areas.

[0066] The system also has an operation training module for engineering personnel training and operation simulation, covering training at the plant, system and equipment levels, including training and assessment on functional data, parameter configuration, equipment operation, etc., to help users master theoretical knowledge and effectively reduce training costs and time.

[0067] In one possible implementation, in the data management unit, the user can flexibly set the association between the model, equipment and points to form a customized association model, and perform operations in this customized association model. The solution allows the deployment of a variety of monitoring equipment according to the needs of the actual application scenario, and the monitoring equipment associated with the customized association model will capture and provide monitoring data in real time. Subsequently, the system extracts key information from these monitoring data according to the preset fields of the association model, and uses digital twin technology in the back end for high-precision simulation analysis. The data after simulation processing is pushed to the corresponding terminal device for display. Therefore, the present invention relies on the organic integration of automatic collection of equipment status and digital twin simulation technology to present a more realistic and intuitive scene status view to the staff, thereby significantly improving the efficiency and effectiveness of construction monitoring.

[0068] like Figure 6 As shown, in a possible implementation, the system data in the data management unit is divided into document data, model data and IoT data, and managed through the Web end, Unity editor and the Web end interface respectively. The Unity editing component supports hierarchical data source filtering. Implement the following functions

[0069] Model management: involves uploading, storing, format conversion and standardized management of file names (including length and suffix control) of model files.

[0070] File management: mainly classifies and manages drawings, manuals and other documents uploaded by users, and provides file management system functions. At the same time, it is also responsible for the reference management of UI resource names and stores UI content in the form of files.

[0071] Project configuration data management: The project configuration information is stored in a structured manner using key-value pairs or XML format, and supports read and modify operations.

[0072] IoT data interface: responsible for connecting with the IoT platform, realizing persistent storage of data, and extracting required data from the IoT time series database.

[0073] System data is divided into document data, model data and IoT data. Document data is managed on the Web, model data is managed in Unity, and IoT data interfaces are managed on the Web. The Unity editing component can filter and select data sources in a hierarchical manner.

[0074] The disclosed system is equipped with a data binding tool that can quickly achieve seamless binding between the acquired data and the corresponding 3D model. This mechanism not only ensures the instant synchronization of data, but also drives the 3D model to perform smooth movement, rotation and linkage reactions. In addition, users can easily add display tags to the scene, and the system will automatically extract and convert the relevant data and display it intuitively in the tag.

[0075] like Figure 7 As shown, the disclosed system has a data filtering function. It supports flexible rule setting for model point data, and users can customize the response rules of the device according to the actual data of the device. When new data flows in, the system will perform intelligent filtering based on the preset rule set, accurately match and retain key data, and realize instant data storage. In addition, users can also view alarm information in real time on the 3D model to ensure the first response to abnormal situations. For details about alarm configuration and data processing flow, please see Figure 7 shown.

[0076] In a possible implementation, the present disclosure can automatically generate dynamic operation rules through Excel. There are many points in the industrial scene. The points are managed in the three-dimensional scene and associated with the relevant data panel. The system uses Excel tables for import, which better supports the import and processing of tens of thousands of points in the industrial scene. Figure 8 As shown in the figure, when the GIS map is loaded on the 3D end, the system queries the specific point information based on the current layer information. The BI system calls the Unity 3D API to map these point information according to the preset rules. After that, points are automatically marked in the 3D scene to mark the location of each point. Finally, when the user clicks on these points, a window with related information will pop up to display detailed data related to the point.

[0077] In the system disclosed in the present invention, a rule engine is introduced to perform rule judgment, and a relatively simple IF-ELSE combination is used for logic practice, which reduces the configuration cost of user logic. At the same time, a mature rule engine is also cited to improve the efficiency and stability of logic judgment.

[0078] Compared with other systems, the system design of the present invention uses a similar BS architecture, which makes the system fully split and compresses the development content in Unity. Considering that the main users are state-owned enterprises, it provides the possibility of lower cost for subsequent domestic independent and controllable improvements.

[0079] The system design separates the coupling between data and 3D rendering, and places the data-driven logic on the backend rather than the 3D frontend. Among them, the control of the soft interface and WebSocket are relatively advanced methods. Decoupling improves the scalability of the system while ensuring that the data delay does not exceed an acceptable level. At the same time, the WebSocket transmission method can be seamlessly used in docking with Web-side 3D rendering, providing a basis for subsequent updates.

[0080] The system uses BI panel (Web panel) for embedding and data display. This method provides a quick way to build a data panel. At the same time, since the Web interface development is more mature and effective than that in 3D software such as Unity, it can accelerate system construction in subsequent system use.

[0081] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A three-dimensional scene-assisted dynamic monitoring generation system based on digital twin technology, characterized in that: The system includes a physical layer, a background service layer, a background setting layer and a front-end presentation and application layer; The physical layer includes multiple physical hardware devices, each of which is connected to the system, providing the system with the ability to access real-time data of the hardware and reversely control the hardware; The backend service layer includes the IoT data collection platform, data management unit, application service unit, and model management unit; The IoT data collection platform is used to uniformly access devices and messages from different manufacturers and different types, and realize centralized management of devices and data collection aggregation; The application service unit includes the basic backend service module, video control platform, data-driven module and model management module; the basic backend service module provides interface access for the web and Unity3D terminals; the video control platform is used to support the video computing requirements of the front end, and provide cloud computing support for 3D video computing, real-time monitoring and real-time animation calculation; the data-driven module is used to set data rules, data-driven rules, and display animation settings. Through the rule engine mechanism, the data rules in the system are configured and managed, and the correct binding and calculation of data and models, animations and linkage logic are realized; The model management module is used for 3D scene management, model format conversion, model reading and model storage, realizing the unified management and scheduling of 3D scenes, while providing lightweight and encapsulated processing of models; The background setting layer integrates multiple configuration capabilities in addition to 3D functions, including user management, authority allocation, message processing, rule setting, alarm monitoring, model import, video configuration, drawing file management and POI point setting; The application layer is used to read the background management configuration and draw three-dimensional and two-dimensional models and scenes through the Unity3D engine to complete the model display and interaction functions within the system.

2. The system according to claim 1, characterized in that The application layer integrates POI interaction, video playback, virtual tours, data playback, equipment interaction, alarm management, data-driven presentation, graphic interaction, and 2D and 3D linkage; The application layer can respond to click events of POI points and conduct user interaction according to the background configuration; read and display video streams in real time; conduct virtual tours along preset routes; reproduce equipment actions in historical data; interact with equipment in a three-dimensional interface and achieve reverse control; display alarm information according to alarm rules and real-time data; perform logical judgment based on background configuration and real-time data to drive the state transfer and animation playback of three-dimensional models; and add graphic and text interaction content in equipment interaction events; And perform point jump and association operations in the three-dimensional interface through a flat map.

3. The system according to claim 1, characterized in that The system uses motion visualization technology to utilize special effects to display the operating data and status of ventilation and cooling water system auxiliary systems, and displays the dynamic trend of data through the platform navigation chart function.

4. The system according to claim 1, characterized in that In terms of real-time interaction, the system realizes real-time interaction between users and virtual environments by accessing sensor devices; The point entry technology allows users to upload and edit equipment drawing files, enter points and operation and maintenance records, and develop equipment simulation operation and parts disassembly and assembly functions to achieve real-time display of key equipment operation parameters and interlocking display of video monitoring signals; The system builds equipment topology through data collection and modeling, generates equipment interconnection diagrams, helps operation and maintenance personnel observe the pipeline flow direction and interconnection relationship between equipment at multiple levels and in all directions, and realizes the classified upload, query and viewing of drawings, documents and technical materials; The interconnection diagram is associated with the model and alarm system to realize the electronic display and mutual call of drawings, flow charts and models; The system's roaming inspection technology supports users to set or edit roaming routes, browse equipment layout and operation status along the routes, and provide navigation mini-maps and real-time monitoring video screen switching functions.

5. The system according to claim 1, characterized in that The system also has an operation training module for engineering personnel training and operation simulation, covering training at the plant, system and equipment levels, including training and assessment of functional data, parameter configuration, and equipment operation.

6. The system according to claim 1, characterized in that In the data management unit, users can set the association between models, equipment and points. The equipment will capture and provide monitoring data in real time. The system extracts key information from the data captured by the equipment and uses digital twin technology for simulation analysis at the back end. The simulated data is pushed to the corresponding terminal device for display.

7. The system according to claim 1, characterized in that The system data in the data management unit is divided into document data, model data and IoT data, and is managed through the Web end, Unity editor and the Web end interface respectively. The Unity editing component supports hierarchical data source filtering to achieve the following functions: Model management: involves uploading, storing, format conversion and standardized management of model files; File management: mainly classifies and manages drawings and manual documents uploaded by users, and provides file management system functions; it is also used for reference management of UI resource names and stores UI content in file form; Project configuration data management: structured storage of project configuration information in key-value pairs or XML format, and support for reading and modifying operations; IoT data interface: responsible for connecting with the IoT platform, realizing persistent storage of data, and extracting required data from the IoT time series database; System data is divided into document data, model data and IoT data. Document data is managed on the Web, model data is managed in Unity, and IoT data interfaces are managed on the Web. The Unity editing component can filter and select data sources in a hierarchical manner. Users can add display tags to the scene, and the system will automatically extract and convert relevant data and display it intuitively in the tags.

8. The system according to claim 1, characterized in that The system has a data filtering function and supports rule setting for model point data. After customizing the response rules of the device, when new data flows in, the system intelligently filters according to the preset rule set, matches and retains key data, and realizes real-time data storage. In addition, users can also view alarm information in real time on the 3D model to ensure the first-time response to abnormal situations.

9. The system according to claim 1, characterized in that The system uses an Excel table containing point association relationships for import. When the system loads the GIS map on the 3D side, it queries the specific point information based on the current layer information, calls the Unity 3D API through the BI system, maps the point information according to the preset rules, and automatically points in the 3D scene to mark the location of each point. When the user clicks on a point, a window with related information pops up for the point, displaying detailed data related to the point.

10. The system according to claim 1, characterized in that The data management unit includes a metadata management module, a data authority management module, a master data management module, a reference data management module, a data collection log module, and a data storage module; The metadata management module is used to edit and manage the raw data collected by the IoT, providing clear meaning and processing basis for subsequent system operations; The data rights management module is used to configure the access rights of data in the system, protect data security, and prevent unauthorized access; the master data management module is used to store and configure the core data in the business system, providing direct and fundamental support for model mapping and alarm functions; the reference data management module is used to save the data configured for master data parsing to ensure that the system can correctly parse and analyze the master data; The data collection log module is used to record data collection behaviors within the system, providing a basis for system auditing and stability improvement; the data storage module is used to store graphics, text, files, users, permissions and other types of data within the management system to ensure comprehensive and effective data management.

Images