Platform management system, terminal and model rendering server
By building a WebGL lightweight display model database and factory planning SaaS system, the factory digital twin platform has solved the problems of large data analysis load, lack of original design data and slow model loading speed, and efficient construction planning and design and automatic output of production bill of materials.
Patent Information
- Application Number
- CN202411470264.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-25
- Publication Date
- 2025-03-14
AI Technical Summary
During the construction and display process of existing factory digital twin platforms, there are problems such as large data analysis load, lack of original design data of model equipment, and slow model loading speed, especially in the application of multiple three-dimensional file compatibility and production links.
By building a WebGL lightweight display model database, the construction of factory planning SaaS system is realized, including the lightweight and WebGL processing of three-dimensional models, integrating business data, providing drag-and-drop planning tools and production list export functions, realizing two- and three-dimensional linkage and automatic output of production bill of materials.
It significantly reduces the data calculation processing volume, improves the efficiency of construction planning and design, realizes the definition of the relationship between factory model and equipment attributes, automatically outputs the production bill of materials, and supports manufacturing applications in the production process.
Smart Images

Figure CN119625159A_ABST
Abstract
Description
[0001] The original basis of this divisional application is the patent application with application number (202311392938.8), application date 2023.10.25, and invention name “A method for building a factory planning SaaS system based on lightweight model”. Technical Field
[0002] The present invention relates to the technical field of lightweight three-dimensional model data and cloud data management, and in particular to a platform management system, a terminal and a model rendering server. Background Art
[0003] At present, in the process of building a digital twin platform for factories (such as power plants), most of the three-dimensional modeling based on the factory is drawn by engineers familiar with professional CAD software. This requires users to be familiar with the factory's business processes, process specifications, and the structure and attribute characteristics of each equipment; it also requires users to master proficient CAD drawing skills and specifications, which increases the difficulty of building a factory digital twin system. Most factory model building is based on the initial design institute planning drawings to draw three-dimensional models. The current mainstream method is based on two-dimensional drawings, including references such as building master plans, equipment layout drawings, and process flow charts. The local software of three-dimensional models such as factory buildings, floors, equipment, and pipelines is gradually built through planning or BIM CAD engine software; then the model is output to the cloud through lightweight means, and displayed on the browser in the form of WebGL for easy access by different cloud accounts. The 3D model built on the local CAD software needs to be output and checked one by one through the software's built-in bill of materials output function. For example, architectural drawings need to output the building BOM table through Revit, equipment needs to output the mechanical and electronic BOM table through Inventor, and pipeline components need to output the pipe BOM table through PDMS. Finally, the BOM tables are sent one by one to the corresponding manufacturers for component processing, construction consumables preparation and other production links.
[0004] At present, most of the three-dimensional model construction of factories is carried out through the forward modeling process through CAD tool software. The factory building model is modeled by BIM according to the two-dimensional master plan and elevation drawing during the architectural planning, including the definition of elements with different family attributes such as building elevation, civil walls, doors, windows, structural beams, columns, steel structures, MEP and terrain floor, so as to realize the construction of the building. The large equipment and pipelines of the factory are modeled by three-dimensional CAD according to the equipment installation diagram and factory process flow diagram during the design planning, including the construction of equipment and pipelines in the steam engine room area and boiler area, such as the high and low pressure condensers, various water pumps, steam pumps, oil pumps, vacuum pumps, heaters, deaerators, closed water tanks, bypass oil stations, generator sealing oil stations, generator sets, steam turbines, various instruments and pipeline libraries, and the classification and construction of coal mills, coal feeders, blowers, induced draft fans, circulating pumps, etc. in the boiler area and various instruments and pipeline libraries. The construction of this type of factory needs to be implemented through a variety of modeling software, and the SaaS deployment is realized through the WebGL conversion of the model to achieve the digital twin display of the factory browser.
[0005] On the one hand, since factory construction involves different fields, including construction, mechanical equipment, and pipeline instrumentation, the CAD geometry engines used are also different. Even if the model data has been lightweight to reduce the space occupied by the 3D model on the server, the review stage after the factory is built requires compatibility with multiple different types of 3D files on the same platform, which will bring a large data analysis load to the browser side; on the other hand, since most factory digital twin platforms are displayed and applied to users in the form of SaaS, most of them are concentrated on the browser side (B / S architecture side) for unified display and operation and maintenance, and most of the models are loaded in the browser's graphics card in WebGL format for online display, but lack the original design data of the model equipment (model, specifications, etc.), and cannot be directly converted into a production bill of materials, and lack the application of digital twin factories in production manufacturing.
[0006] In addition, on the one hand, there are differences in understanding among those skilled in the art; on the other hand, the applicant studied a large number of documents and patents when making the present invention, but due to space limitations, not all details and contents are listed in detail. However, this does not mean that the present invention does not have the characteristics of these prior arts. On the contrary, the present invention already has all the characteristics of the prior art, and the applicant reserves the right to add relevant prior art to the background technology. Summary of the invention
[0007] In view of the deficiencies in the prior art, the present invention provides a SaaS system based on lightweight construction of factory models, which realizes the definition of attribute relationships of lightweight associated equipment of factory models, and at the same time provides a model construction page of the SaaS architecture and automatically outputs the production material list to connect subsequent production and manufacturing links.
[0008] To achieve the above objectives, the present invention provides a method for building a factory planning SaaS system based on lightweight model, which may include:
[0009] Build a WebGL lightweight display model database:
[0010] Build the 3D model required for factory planning,
[0011] Lightweight and WebGL-based 3D model data.
[0012] Integrate the WebGL-processed 3D model with business data to form a model database for users to plan factory construction;
[0013] Building a factory planning SaaS system based on the WebGL lightweight display model database:
[0014] Based on the WebGL lightweight display model database, various standard databases for users to plan and build factories are classified.
[0015] Build a factory planning tool that allows users to build factory models at the model output end,
[0016] Build a display platform and production list export tool suitable for the factory model built by users.
[0017] On the construction planning function page, the present invention can realize the associated jump on the factory's two-dimensional master plan, equipment layout diagram and three-dimensional model diagram, and can collaborate on the annotation, modification and review of three-dimensional models or two-dimensional engineering views through the tool module in the system page, thereby avoiding problems such as design rework and construction period delays caused by design defects before construction.
[0018] On the collaborative design function page, the SaaS architecture platform provided by the present invention can enable designers and design studios in different regions to log in to the platform, conduct collaborative design modifications on the same factory model, and control different design versions of the same model; factory planning technicians who have no experience in using design software can also use a fool-proof drag-and-drop method to visually drag and build from the model library list, and associated device nodes and pipeline nodes can be automatically connected to quickly realize the rapid construction and web (browser) display of new factories and modified areas.
[0019] After planning the corresponding factory model, users can use the production list export tool to automatically export the BOM production list of all factory equipment, pipelines and instruments in one click; or users can click to select the BOM list of equipment, pipelines and instruments that need to be exported on the Web (browser) side, and send it to the connected production MES system or third-party ERP system to complete the workshop production or third-party outsourcing production process.
[0020] The main idea of the prior art for lightweighting three-dimensional models is to adjust the size and data structure of the model to improve the loading and display speed of the model. For example, CN106909640A discloses a lightweight display technology for three-dimensional models based on webgl, in which the geometry and material of the model are first obtained, and a scene tree is generated according to the model tree. If there is an animation, an animation tree is generated; secondly, the discrete triangles and line segments of the geometry are obtained, and the triangle index is reduced to improve the compression rate of the compression algorithm; then the triangle normal data and the index of the reduced line segment are compressed, and the geometric objects are divided into blocks, and the geometric blocks are compressed with lzma to generate several bin files; the attributes of the geometry and material, the scene tree and the animation tree data are jsonized to generate a js file; finally, the file is read and decompressed, and the triangles and line segments are restored, and the scene and animation are established and rendered. This technical solution can convert three-dimensional models of various formats into a smaller intermediate file, so that it can be quickly loaded in the web platform, thereby directly displaying it in the browser based on webgl. In other words, the technical solution performs unified preprocessing on 3D models of different formats to parse and convert them into the smallest possible intermediate format files, so that the 3D models can be loaded quickly and the space occupied by the 3D models on the server can be reduced. That is, the technical solution uses the intermediate format files as conversion carriers to achieve conversion between different 3D models. The technical solution mainly involves parsing and conversion between different 3D models, and their corresponding geometric objects can be processed in blocks through the same preprocessing method.
[0021] However, the technical solution does not involve the technical problem of how to realize the conversion between two-dimensional view and three-dimensional view. Accordingly, compared with the above-mentioned prior art, the present application can realize the association jump on the two-dimensional general plan, equipment layout diagram and three-dimensional model diagram of the factory by matching association during the construction planning process, so as to improve the efficiency of construction planning and design, without the need to perform corresponding model analysis and conversion again, and significantly reduce the amount of data calculation and processing. Specifically, the present application can perform lightweight processing on two-dimensional engineering drawings (PDF, DXF or SVG) to obtain the unique identification code of the object in the relevant layer, and write the unique identification code into the xml file to match the unique identification code (or bit number) in all scene node models. The unique identification code serves as a switching bridge between models of different dimensions to realize the selection of equipment in the three-dimensional model list and 3D screen and jump to the corresponding equipment display of the two-dimensional engineering drawing, which can realize the management of two-dimensional and three-dimensional linkage effects. This method does not require additional settings such as the intermediate format file in the above-mentioned prior art, thereby further reducing the complexity of model processing and improving the processing efficiency of construction planning and design.
[0022] After completing the lightweight processing of the model, it is necessary to modularize and softwareize the digital management process after modeling. The existing technology already has technical solutions that allow users to use cloud-based applications through Internet connections. For example, CN113448693A discloses a digital factory SAAS cloud platform, in which the microservice components selected by users from the microservice component pool are received through a unified authentication portal, and the microservice components selected by users are registered through a service registration center to generate one or more service instances. When a re-registration instruction is received, the microservice component corresponding to the service instance in the re-registration instruction is registered; if the status of the monitoring service instance is abnormal, a re-registration instruction containing the service instance is generated and sent to the service registration center; finally, the service instance is packaged and published through the container service. The platform mainly provides a unified digital thread base, so that each industrial microservice and industrial SaaS business function component can be used separately, so that they can be combined with each other like building blocks to build more complex and comprehensive industry digital solutions, such as C2M factory digitalization, remote equipment maintenance and patrol inspection, etc., so that it has maximum flexibility and scalability, thereby realizing the modularization and softwareization of the model algorithm.
[0023] However, modular component retrieval requires a large amount of data processing space and computing occupancy, especially when there are multiple microservice components in the above-mentioned prior art. Due to the different display resolutions of different user terminals, modular component retrieval will increase the data processing pressure of low-resolution user terminals, thereby causing jamming in the planning and design process. Therefore, the technical solution does not involve the technical problem of how to speed up the loading speed of three-dimensional model objects in the user-side interface. Accordingly, compared with the above-mentioned prior art, the model rendering server of the present application can determine the minimum size of the components to be rendered based on the minimum naked eye resolution size determined by the resolution of the user terminal that makes the viewing request, thereby being able to execute specific rendering requirements based on different user terminals, thereby improving the processing efficiency of construction planning and design. Specifically, in view of the different data processing performances of different user terminals, when displaying the 3D model object that the user expects to view to the user's terminal interface, the model rendering server performs the rendering task of the target 3D model object in a way that meets the user's most basic viewing needs, reduces the data processing pressure of the user-side rendering to generate the 3D model object, and speeds up the loading speed of the 3D model object on the user-side interface. In particular, when the user's access purpose is only to view the local details of the 3D model, there is no need to render the global details of the 3D model object with the highest accuracy or resolution. For example, unnecessary parts such as nuts in the equipment can be displayed without or with a lower resolution.
[0024] Conventional digital factory SAAS cloud platforms usually assume that all management terminals have the same processing performance. If only the terminal data generation is performed on the digital model of the factory that has been built, the corresponding needs can be met by uniformly setting the processing performance of the management terminal. However, the conventional processing method lacks the original design data (model, specifications, etc.) of the model equipment and cannot be directly converted into a production bill of materials. Since the data processed by the user terminal used for the original design data is mostly simple two-dimensional drawings or business data, it usually does not have strong complete three-dimensional model processing performance, which results in the digital twin factory being unable to be directly applied to the user terminals used in the production link manufacturing. Therefore, the combination of the above-mentioned prior art and conventional technical means cannot solve the above-mentioned technical problems involved in this application.
[0025] Furthermore, different network bandwidths will also directly affect the model loading speed of different user terminals, especially in the process of switching from two-dimensional drawings to three-dimensional models, there will be a significant mutation in the amount of data transmission. The model rendering server of the present application can determine the field of view and / or depth of field related to the target model object selected at the terminal according to the network bandwidth of the user terminal that makes the viewing request, and render the components related to the determined field of view and / or depth of field according to the display possibility selected by the user through his terminal. Specifically, according to the network bandwidth request result of the user terminal, the model rendering server determines the field of view and / or depth of field of the target three-dimensional model object displayed to the user terminal interface to ensure the model loading speed while ensuring the clarity of the displayed three-dimensional model object. For example, if the network bandwidth of the user terminal is low, the amount of data that can be loaded per unit time is small, and the model rendering server can render the target three-dimensional model object with the first depth of field and / or the first field of view; if the network bandwidth of the user terminal is high, the model rendering server can render the target three-dimensional model object with the second depth of field and / or the second field of view. The second depth of field and / or the second field of view are greater than the first depth of field and / or the first field of view. That is, when the network bandwidth of the user terminal is low, only the target 3D model object selected by the user is displayed at high resolution, while the remaining objects and background are displayed at lower resolution.
[0026] Preferably, building a factory planning SaaS system based on the WebGL lightweight display model database also includes:
[0027] Build a cloud-based solution review tool for users to annotate, review and / or confirm the model output in combination with 2D and 3D views.
[0028] Preferably, lightweighting and WebGL processing of the 3D model data may include:
[0029] Use the graphics compression engine to compress the 3D model required for factory planning to achieve lightweight model data;
[0030] Based on the lightweight 3D model file, cloud rendering configuration and resource registration are completed to form a rendering model that can be displayed on the output end.
[0031] Preferably, building a factory planning tool that allows a user to build a factory model at a model output end may include:
[0032] Providing a building platform drawing tool for users to perform model drawing tasks;
[0033] and / or providing a floor layout tool for a user to perform floor model layout tasks;
[0034] And / or provide a pipeline generator for users to perform automatic tapping of device pipelines.
[0035] Preferably, using a graphics compression engine to compress the three-dimensional model required for factory planning to achieve lightweight model data may include:
[0036] Scatter and manage the UV maps and 3D models in the 3D models required for factory planning;
[0037] The graphics compression engine performs voxel decomposition on the 3D model, separates the 3D mesh geometry existing in the 3D coordinates according to the set spatial geometry, and performs data structure optimization of compressed texture images, compressed vertex number algorithms, and optimized index buffers. In the present invention, after the 3D model is lightweight, it is uniformly output in wlkx format and uploaded to the cloud and displayed on the browser in the form of WebGL, which significantly reduces the computing pressure of the CPU and GPU.
[0038] Preferably, the cloud rendering configuration may include:
[0039] Create a model cloud rendering function to render the lightweight 3D model file content in a DOM element or a container element of a CSS selector string to mount the cloud rendering model.
[0040] Preferably, resource registration may include:
[0041] Control and manage the basic modules in the lightweight 3D model;
[0042] and / or controlling and managing object scenes in lightweight three-dimensional model scenes;
[0043] and / or control and manage NPC roaming content;
[0044] And / or control and manage basic voxels and 3D elements.
[0045] Preferably, the lightweight processing for the three-dimensional model may include absolute lightweighting and relative lightweighting, wherein:
[0046] Absolute lightweighting: By deleting mesh vertices, edges, and faces and unifying the direction of normal vectors, the mesh is optimized.
[0047] Relatively lightweight, it transfers and loads models based on scene needs, and performs distributed loading based on the observer's perspective in the three-dimensional scene.
[0048] Preferably, integrating the WebGL-processed 3D model with the business data to form a model database for users to plan factory construction may include:
[0049] Integrate production and construction data files into the 3D model to form a lightweight model that can simultaneously display production and construction data;
[0050] The unique identification code of the two-dimensional object in the relevant layer obtained by lightweight processing of the two-dimensional view is written into the production and construction data file to match the unique identification code in all associated scene node models.
[0051] Preferably, the digital twin-based factory planning SaaS system involved in the present invention further includes:
[0052] The user makes a viewing request to the model rendering server through his terminal, and the model rendering server provides a first digital twin view of a first data volume to the user terminal in response to the viewing request;
[0053] In response to receiving the first digital twin view, the user selects an object in the two-dimensional view through the terminal to make an access request to the model rendering server for a second digital twin view of a second data volume;
[0054] In response to receiving the access request, the model rendering server requests the terminal making the viewing request for its network bandwidth, resolution, access permission and / or access purpose;
[0055] The model rendering server determines the scale of the second data volume based on the network bandwidth, resolution, access rights and / or access purpose of the terminal and provides at least two display possibilities to the terminal, wherein the first display possibility is determined in association with display speed and performance optimization, and the second display possibility is determined in association with display details and editing access optimization. BRIEF DESCRIPTION OF THE DRAWINGS
[0056] Figure 1 This is a hardware server association diagram of a SaaS system lightweight built based on a power plant model according to a preferred embodiment of the present invention;
[0057] Figure 2 It is a schematic diagram of the construction process of a SaaS system based on a lightweight construction of a power plant model according to a preferred embodiment of the present invention;
[0058] Figure 3It is a business process diagram of a SaaS system based on a lightweight construction of a power plant model according to a preferred implementation mode provided by the present invention;
[0059] Figure 4 It is a software architecture diagram of a SaaS system lightweight built based on a power plant model according to a preferred implementation mode provided by the present invention. DETAILED DESCRIPTION
[0060] The preferred embodiments of the present invention are described in detail below in conjunction with the accompanying drawings, so that the advantages and features of the present invention can be more easily understood by those skilled in the art, thereby making a clearer and more explicit definition of the protection scope of the present invention. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments described herein.
[0061] The present invention proposes a SaaS platform system based on the lightweight compression conversion of 3D models used in the planning period of new factories (such as power plants), drag-and-drop planning and construction of WebGL factory equipment models, and automatic output of production and manufacturing bills of materials. The system can connect to the ERP or MES systems of different manufacturers, automatically export the bill of materials of equipment and facilities in the planning drawings, and can send the order-taking system or production and manufacturing execution system information of each equipment outsourcing manufacturer in real time. It is a management SaaS platform system that can complete the factory from the planning and design stage to the design and manufacturing integration stage.
[0062] Figure 1 A hardware server association diagram of a SaaS system based on a lightweight construction of a power plant model according to a preferred embodiment of the present invention is shown. Specifically, the SaaS system or SaaS architecture platform described in the present invention may include a database service module, a file service module, a database access core service module, and a business operation service module that are communicatively coupled to each other. Specifically, the database service module includes a database server, which has all database information of the lightweight SaaS platform, such as database management information, enterprise information, designer information, model information, project information, BOM information, and dynamic information of the database. The file service module is a file server for building a model system, which is used to store, for example, 3D model files and related image files. The database access core service module is used to perform various business and management operations on the database and file server. The business operation service module is used to provide power plant model design services, including model conversion, two- and three-dimensional linkage, and BOM list output, etc., and mainly serves the planning and construction of power plants.
[0063] Furthermore, another aspect of the present invention provides a method for building a power plant planning SaaS system based on lightweight models, the method comprising building a database server and a file server; building a database access core server; and building a business operation server. More specifically, the SaaS system building method is a method for building a power plant building, equipment, and pipeline model library in combination with WebGL technology, and the method may include the following steps:
[0064] Classification of power plant building, equipment and piping model libraries.
[0065] Based on the model design attributes (such as Archi, Eqp or Pipe), the lightweight compressed partitions entering different levels are judged and converted to WebGL models.
[0066] Based on the two-dimensional layout diagram, drag the model that enters the model level library to the web page, and perform building block-like model stacking and drag-and-drop construction.
[0067] Based on the model classification of power plant area and purpose, the familiar way of associating equipment, pipeline and instrument production information can be automatically derived to derive the classification logic of different bills of materials (such as electronics, machinery, architecture or construction).
[0068] SaaS platform and MES (Manufacturing Execution System), ERP (Enterprise Resource Planning) system automated bill of materials delivery and push method.
[0069] Preferably, when building a three-dimensional model of a power plant (such as a building or equipment model) on a web page, key feature points of the model, such as a dragged pipeline interface, can be automatically adsorbed when it is close to a power plant pump pipeline interface, thereby automatically completing the construction and combination of different equipment and facilities.
[0070] Figure 2 The figure shows a schematic diagram of the construction process of a SaaS system based on a lightweight construction of a power plant model according to a preferred embodiment of the present invention. Specifically, in the present invention, the method for constructing a power plant planning SaaS system based on a lightweight model mainly includes the construction of a three-dimensional model of a power plant and a lightweight WebGL display and the construction of a power plant planning SaaS platform system. Figure 2 The method for building a power plant planning SaaS system based on lightweight model provided by the present invention may include the following steps:
[0071] S100: Construction of WebGL lightweight display model database.
[0072] Specifically, the process of building a WebGL lightweight display model database includes the local construction of the three-dimensional model of the power plant planned by the power plant, the lightweighting of the model data, the WebGL processing of the model data and the integration of the database. The main work of building a WebGL lightweight display model database is to lightweight, cloud and WebGL model the model building content entrusted by the user, and integrate the final WebGL model with the business data to build a model database that can be used by users to plan and build power plants.
[0073] S200: Construction of power plant planning SaaS platform system.
[0074] Specifically, the main work content of building a power plant planning SaaS platform system is to classify various sub-databases as the source of materials for users to plan power plants based on the WebGL lightweight display model database, build a variety of power plant planning tools that serve users to build power plant models on the web page in a drag-and-drop manner, and build a display platform and production list export tool suitable for the models built by users, so that users can efficiently and easily plan the preliminary preparations and construction preparations of the power plant in the power plant planning SaaS platform system.
[0075] According to a preferred implementation, the steps of building a WebGL lightweight display model database may specifically include:
[0076] S101: Build a three-dimensional model of the power plant for power plant planning.
[0077] Specifically, the power plant planning SaaS platform provided by the present invention is compatible with third-party design tool software formats. Combined with the two-dimensional engineering drawings (DXF / PDF / SVG), equipment and pipeline models (RVM / VUE / DWG) and / or building models (RVT) provided by users, a local three-dimensional model of the power plant planning is pre-built based on the original design tools (such as CAD).
[0078] S102: Lightweight processing of three-dimensional model data.
[0079] Specifically, the relevant three-dimensional models of the power plant planning are compressed based on the 2D / 3D compression engine to achieve lightweight three-dimensional model data. Specifically, the UV map and three-dimensional model in the relevant three-dimensional model of the power plant planning are broken up and managed, and the broken model surface is split into multiple small triangles, and the proportion and shape of each model surface in the texture map are matched and fitted by algorithm to ensure that each model surface corresponds to a two-dimensional UV map, and the resolution of the map attached to the model surface is accurate. Furthermore, the 2D / 3D compression engine performs voxel decomposition on the relevant three-dimensional model of the power plant planning, separates the 3D mesh geometry existing in the XYZ coordinates according to the set spatial geometry (such as cubes, spheres, cylinders, cones or torus, etc.), and compresses the texture image, compresses the vertex number algorithm and optimizes the data structure of the index buffer.
[0080] In particular, the 2D / 3D compression engine can adopt the ezWalker2D / 3D compression engine independently developed by the applicant. The ezWalker2D / 3D compression engine is compatible with a variety of mainstream 3D model source file formats (such as .CATproduct, .ASM, .SLDASM, .PRT, .STEP, .IAM, .REVIT, etc.), and can unify the relevant three-dimensional model format data of power plant planning into a new model format wlkx for output. Through the above-mentioned data lightweight process, the storage space occupied by the model data is reduced, and the compression ratio is between 1:10 and 1:50 compared with the original model; at the same time, the format of the 3D model source file is unified and output as wlkx, further reducing the data processing volume on the Web (browser) side.
[0081] S103: WebGL processing of the 3D model data.
[0082] Specifically, based on the 2D / 3D compression engine, the uploaded wlkx format 3D model file is processed, and the cloud rendering configuration and resource registration are completed to form a WebGL rendering model that can be displayed on the Web (browser) side. The process of cloud rendering configuration is: create a model cloud rendering function (creatCloud), mount the cloud rendering model, and render the uploaded wlkx format 3D model content in a container element of a DOM element or CSS selector string to mount the cloud rendering model, and complete the cloud rendering configuration.
[0083] According to a preferred embodiment, the process of displaying the WebGL rendering model on the Web (browser) side may include: building a set of standard interfaces based on standard HTML, CSS and JavaScript, covering the real-time rendering function, which can quickly, efficiently and timely render the three-dimensional model scene based on the cloud rendering configuration. Preferably, the three-dimensional model scene loading process can be divided into absolute lightweight processing and relative lightweight processing, wherein the absolute lightweight process is to modify the model LOD algorithm to delete the mesh vertices, edges and faces and unify the normal vector direction to obtain the optimized state of the mesh; the relative lightweight process is based on the scene needs to transfer and load the model, and according to the regional position and distance of the observer in the three-dimensional scene, distributed progressive loading is realized, and different LOD model levels are switched to maintain rendering efficiency.
[0084] According to a preferred implementation, the resource registration process may include:
[0085] a. Control and manage the basic modules in the lightweight 3D model, including:
[0086] ① Call the lightweight model loading manager to complete the call of the model address, model download method and / or model initialization position and posture.
[0087] ② Call the model measurement manager to control and manage two-point, height, clear distance, angle, area and / or continuous measurement on the model.
[0088] ③Call the environment manager to control and manage sunlight intensity, outline color, sky box, ambient light intensity, sunlight direction, shadows, coordinate axis type and / or set grid.
[0089] ④ Call the static collision detection manager to start and end static collision detection on the model, obtain the static collision detection results, and set the collision detection progress callback function for management.
[0090] b. Control and manage the object scenes in the lightweight 3D model, including:
[0091] ① Obtain the GUID node, 3D root node, pick node callback function, pick point and pick node in the scene of each model, obtain the node operation interface and / or obtain the virtual tree operation interface.
[0092] ② Call the node operation manager to manage setting and obtaining node status, obtaining node attributes, obtaining node bounding boxes and / or obtaining and setting node local transformations.
[0093] ③ Call node management to obtain parent nodes, ancestor nodes, child nodes and / or node names for lightweight three-dimensional models for management.
[0094] ④ Call the virtual node manager to manage the creation and deletion of virtual nodes, obtain the number of times the node is referenced and / or obtain the virtual node based on the GUID.
[0095] c. Control and manage NPC roaming content, including:
[0096] ①Call the NPC manager to manage gravity mode, first-person perspective, collision detection, adding and deleting NPCs, setting and getting NPC postures, deleting a certain NPC object in a layer, and deleting a certain NPC object in a layer by pattern GUID;
[0097] ②Call the path manager to manage path objects, path management, path animation objects, path animation addition and deletion, and / or path layer objects;
[0098] ③ Call the exploded view manager to obtain the explosion object GUID, set the model node of the explosion effect in the exploded view, manage the explosion effect when it explodes to a certain position, the explosion animation effect within a specified range, clear the scene to view the final explosion effect, and / or pause and continue the explosion view animation.
[0099] d. Control and manage basic voxels and 3D elements, including:
[0100] ① Call the sign manager to manage 3D element objects and / or 3D element layers.
[0101] ② Call the fence object class manager to manage the GUIDs of the fence objects, fence object layers and / or fence walls.
[0102] ③Call the Advanced Settings Manager to manage advanced retrieval and / or advanced operations of model objects.
[0103] ④ Call the sectioning manager to manage model sectioning and / or sectioning object operations.
[0104] S104: Database integration.
[0105] Specifically, according to the results of cloud rendering configuration and resource registration, the business data is combined with the lightweight three-dimensional model to integrate and form a WebGL lightweight model database. Business data can include various data related to factory design, construction and related component production. Specifically, the XML files in the production and construction data such as construction, production operation and maintenance are integrated into the wlkx model to form a lightweight model that can synchronously display the production and construction data; the two-dimensional engineering drawings (PDF, DXF or SVG) are lightweight processed to obtain the unique identification code of the objects in the relevant layers, and the unique identification code is written into the XML file to match the unique identification code (or bit number) in all scene node models generated in the association S103, so as to realize the selection of equipment in the three-dimensional model list and 3D screen and jump to the corresponding equipment display of the two-dimensional engineering drawing, so as to realize the management of two-dimensional and three-dimensional linkage effects.
[0106] According to a preferred implementation, after the WebGL lightweight display model database is built according to the above steps, the user can use the WebGL lightweight display model database to build a power plant planning SaaS system. Specifically, building a power plant planning SaaS system may include:
[0107] S201: Classify the content of the WebGL lightweight display model database to establish a standard library.
[0108] Specifically, the standard library includes but is not limited to a standard equipment library (such as generator sets, high-pressure boilers, etc.), a standard parts library (such as standard accessories for turbine and boiler areas, etc.), an auxiliary material library (such as tanks, pipes, etc.), etc.
[0109] S202: Construct a power plant planning tool that allows users to plan power plant models in a drag-and-drop manner on the Web (browser) side.
[0110] Specifically, the power plant planning SaaS system provides users with a variety of platform building tools, including building platform drawing tools, which are used for users to complete model drawing by selecting and adjusting civil construction parameters. Optionally, civil construction parameters include but are not limited to plant location, plant type (such as concrete, steel structure and steel frame, etc.), floor area and number of floors, floor elevation, steel column type (such as T-shaped, H-shaped), column spacing and number of columns. Floor layout tool, used for users to complete the model floor layout work, the specific functions of the floor layout tool include but are not limited to equipment positioning, pipeline interface docking, single floor adsorption and equipment interface connection. Automatic pipeline generator, used to automatically complete the construction combination of different equipment and facilities when the user drags and drops to build the power plant, specifically based on the guidance of related algorithms, when the user drags and drops to build the power plant model, the equipment pipeline can be automatically adsorbed when it is close. The guidance algorithm can realize the modification of pipeline connection type (such as round head, square head, square to round connection, hopper connection or elbow connection, etc.), matching the material properties of the pipeline, steel plate thickness, slide pipe diameter and type and other parameters, matching pipeline inlet and outlet types, height dimensions, elbow angles, etc. Automatic floor opening calculation, support for manual adjustment of pipe connection elbow direction, etc. The relevant algorithm can be one or more of topological relationship, distance field, neural network and machine learning.
[0111] S203: Build a cloud-based solution review tool.
[0112] Specifically, based on the linkage between the two-dimensional and three-dimensional drawings in step S104, the user can select relevant components of the two-dimensional drawings and / or three-dimensional models on the platform to synchronously obtain the corresponding three-dimensional models and / or contents on the two-dimensional drawings on the platform, thereby allowing the user to synchronously combine 2D engineering drawings and 3D design models on the web page for annotation, review and confirmation.
[0113] S204: A component three-dimensional visualization display tool allows the user to export and display the constructed power plant model.
[0114] Specifically, after the user builds the power plant model, the three-dimensional visualization display tool can be integrated with various APIs to achieve display on mobile terminals (such as mobile phones, tablets, etc.) or Web (browser) terminals, and can be pushed to relevant stakeholders for browsing and display via QR codes or URLs.
[0115] The factory planning SaaS platform system based on digital twins according to the embodiment of the present invention includes a rendering server and multiple terminals communicating with the server. Furthermore, after the user has built the power plant model, when the user browses the layout of the related building, equipment and / or pipeline model through the terminal device equipped by the user, the following method can be used:
[0116] S1) The user terminal makes a viewing request to the model rendering server. In response to the viewing request, the model rendering server provides the user terminal with a first digital twin view of a first data volume. Specifically, the first digital twin view is, for example, a two-dimensional plane engineering drawing. The user terminal can be a mobile phone, a tablet, and a personal computer. Different types of user terminals have different CPU and GPU processing capabilities, which affect the output results of the lightweight processed three-dimensional model on the user terminal interface, such as affecting the field of view, depth of field and / or clarity of each three-dimensional object in the three-dimensional scene.
[0117] S2) After receiving the first digital twin view of the first data volume, the user submits an access request to the model rendering server for accessing the second digital twin view of the second data volume by selecting an object (such as equipment, pipeline component) on the first digital twin view on the terminal. Specifically, the second digital twin view is, for example, a three-dimensional model diagram. The second data volume of the second digital twin view is greater than the first data volume of the first digital twin view, and in particular, is several orders of magnitude greater than the first data volume.
[0118] S3) In response to receiving an access request for the second digital twin view, the model rendering server requests the network bandwidth, resolution, access permission and / or access purpose of the user terminal that made the viewing request.
[0119] Specifically, in the present invention, the access request made by the user terminal to the model rendering server includes but is not limited to a request to view, edit or delete one or more objects in the second digital twin view.
[0120] S4) The model rendering server determines the size of the second data volume based on the network bandwidth, resolution, access rights and / or access purpose of the user terminal that makes the viewing request and provides at least two display possibilities to the user terminal that makes the viewing request, wherein the first display possibility is determined in relation to display speed and performance optimization, and the second display possibility is determined in relation to display details and editing access optimization.
[0121] According to a preferred embodiment, in the present invention, the scale of the second data volume of the second digital twin view can be determined as follows:
[0122] The model rendering server determines the minimum size of the components to be rendered based on the minimum naked eye resolution size determined by the resolution of the user terminal that makes the viewing request. Specifically, in view of the different data processing performances of different user terminals, when displaying the three-dimensional model object that the user expects to view to the user's terminal interface, the model rendering server performs the rendering task of the target three-dimensional model object in a manner that meets the user's most basic viewing needs, reduces the data processing pressure of the user-side rendering to generate the three-dimensional model object, and speeds up the loading speed of the three-dimensional model object on the user-side interface. In particular, when the user's access purpose is only to view the local details of the three-dimensional model, it is not necessary to render the global details of the three-dimensional model object with the highest accuracy or resolution. For example, unnecessary parts such as nuts in the equipment can be displayed or the resolution can be reduced.
[0123] According to a preferred embodiment, the model rendering server can determine the field of view and / or depth of field related to "selecting an object on the first digital twin view at the terminal" according to the network bandwidth of the user terminal that makes the viewing request, and render the components related to the determined field of view and / or depth of field according to the display possibility selected by the user through his terminal. Specifically, according to the network bandwidth request result of the user terminal, the model rendering server determines the field of view and / or depth of field of the target three-dimensional model object displayed to the user terminal interface to ensure the model loading speed while ensuring the clarity of the displayed three-dimensional model object. For example, if the network bandwidth of the user terminal is low, the amount of data that can be loaded per unit time is small, and the model rendering server can render the target three-dimensional model object with the first depth of field and / or the first field of view; if the network bandwidth of the user terminal is high, the model rendering server can render the target three-dimensional model object with the second depth of field and / or the second field of view. The second depth of field and / or the second field of view are greater than the first depth of field and / or the first field of view. That is, when the network bandwidth of the user terminal is low, only the target three-dimensional model object selected by the user is displayed with high resolution, while the remaining objects and background are displayed with reduced resolution.
[0124] S205: Build a one-click automatic output tool for BOM lists to allow users to export the bill of materials related to the power plant planning model with one click for production and construction preparation.
[0125] Specifically, based on the production and construction data related to the lightweight model in step S104, different materials are classified in combination with the production information familiarity of the area, purpose and related equipment, pipelines and instruments based on the power plant model. Furthermore, the user can automatically export the BOM production list of all power plant equipment, pipelines and instruments in the field with one click, or click to select the BOM list of equipment, pipelines and instruments that need to be exported from the web page, and send it to the docked production MES or third-party ERP system to complete the workshop production or third-party outsourcing production process. The BOM list can include automatic output of pipelines, floor openings, and engineering drawings, generate a list BOM (EXCEL or PDF format, the same below) of equipment, prefabricated parts, floor platforms, etc.; generate a purchase list BOM for purchased parts; generate a list BOM for pipelines, chutes, and clamps; generate a list BOM for building steel; output a list BOM of standard parts (such as screws and nuts), etc.
[0126] Those skilled in the art will appreciate that, as long as the purpose of the present invention can be achieved, other steps or operations may be included before and after the above steps or between the steps, such as further optimizing and / or improving the method described in the present invention. In addition, although the method described in the present invention is shown and described as a series of actions performed in sequence, it should be understood that the method is not limited by the sequence. For example, some actions may occur in an order different from the order described herein. Alternatively, an action may occur simultaneously with another action.
[0127] Figure 3 This is a business process diagram of a SaaS system based on a lightweight power plant model according to a preferred embodiment of the present invention. Specifically, Figure 3 The power plant design SaaS architecture platform shown mainly includes the power plant design SaaS platform interface module, the power plant planning system interface module and the WebGL lightweight display module. Users can enter the platform homepage through the power plant design SaaS platform interface module and can perform business operation processes including but not limited to the following:
[0128] ① The three-dimensional model of the power plant that has been planned in the local drawing software (such as CAD) can be directly compressed and clouded through the 2D / 3D compression engine. For example, it supports the format conversion of multiple mainstream 3D model source files (.CATproduct, .ASM, .SLDASM, .PRT, .STEP, .IAM, .REVIT, etc.) to form a web page display in WebGL format.
[0129] ② For facility pipelines that need to enter 2D engineering drawings and 3D models and click on 2D drawing components to jump to 3D model components, the property association is completed through the 2D and 3D drawing linkage function (for example, the 2D and 3D drawing linkage is set through the association and binding algorithm of the A valve layer number of the DWG drawing and the A valve 3D model unique identification code GUID), and then the 2D / 3D compression engine is used for cloud compression and displayed on the web page.
[0130] ③ For those who want to build equipment and facilities in professional areas of a power plant (such as the turbine room, boiler area or chemical water area) from scratch, they can enter the power plant planning system interface through the power plant design planning tool, and quickly build them by dragging and dropping from the loaded conventional power plant area equipment, building and pipeline model library. Among them, the key equipment and pipeline nodes can be automatically connected in close proximity to complete the equipment planning and construction similar to the production process flow of the power plant.
[0131] ④ For technical transformation or new equipment areas of existing power plants, you can customize the three-dimensional models of equipment, pipelines and buildings by lightweight model and WebGL processing, upload, compress and import them into the customized model library.
[0132] ⑤ The custom model library provides multiple modes of model writing for custom equipment import. One of them is the two-dimensional and three-dimensional model data provided by third-party manufacturers. You can define the linkage binding of two-dimensional and three-dimensional data by yourself, and import the model in WebGL format into the custom model library after compression. The other is custom customer-designed pipelines, equipment, and buildings, which require editing operations through the local power plant equipment library management tool of the C / S architecture (for example, use the equipment editing tool to modify the parameters of the existing equipment model to become equipment, pipelines or buildings that meet the custom parameters, and then compress the model, cloud it, and put it into the warehouse).
[0133] ⑥ The completed cloud power plant model can be displayed through a mobile terminal (such as a mobile phone, tablet) or a computer Web (browser), and can be pushed to relevant stakeholders for browsing and display through, for example, a QR code or URL.
[0134] ⑦ The planned power plant model, in which the model-associated design attribute data of the equipment, pipelines, instruments or steel structures to be produced automatically forms a BOM list, and is exported and displayed according to different types (EBOM, MBOM or PBOM), so that the BOM list can be displayed and exported to Excel or PDF files with one click.
[0135] ⑧Open the API interface of the BOM list, which can be connected to the third-party production execution system MES and enterprise resource planning system ERP.
[0136] Figure 4This is a software architecture diagram of a SaaS system based on a lightweight power plant model according to a preferred embodiment of the present invention. Figure 4 The main functional modules of the power plant design SaaS platform architecture provided by the present invention include PIMCenter Core API Server, middleware computing engine and general service virtual machine framework. Specifically, PIMCenter Core API Server is based on the integration and three-dimensional visualization of various APIs, including an online power plant planning system based on power plant planning layout, a power plant design SaaS platform and a WebGL lightweight display module, which are finally displayed on tablets, computers and mobile phones. Later, the real-time data system of the equipment can be connected to form a smart power plant digital twin platform that supports power plant operation and maintenance safety decision-making.
[0137] The middleware computing engine includes a graphic database, a general database, a graph database, and an SDK module. The graphic database may include a two-dimensional graphic database and a three-dimensional model database, which is used to realize the association, modification coordination, and fast search and call of two-dimensional graphics (DWG) and three-dimensional models of different equipment and products. The two-dimensional / three-dimensional graphics compression engine provides an indexing function for searching plan drawings, engineering drawings, and three-dimensional drawings based on different keywords. The SDK module provides secondary development function modules for the above computing engines to meet the customized needs of different enterprises / individuals for power plant construction planning.
[0138] The general service virtual machine framework provides the underlying memory and data management functions, including memory allocation, serialization and deserialization, unified data extension framework, etc. Furthermore, the general service virtual machine framework includes storage services, encryption and decryption services, network communication services, operation log services, audit services and other functional sub-modules, which are the basis of the core architecture of the entire power plant design SaaS cloud platform.
[0139] It can be understood that the SaaS architecture platform using power plant planning as an example shown in the embodiment of the present invention is only an illustration of a non-limiting example. In fact, the model-based lightweight SaaS planning and design platform described in the present invention can also be applied to plant construction planning needs including various other building forms.
[0140] It should be noted that the above-mentioned specific embodiments are exemplary, and those skilled in the art can come up with various solutions inspired by the disclosure of the present invention, and these solutions also belong to the disclosure scope of the present invention and fall within the protection scope of the present invention. Those skilled in the art should understand that the present invention specification and its drawings are illustrative and do not constitute a limitation on the claims. The scope of protection of the present invention is defined by the claims and their equivalents. The present invention specification contains multiple inventive concepts, such as "preferably" and "according to a preferred embodiment", which means that the corresponding paragraph discloses an independent concept, and the applicant reserves the right to file a divisional application based on each inventive concept.
Claims
1. A platform management system, characterized in that: include: File service module, used to store 3D model files and related image files; A database access core service module, used to perform various business and management operations on the database and the file service module; Business operation service module, used to provide power plant model design services; Wherein, the business operation service module is provided with a factory planning tool that allows the user to build a factory model at the model output end; The factory planning tools include: Providing a building platform drawing tool for users to perform model drawing tasks; and / or providing a floor layout tool for a user to perform floor model layout tasks; And / or provide a pipeline generator for users to perform automatic tapping of device pipelines.
2. The platform management system according to claim 1, characterized in that: The business operation service module is provided with a display platform and a production list export tool suitable for the factory model built by the user; The user can use the production list export tool to automatically export the BOM production list of all factory equipment, pipelines and instruments in the entire site with one click; Alternatively, the user clicks to select the BOM list of equipment, piping, and instruments that needs to be exported from the browser, and sends it to the connected production MES system or third-party ERP system to complete the workshop production or third-party outsourcing production process.
3. The platform management system according to claim 1, characterized in that: The platform management system includes a collaborative design function page, On the collaborative design function page, designers and design studios in different regions log in to the platform to collaboratively modify the same factory model and control different design versions of the same model. Collaborate on the annotation, modification and review of 3D models or 2D engineering views through tool modules.
4. The platform management system according to claim 3, characterized in that: The platform management system includes a construction planning function page, On the construction planning function page, the factory 2D master plan, equipment layout and 3D model drawings are linked and jumped. Collaborate on the annotation, modification, and review of 3D models or 2D engineering views through the tool modules on the system page.
5. The platform management system according to claim 3, characterized in that: It also includes database service modules. The lightweight 2D engineering drawings have unique identification codes for objects in the relevant layers, and the unique identification codes are matched and associated with the unique identification codes in all scene node models. The unique identification code serves as a switching bridge between models of different dimensions to realize device selection in the three-dimensional model list and 3D screen and jump to the corresponding device display of the two-dimensional engineering drawing, thereby realizing the two- and three-dimensional linkage effect.
6. The platform management system according to claim 3, characterized in that: The 3D model on the construction planning function page is a compressed lightweight 3D model. Each model face of the lightweight three-dimensional model corresponds to a two-dimensional UV map to ensure that the resolution of the map attached to the model face is accurate.
7. The platform management system according to claim 6, characterized in that: The lightweighting step of corresponding each model face of the lightweight three-dimensional model to a two-dimensional UV map includes: Scatter and manage the UV maps and 3D models in the relevant 3D models of power plant planning. The broken model surface is split into multiple small triangles. The proportions and shapes of the small triangles and each model face in the texture map are matched and fitted by an algorithm to ensure that each model face corresponds to a two-dimensional UV map.
8. The platform management system according to claim 6, characterized in that: The lightweight 3D model is configured through cloud rendering and resource registration to form a WebGL rendering model that can be displayed on the browser side; The process of cloud rendering configuration is as follows: Create a model cloud rendering function, mount the cloud rendering model, and render the uploaded 3D model content in a container element of a DOM element or CSS selector string to mount the cloud rendering model, completing the cloud rendering configuration.
9. A terminal, characterized in that: The terminal is connected to the model rendering server in the platform management system. In response to a viewing request made by a user through his terminal to the model rendering server, the model rendering server provides a first digital twin view of a first data volume to the user's terminal; In response to a user making an access request to the model rendering server for a second digital twin view of a second data volume in response to an object in the two-dimensional view selected by the user through the terminal, the model rendering server requests the terminal making the viewing request for its network bandwidth, resolution, access permission and / or access purpose; The model rendering server determines the scale of the second data volume based on the network bandwidth, resolution, access rights and / or access purpose of the terminal and provides at least two display possibilities to the terminal, wherein the first display possibility is determined in association with display speed and performance optimization, and the second display possibility is determined in association with display details and editing access optimization.
10. A model rendering server, connected to a user's terminal, characterized in that: The field of view and / or depth of field related to the target model object selected at the terminal is determined according to the network bandwidth of the terminal of the user making the viewing request, and the components related to the determined field of view and / or depth of field are rendered according to the display possibility selected by the user through his terminal.
Citation Information
Patent Citations
Lightweight display technology of three-dimensional model based on WebGL
CN106909640A
Method and system for searching document association
CN102999524A
Online three-dimensional rendering technology and system based on cloud platform
CN110751712A
Roadbed slope live-action three-dimensional model visual modeling method
CN112734924A
Fabricated lightweight steel structure building intelligent design and industrial construction cloud platform
CN115758551A