Low-code digital twin platform building method, device, equipment and medium

Abstract

The invention discloses a low-code digital twinning platform building method, device, equipment and medium, and relates to the technical field of digital twinning, and the low-code digital twinning platform building device comprises an organization structure module, a scene module, a twinning body module, a virtual-real mapping module, a twinning data access module and a twinning side rendering module. A system administrator creates a user organization structure, opens accounts for accessing a management side and a twin side and gives role permission, a user logs in a management side system, uploads a scene model and a data label, configures basic information and feature information of equipment facilities, renders a three-dimensional model scene on the management side, and gives role permission to the twin side. The method comprises the following steps: selecting a corresponding model in a scene according to a physical world point location coordinate to associate and map with equipment facility twinborn body data, displaying a static three-dimensional scene on a twinborn side, further accessing twinborn data by configuring Internet of Things communication information, converting and pushing the twinborn data to the twinborn side, and rendering the twinborn data in the static three-dimensional scene on the twinborn side. And the purpose of constructing the digital twin system by the twin bodies with low code configuration is achieved.

Description

Technical Field

[0001] This invention relates to the field of digital twin technology, and in particular to a method, apparatus, equipment and medium for building a low-code digital twin platform. Background Technology

[0002] Digital twins fully utilize physical models, sensor updates, and operational history data to integrate multidisciplinary, multi-physical, multi-scale, and multi-probabilistic simulation processes, completing mapping in virtual space to reflect the entire lifecycle of the corresponding physical equipment. It is a concept that transcends reality and can be regarded as a digital mapping system of one or more important and interdependent equipment systems.

[0003] In short, it involves creating a digital "clone" of a device or system, also known as a "digital twin." This "clone" is created on an information platform and is virtual. With the development of information technology, combined with the Internet of Things, big data, and artificial intelligence, it provides greater value and benefits to the operation, maintenance, and optimization of physical entities at four levels: monitoring and description, analysis and diagnosis, prediction and optimization, and decision support.

[0004] The current digital twin system, after importing the model, handles the virtual-real mapping of device model nodes and data flow during the coding stage to build a digital twin scenario. For different business scenarios, customized work needs to be done during the coding stage, which results in a lot of code and redundant work, thus affecting the overall operation. Summary of the Invention

[0005] This invention provides a method, apparatus, device, and medium for building a low-code digital twin platform, which can solve the problem of excessive code and redundant work in the prior art.

[0006] This invention provides a method for building a low-code digital twin platform, comprising the following steps:

[0007] The architecture of the digital twin platform for creating a digital twin platform includes a management side that operates the physical entity model and a twin side that displays the scene of the digital twin model of the physical entity.

[0008] Import the 3D model of the equipment and facilities on the management side to obtain a static 3D model scene of the equipment and facilities that can be rendered on the twin side;

[0009] Import the basic and feature information of the 3D model of the equipment and facilities on the management side to obtain a static 3D model scene that carries twin data information for rendering on the twin side;

[0010] On the management side, the three-dimensional equipment and facility models that need to be displayed in the scene are selected based on the physical world point coordinates. The twin data of the equipment and facilities imported on the management side will be associated and mapped with the equipment and facility models to obtain a static three-dimensional model scene that can establish a virtual reality mapping on the twin side.

[0011] Configure and manage IoT communication information, convert and push the collected equipment and facility data to the equipment model in the digital geometric model scene, realize the rendering of twin data in the virtual-real mapping 3D model scene on the twin side, that is, realize the construction of a low-code digital twin platform.

[0012] Preferably, importing the 3D model of the equipment and facilities on the management side includes the following steps:

[0013] Create 3D models of equipment and facilities using 3ds Max or other 3D modeling software, and then upload the created 3D models to the management side.

[0014] Preferably, obtaining a static 3D model scene capable of rendering twin data information on the twin side includes the following steps:

[0015] Upload equipment information on the management side, including equipment type, equipment measurement points, equipment name, equipment attributes, equipment area, and static extended information of the equipment and facilities in the physical world.

[0016] Upload camera information to the management side, including grouping information of devices and facilities in the physical world, camera name, streaming method, streaming template name, video stream IP, video stream port, video stream account, video stream password, channel information, transcoding compatibility, automatic shutdown settings, and static extended information.

[0017] Equipment information and camera information are collectively referred to as the basic information and feature information of the equipment and facility 3D model;

[0018] Based on the 3D model, basic information, and feature information of the equipment and facilities uploaded by the management side, a static 3D model scene carrying twin data information can be obtained and rendered on the twin side.

[0019] Preferably, obtaining a static 3D model scene capable of establishing a virtual reality mapping on the twin side includes the following steps:

[0020] The uploaded model is loaded and rendered on the management side to obtain a digital geometric model scene that matches the physical world;

[0021] The physical coordinates of the equipment are obtained by measuring and drawing information, and the equipment model that matches the scene is selected from the digital geometric model scene to be displayed based on the physical coordinates.

[0022] The twin data of equipment and facilities imported from the management side will be associated and mapped with the equipment models that match the selected scenes to obtain a static 3D model scene that can establish a virtual reality mapping on the twin side.

[0023] Preferably, the process of rendering twin data in a 3D scene with virtual-real mapping on the twin side includes the following steps:

[0024] Utilize the built-in MQTT communication logic on the management side to configure the required communication information on the web page;

[0025] Based on the configured communication information, the device data format is converted to the internal data format of the twin side through data conversion, so as to render the twin data in the 3D model scene of virtual-real mapping on the twin side.

[0026] This invention also provides a low-code digital twin platform construction device, comprising:

[0027] The organizational structure module is used to create the digital twin platform architecture of the digital twin platform, which includes the management side that operates the physical entity model and the twin side that displays the scene of the physical entity digital twin model;

[0028] The scene module is used to import 3D models of equipment and facilities on the management side;

[0029] The twin module is used to import basic and feature information of the 3D model of equipment and facilities from the management side;

[0030] The virtual-real mapping module is used to select the 3D equipment and facility models that need to be displayed in the scene based on the physical world point coordinates on the management side. It will associate and map the twin data of the equipment and facilities imported on the management side with the equipment and facility models to obtain a static 3D model scene that can establish a virtual reality mapping on the twin side.

[0031] The twin data access module is used to configure IoT communication information on the management side and convert and push the collected equipment and facility data to the equipment model in the digital geometric model scene;

[0032] The twin-side rendering module enables the rendering of twin data in a 3D model scene with virtual-real mapping on the twin side, thus realizing the construction of a low-code digital twin platform.

[0033] This invention also provides an electronic device, including a memory and a processor;

[0034] The memory is used to store computer programs;

[0035] When the processor executes the computer program stored in the memory, it implements the steps of the low-code digital twin platform construction method described above.

[0036] This invention also provides a computer-readable storage medium for storing a computer program, which, when executed by a processor, implements the steps of a low-code digital twin platform construction method as described above.

[0037] This invention provides a method, apparatus, device, and medium for building a low-code digital twin platform, which has the following advantages compared with the prior art:

[0038] This invention directly selects the corresponding model in the digital geometric scene to be displayed based on the physical world point coordinates in the digital twin scene, associates and maps the equipment and facility twin data with the corresponding model in the selected scene, and then connects the equipment and facility data to the twin scene for conversion and push to the twin side by configuring IoT communication information. This process omits repetitive coding work and repetitive code development process, and achieves the goal of building a digital twin platform with low-code configuration of twins.

[0039] Moreover, when it is necessary to change the equipment and facilities in the physical world, it will not affect the logic and use of the overall system. Attached Figure Description

[0040] Figure 1 This is a schematic diagram of the main process of a low-code digital twin platform construction method, apparatus, equipment and medium provided in an embodiment of the present invention;

[0041] Figure 2 A schematic diagram of the organizational structure modules of a low-code digital twin platform construction method, apparatus, equipment and medium provided in an embodiment of the present invention;

[0042] Figure 3 A schematic diagram of a scenario module for a low-code digital twin platform construction method, apparatus, equipment, and medium provided in an embodiment of the present invention;

[0043] Figure 4 A schematic diagram of the device twin module flow of a low-code digital twin platform construction method, apparatus, equipment and medium provided in an embodiment of the present invention;

[0044] Figure 5 A schematic diagram of the camera twin module of a low-code digital twin platform construction method, apparatus, device and medium provided in an embodiment of the present invention;

[0045] Figure 6 A schematic diagram of the device virtual-physical mapping module for a low-code digital twin platform construction method, apparatus, equipment and medium provided in an embodiment of the present invention;

[0046] Figure 7A schematic diagram of the camera virtual-real mapping module for a low-code digital twin platform construction method, apparatus, device and medium provided in an embodiment of the present invention;

[0047] Figure 8 A schematic diagram of the twin data access module of a low-code digital twin platform construction method, apparatus, device and medium provided in an embodiment of the present invention;

[0048] Figure 9 This is a schematic diagram of the twin-side rendering module process of a low-code digital twin platform construction method, apparatus, device and medium provided in an embodiment of the present invention. Detailed Implementation

[0049] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Many specific details are set forth in the following description to provide a thorough understanding of the present invention. However, the present invention can be practiced in many other ways different from those described herein, and those skilled in the art can make similar modifications without departing from the spirit of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0050] See Figures 1-9 This invention provides a method and apparatus for building a low-code digital twin platform, including an organizational structure module, a scene module, a twin module, a virtual-real mapping module, a twin data access module, and a twin-side rendering module.

[0051] The organizational structure module is used to create the digital twin platform architecture of the digital twin platform, which includes the management side for operating the physical entity model and the twin side for displaying the digital twin model scene of the physical entity. That is, it creates the organization, roles, permissions and account information of the twin system users; the scene module is used to import the 3D model and data tags of the twin scene; the twin module is used to configure the basic information and feature information of the equipment and facilities in the physical world; the virtual-real mapping module is used to associate and map the equipment and facility information of the twin module with the model received by the scene module according to the physical world equipment point coordinates; the twin data access module is used to configure the data communication method and data format conversion between the system and the Internet of Things system; and the twin side rendering module is used to display the configuration information of the above modules through human-computer interaction.

[0052] The system administrator creates the digital twin platform architecture of the digital twin platform, which means creating a user organizational structure, opening accounts for access to the management side and the twin side, and assigning role permissions. Users use the accounts created above to log in to the management side system, upload scene models and data tags, configure basic information and feature information of equipment and facilities, render the 3D model scene on the management side, and select the corresponding model in the scene and associate it with the equipment and facility twin data based on the physical world point coordinates. This allows the static 3D scene to be displayed on the twin side. Furthermore, by configuring IoT communication information to access twin data and converting and pushing it to the twin side, the twin data can be rendered in the static 3D scene on the twin side, achieving the goal of low-code configuration of the twin to build a digital twin system.

[0053] Organizational structure modules, such as Figure 2 As shown:

[0054] Establish enterprise, department, position, and employee tables. The enterprise and department tables do not have hierarchical restrictions; enterprises, sub-enterprises, departments, and sub-departments can be dynamically created on the management side, and (sub)enterprises and (sub)departments can be linked. On the management side, employee-related position information can be dynamically added; if no matching position information exists, it can be dynamically added to the position table. After employee information is entered, access permissions can be granted to the management and twin systems, and the above data and their relationships can be stored in the database.

[0055] Scene modules, such as Figure 3 As shown:

[0056] Upload models output from 3ds Max or other 3D modeling software to the management side. Multiple models are allowed to be uploaded, and all components in the model must have a unique identifier. Uploaded models are associated with the organizational structure, and each organization can only manage its own models. Store the above data-to-data, data-to-model, and model-to-model relationships in the database.

[0057] The UI design's tag images are encoded and uploaded to the management side to form a tag library; uploaded tags are associated with the organizational structure, and each organization can only manage its own tags; the above data and the relationships between the data are stored in the database.

[0058] Twin module:

[0059] Device twin modules, such as Figure 4 As shown:

[0060] The management side uploads device information from the physical world, including device type, device measurement points (physical quantities or environmental parameters acquired by sensing devices, such as temperature, humidity, pressure, light intensity, current, voltage, etc.), device name, device attributes, device area, and static extended information, and stores it in a relational database.

[0061] When the equipment information, including the equipment name and measurement points, is first created in the system, a unique internal code for the displacement equipment name and measurement point must be established. This code is called the internal equipment name code and the internal equipment measurement point code. All system logic processing uses the internal equipment name code and the internal equipment measurement point code. The equipment name and measurement points uploaded by the management side are allowed to be changed in the system. The internal equipment name code and the internal equipment measurement point code are globally unique and cannot be changed to prevent changes in equipment name and measurement point naming from affecting the normal operation of the system logic. The twin side displays the equipment name and measurement points uploaded by the management side.

[0062] Camera twin module, such as Figure 5 As shown:

[0063] The management side uploads camera information from the physical world, including group information, camera name, streaming method, streaming template name, video stream IP, video stream port, video stream account, video stream password, channel information, transcoding compatibility, automatic shutdown settings, and static extended information, and stores it in a relational database. When camera information is created, it is associated with the system's built-in streaming template information, such as streaming method and streaming template name. The built-in streaming template contains configuration information and system logic for different camera manufacturers to obtain video streams of different protocols through NVRs or cameras, and can convert the obtained video streams into video streams of protocols such as f1v, m3u8, and GB / T28181.

[0064] Virtual-Real Mapping Module:

[0065] Device virtual-real mapping module, such as Figure 6 As shown:

[0066] Based on the scene model management steps described in the scene module, the uploaded model is loaded and rendered on the management side to display a digital geometric model scene that matches the physical world.

[0067] Retrieve from the database the device name, internal device name code, device measurement point, and internal device measurement point code described in the twin-based module for matching the twin scenario.

[0068] For physical equipment, the location coordinates of the equipment in the physical world are obtained through on-site measurement or drawing information. Based on the location coordinates of the physical equipment, the matching equipment model is manually located in the digital geometric model scene. The system automatically extracts the displacement identifier built into the equipment model and associates and maps this unique identifier with the name of the equipment in the physical world. In the system, this is reflected as the association between the model's unique identifier and the internal equipment name code.

[0069] Equipment measurement points are obtained based on the equipment name. The equipment measurement points are divided into three categories: real-time operating condition measurement points, status measurement points, and alarm measurement points. After associating the equipment model name with the equipment name, the equipment measurement points that need to be displayed on the twin side are selected. Based on the measurement points, the tag type to be displayed on the twin side is selected from the tag library. The association relationship between data and data, and between data and model is stored in the database.

[0070] Camera virtual-real mapping module, such as Figure 7 As shown:

[0071] Based on the scene model management steps described in the scene module, the uploaded model is loaded and rendered on the management side to display a digital geometric model scene that matches the physical world.

[0072] Retrieve the camera names described in the twin-based module, which are to be matched with the twin scene, from the database.

[0073] For physical cameras, the position coordinates of the camera in the physical world are obtained through on-site measurement or drawing information. Based on the position coordinates of the physical camera, the matching camera model is manually located in the digital geometric model scene. The system automatically extracts the unique identifier built into the camera model, associates and maps this unique identifier with the camera name in the physical world, and manually adjusts the camera's viewing angle in the digital geometric model scene so that the camera's field of view in the physical world matches the camera's field of view in the digital geometric model scene.

[0074] Select the tag type to be displayed on the twin side from the tag library, and store the above data-to-data and data-to-model relationships into the database.

[0075] Twin data access module, such as Figure 8 As shown:

[0076] The management side has built-in MQTT Broker logic, which can be configured on the web page with the IP address, port, username, password, topic, QoS, and activation status of the MQTT Broker to be connected. Through the above configuration, the IoT system publishes the collected device data to the MQTT Broker. The device data includes the device name, measurement point information, data value, timestamp, and organization identifier. The twin backend can subscribe to the device data using the same MQTT Broker configuration information. If there are data format inconsistencies, the data conversion module converts the subscribed device data to the internal data format of the twin system and stores it.

[0077] Twin-side rendering module, such as Figure 9 As shown:

[0078] Once the twin-side page rendering is complete, the RestFu1 interface for the latest device data in the scene is called. The system queries the basic information of the model, as well as the real-time measurement point data, status measurement point data, and alarm measurement point data transmitted by the IoT gateway, based on the unique and unchanging internal device name codes organized by the login account. The data is then displayed on the web page in real time. Next, a WebSocket communication is established with the twin-side backend to receive device data in real time and display it on the web page in real time.

[0079] This invention also provides an electronic device, including a memory and a processor.

[0080] Memory is used to store computer programs.

[0081] The steps of implementing a low-code digital twin platform construction method when a processor executes a computer program stored in memory.

[0082] This invention also provides a computer-readable storage medium for storing a computer program, which, when executed by a processor, implements the steps of a low-code digital twin platform construction method.

[0083] The embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these all fall within the protection scope of the present invention. Therefore, the protection scope of this invention patent should be determined by the appended claims.

Claims

1. A method for building a low-code digital twin platform, characterized in that, Includes the following steps: The architecture of the digital twin platform for creating a digital twin platform includes a management side that operates the physical entity model and a twin side that displays the scene of the digital twin model of the physical entity. Import the 3D model of the equipment and facilities on the management side to obtain a static 3D model scene of the equipment and facilities that can be rendered on the twin side; Import the basic and feature information of the 3D model of the equipment and facilities on the management side to obtain a static 3D model scene that carries twin data information for rendering on the twin side; On the management side, the three-dimensional equipment and facility models that need to be displayed in the scene are selected based on the physical world point coordinates. The twin data of the equipment and facilities imported on the management side will be associated and mapped with the equipment and facility models to obtain a static three-dimensional model scene that can establish a virtual reality mapping on the twin side. Configure and manage IoT communication information, convert and push the collected equipment and facility data to the equipment model in the digital geometric model scene, realize the rendering of twin data in the virtual-real mapping 3D model scene on the twin side, that is, realize the construction of a low-code digital twin platform.

2. The method for building a low-code digital twin platform according to claim 1, characterized in that, The process of importing the 3D model of the equipment and facilities on the management side includes the following steps: Create 3D models of equipment and facilities using 3ds Max or other 3D modeling software, and then upload the created 3D models to the management side.

3. The method for building a low-code digital twin platform according to claim 1, characterized in that, The process of obtaining a static 3D model scene capable of rendering twin data information on the twin side includes the following steps: Upload equipment information on the management side, including equipment type, equipment measurement points, equipment name, equipment attributes, equipment area, and static extended information of the equipment and facilities in the physical world. Upload camera information to the management side, including grouping information of devices and facilities in the physical world, camera name, streaming method, streaming template name, video stream IP, video stream port, video stream account, video stream password, channel information, transcoding compatibility, automatic shutdown settings, and static extended information. Equipment information and camera information are collectively referred to as the basic information and feature information of the equipment and facility 3D model; Based on the 3D model, basic information, and feature information of the equipment and facilities uploaded by the management side, a static 3D model scene carrying twin data information can be obtained and rendered on the twin side.

4. The method for building a low-code digital twin platform according to claim 1, characterized in that, Obtaining a static 3D model scene capable of establishing a virtual reality mapping on the twin side includes the following steps: The uploaded model is loaded and rendered on the management side to obtain a digital geometric model scene that matches the physical world; The physical coordinates of the equipment are obtained by measuring and drawing information, and the equipment model that matches the scene is selected from the digital geometric model scene to be displayed based on the physical coordinates. The twin data of equipment and facilities imported from the management side will be associated and mapped with the equipment models that match the selected scenes to obtain a static 3D model scene that can establish a virtual reality mapping on the twin side.

5. The method for building a low-code digital twin platform according to claim 1, characterized in that, The method for rendering twin data in a 3D scene with virtual-real mapping on the twin side includes the following steps: Utilize the built-in MQTT communication logic on the management side to configure the required communication information on the web page; Based on the configured communication information, the device data format is converted to the internal data format of the twin side through data conversion, so as to render the twin data in the 3D model scene of virtual-real mapping on the twin side.

6. A low-code digital twin platform construction device, characterized in that, include: The organizational structure module is used to create the digital twin platform architecture of the digital twin platform, which includes the management side that operates the physical entity model and the twin side that displays the scene of the physical entity digital twin model; The scene module is used to import 3D models of equipment and facilities on the management side; The twin module is used to import basic and feature information of the 3D model of equipment and facilities from the management side; The virtual-real mapping module is used to select the 3D equipment and facility models that need to be displayed in the scene based on the physical world point coordinates on the management side. It will associate and map the twin data of the equipment and facilities imported on the management side with the equipment and facility models to obtain a static 3D model scene that can establish a virtual reality mapping on the twin side. The twin data access module is used to configure IoT communication information on the management side and convert and push the collected equipment and facility data to the equipment model in the digital geometric model scene; The twin-side rendering module enables the rendering of twin data in a 3D model scene with virtual-real mapping on the twin side, thus realizing the construction of a low-code digital twin platform.

7. An electronic device, characterized in that, include: Memory and processor; The memory is used to store computer programs; When the processor executes the computer program stored in the memory, it implements the steps of the low-code digital twin platform construction method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, Used to store a computer program, which, when executed by a processor, implements the steps of a low-code digital twin platform construction method as described in any one of claims 1 to 5.

Images