Iot-driven three-dimensional digital twin implementation method, device and product, medium

Abstract

The application provides an Internet of Things driven three-dimensional digital twin implementation method, device and product, medium, which can realize the connection and interaction of the physical entity corresponding to the object model on each Internet of Things platform by means of the mapping of the three-dimensional component to the object model, the object model as the digital representation of the physical entity on the Internet of Things platform does not need to be additionally customized and developed, the implemented twin scene and the three-dimensional digital twin running in the twin scene also do not need to be realized by customized development, and the digital twin platform obtains cross-platform capability, thereby realizing the three-dimensional digital twin and the running of the three-dimensional digital twin in the twin scene on many Internet of Things platforms.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of digital twinning, in particular to an Internet of Things (IoT)-driven three-dimensional digital twinning implementation method, a computer device, a computer program product, and a computer-readable storage medium. BACKGROUND

[0002] With the development of digital twinning technology, various digital twinning platforms are being built in various industries and various scenarios in an attempt to achieve real-time monitoring, simulation, prediction, and optimization in the scene with the help of digital twinning platforms, and ultimately to greatly improve flexibility and response speed in the fields of industry, intelligent manufacturing, smart city, etc.

[0003] The digital twinning platform needs to be connected with the Internet of Things to learn about the running status and changes of various physical entities in the corresponding real environment. However, each industry and each scenario has its own Internet of Things platform, and the Internet of Things platform and the digital twinning platform are relatively fragmented. Therefore, for an existing Internet of Things platform in a scene, a customized development is often needed to build a corresponding digital twinning platform and a twinning scene in the digital twinning platform, and the twinning body of the digital twinning platform will run in the model in the twinning scene.

[0004] That is, for various Internet of Things platforms, especially many third-party Internet of Things platforms, the applicable twinning scene and the model in the twinning scene need to be customized respectively to realize the corresponding digital twinning application. The existing implementation of the digital twinning platform cannot be cross-platform connected with multiple Internet of Things platforms. SUMMARY

[0005] One object of the present application is to enable cross-platform implementation of three-dimensional digital twinning and its running in a twinning scene for many Internet of Things platforms, so that the constructed digital twinning platform has cross-platform capability.

[0006] According to one aspect of an embodiment of the present application, an IoT-driven three-dimensional digital twinning implementation method is disclosed, the method comprising:

[0007] For a twinning scene in a digital twinning platform, a three-dimensional component is associated with a thing model of an Internet of Things platform, the thing model being a digital representation of a corresponding physical entity on the Internet of Things platform, and the twinning scene being a scene in which the three-dimensional component is configured to run;

[0008] Definition information of the associated thing model is obtained as thing model information, and the thing model information is serialized and transmitted to the three-dimensional component;

[0009] binding the object model information to the three-dimensional component, obtaining a three-dimensional digital twin driven by the Internet of Things platform where the object model is located, the three-dimensional digital twin being created with an executable behavior set and business logic;

[0010] running the three-dimensional digital twin in the twin scene, the three-dimensional digital twin running in the twin scene triggering the business logic and / or behavior set created by itself driven by real-time data of the Internet of Things platform.

[0011] According to an aspect of the embodiments of the present application, a computer device is disclosed, comprising a memory, a processor and a computer program stored in the memory, the processor executing the computer program to implement the steps of the method as described above.

[0012] According to an aspect of the embodiments of the present application, a computer program product is disclosed, comprising a computer program, the computer program being executed by a processor to implement the steps of the method as described above.

[0013] According to an aspect of the embodiments of the present application, a computer readable storage medium is disclosed, having a computer program stored thereon, the program being executed by a processor to implement the steps of the method as described above.

[0014] In the embodiments of the present application, for the twin scene of the digital twin platform, a three-dimensional digital twin running thereon is constructed to finally add a three-dimensional digital twin to the twin scene. Firstly, a corresponding three-dimensional component is associated with an object model of the Internet of Things platform. Under the action of the associated object model, a digital representation of the corresponding physical entity of the three-dimensional component on the Internet of Things platform can be obtained. After an object model is associated with an Internet of Things platform, the definition information of the object model is obtained as object model information. After the object model information is serialized, it is transmitted to the three-dimensional component. The object model information transmitted to the three-dimensional component is bound to the three-dimensional component. After the three-dimensional component is bound to the object model information, an executable behavior set and business logic, a three-dimensional digital twin can be obtained. The three-dimensional digital twin runs in the twin scene and is driven by real-time data of the Internet of Things platform to trigger its business logic and / or behavior set. In this way, for each Internet of Things platform, the connection and interaction of the physical entity corresponding to the object model on the platform can be realized by mapping the three-dimensional component to the object model. The object model as the digital representation of the physical entity on the Internet of Things platform does not need to be additionally customized and developed. The twin scene and the three-dimensional digital twin running in the twin scene do not need to be realized by customized development. The digital twin platform obtains the cross-platform capability, and further realizes the three-dimensional digital twin and its running in the twin scene across platforms.

[0015] Other features and advantages of the present application will become apparent from the following detailed description, or will be learned by practice of the present application.

[0016] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application, as claimed. BRIEF DESCRIPTION OF DRAWINGS

[0017] These and other objects, features and advantages of the present application will become apparent with reference to the examples of embodiments thereof illustrated in the accompanying drawings.

[0018] Figure 1 is a flow chart of the method of implementing an Internet of Things driven three-dimensional digital twin according to an example embodiment of the present application.

[0019] Figure 2 is a flow chart of the method of selecting a three-dimensional component of a digital twin scene from all the physical models defined by the Internet of Things platform according to Figure 1 the corresponding embodiment.

[0020] Figure 3 is a flow chart of the method of selecting a three-dimensional component of a digital twin scene from all the physical models defined by the Internet of Things platform according to Figure 2 the corresponding embodiment.

[0021] Figure 4 is a flow chart of the method of selecting a three-dimensional component of a digital twin scene from all the physical models defined by the Internet of Things platform according to Figure 2 the corresponding embodiment.

[0022] Figure 5 is a flow chart of the method of selecting a three-dimensional component of a digital twin scene from all the physical models defined by the Internet of Things platform according to Figure 1 the corresponding embodiment.

[0023] Figure 6 is a flow chart of the method of selecting a three-dimensional component of a digital twin scene from all the physical models defined by the Internet of Things platform according to the corresponding embodiment.

[0024] Figure 7 is a flow chart of the method of selecting a three-dimensional component of a digital twin scene from all the physical models defined by the Internet of Things platform according to Figure 6 the corresponding embodiment.

[0025] Figure 8 is a flow chart of the method of selecting a three-dimensional component of a digital twin scene from all the physical models defined by the Internet of Things platform according to Figure 7 the corresponding embodiment. DETAILED DESCRIPTION

[0026] Example implementations are now described with reference to the drawings. Example implementations can, however, be implemented in many different forms and should not be construed as limited to the examples set forth herein; rather, these example implementations are provided so that this disclosure will be thorough and complete, and will fully convey the inventive aspects to those skilled in the art. The drawings described herein are schematic and are not intended to be to scale with one another. The same reference numbers in different drawings identify the same or similar components.

[0027] Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more example implementations. In the following description, numerous specific details are provided to give a thorough understanding of example implementations. One skilled in the relevant art will recognize, however, that the

[0028] Some of the block diagrams in the drawings are functional entities that do not necessarily correspond to physically or logically separate entities. These functional entities can be implemented in software, or in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0029] The embodiments of the present application build a digital twin platform, and various twin scenarios are constructed according to various twin needs. Both the digital twin platform and the constructed twin scenarios have cross-platform capabilities, and can realize three-dimensional digital twins for physical entities of at least one Internet of Things platform.

[0030] It should be noted that the Internet of Things platforms are independent of each other, have no interaction, and are customized without unified standards. Therefore, in existing implementations, only a single Internet of Things platform can be adapted to realize a specific twin need, and it is difficult to quickly realize a twin scenario and a three-dimensional digital twin body running in the twin scenario for multiple Internet of Things platforms.

[0031] For example, in the field of intelligent manufacturing, an Internet of Things platform is built for a factory, and a dedicated digital twin platform is developed for monitoring and optimizing the production process. However, the digital twin platform cannot be applied to the Internet of Things platform of a smart city. If the digital twin platform needs to be connected to the Internet of Things platform of the smart city, a large amount of cost needs to be spent to solve the linkage relationship between the Internet of Things platform and the digital twin platform, including but not limited to data mapping, behavior mapping, and the like.

[0032] Limited to this, the implementation threshold of digital twin and digital twin scene is very high, and is limited to a single Internet of Things platform. Access of other Internet of Things platforms will result in the need for re-development, and even cannot realize the synchronous access of multiple Internet of Things platforms in a digital twin platform, a twin scene.

[0033] And the three-dimensional digital twin and the twin scene running thereby realized on the digital twin platform based on the present application will not be limited to a single Internet of Things platform, and can build a three-dimensional digital twin for a twin scene and run across platforms.

[0034] Referring to Figure 1 , Figure 1 is a flowchart of an Internet of Things driven three-dimensional digital twin implementation method according to an exemplary embodiment of the present application.

[0035] The Internet of Things driven three-dimensional digital twin implementation method provided by the embodiments of the present application comprises:

[0036] Step S110, for a twin scene in a digital twin platform, associating a three-dimensional component with a thing model of an Internet of Things platform, the thing model being a digital representation of a physical entity on the Internet of Things platform, and the twin scene being a scene in which the three-dimensional component is configured and run;

[0037] Step S120, obtaining definition information of the associated thing model as thing model information, serializing the thing model information and transmitting it into the three-dimensional component;

[0038] Step S130, binding the thing model information to the three-dimensional component, obtaining a three-dimensional digital twin driven by the Internet of Things platform where the thing model is located, the three-dimensional digital twin being created with an executable behavior set and business logic;

[0039] Step S140, running the three-dimensional digital twin in the twin scene, the three-dimensional digital twin running in the twin scene being driven by real-time data of the Internet of Things platform to trigger the business logic and / or behavior set created by itself.

[0040] The steps will be described in detail below.

[0041] First of all, it should be pointed out that the digital twin platform is used to create, manage and maintain three-dimensional digital twins, and provides at least one specific application environment, i.e. a twin scene. The three-dimensional digital twin runs as a twin instance in the twin scene, thereby being driven by at least one Internet of Things platform accessed to trigger corresponding events and / or business logic.

[0042] The digital twin platform implemented in the present application accesses at least one Internet of Things platform, so that the constructed twin scene can access at least one Internet of Things platform, so that the multiple twin entities in the twin scene can correspond to different Internet of Things platforms respectively, and then run under the driving of at least one Internet of Things platform.

[0043] In step S110, the digital twin platform can create a twin scene, which will be adapted to at least one Internet of Things platform, and then trigger corresponding events or business processes in the twin scene in response to the dynamic changes of the physical entities accessed by the Internet of Things platform.

[0044] The digital twin platform creates a twin scene across the Internet of Things platform and adds a three-dimensional digital twin to the created twin scene, that is, in the process of adding a three-dimensional digital twin, first determine the three-dimensional components used to create the three-dimensional digital twin. The three-dimensional component is the core component of building a three-dimensional digital twin, and is the carrier of the geometric properties, behaviors, data properties and other contents of the created three-dimensional digital twin.

[0045] Further explanation, the three-dimensional component is an independent unit in the digital twin platform system, which can form a unit capable of independently executing specific business processes, tasks or functions by giving geometric properties, behaviors, data properties and other contents. The three-dimensional component has input and output, and can interact with other components, such as other three-dimensional components.

[0046] The three-dimensional component carrying geometric properties, behaviors, data properties and other contents constitutes a three-dimensional digital twin, which can perceive the state changes of the physical entities bound by the Internet of Things platform in the twin scene it runs in, and drive itself to trigger specific business processes or events.

[0047] Therefore, it should be pointed out that the three-dimensional component as a carrier is a reusable unit, which can be reused in different twin scenes, so that the digital twin platform can quickly integrate, modify and adjust the required three-dimensional digital twin in multiple twin scenes, has the advantages of high universality, flexibility and strong scalability, and significantly reduces the development cost for the construction and operation of the twin scene.

[0048] For the selected three-dimensional component used to create the three-dimensional digital twin, it needs to achieve its binding to the physical entity of the Internet of Things platform. In order to adapt to the physical entity of the Internet of Things platform, the three-dimensional component is associated with the object model representing the physical entity, and then the mapping between the object model and the physical entity is realized to realize the binding between the three-dimensional component and the physical entity.

[0049] The physical entity can be a sensor on an Internet of Things platform, and the sensor is digitized to obtain a corresponding thing model. A three-dimensional digital twin of the sensor is constructed on the digital twin platform using a three-dimensional component as a carrier. At this time, the three-dimensional component is associated with the corresponding thing model selected from the Internet of Things platform to create a three-dimensional digital twin of the physical entity corresponding to the thing model in the twin scene through step S110.

[0050] In the creation of a twin scene and the creation and addition of a three-dimensional digital twin in a twin scene, step S110 is performed to associate the three-dimensional component of the three-dimensional digital twin to be configured with the physical entity on the Internet of Things platform, realize the association of the twin scene with at least one physical entity in at least one Internet of Things platform, and drive the twin scene by the Internet of Things platform through the association, and enable the built twin scene to quickly access at least one Internet of Things platform, and no longer be limited to a single Internet of Things platform.

[0051] The twin scene is a scene in which the three-dimensional component is configured and run. That is, the twin scene is a scene into which the three-dimensional digital twin created by the three-dimensional component is put. The twin scene corresponds to a physical scene constructed by the physical entity in at least one Internet of Things platform, and the twin scene is a digital expression of the physical scene.

[0052] With the configuration and running of several three-dimensional components, the twin scene is composed of multiple three-dimensional digital twins, and the multiple three-dimensional digital twins will self-drive interaction and cooperation in the twin scene to realize the running of the twin scene.

[0053] In an exemplary embodiment, the digital twin platform selects a thing model for a three-dimensional component of a twin scene from all thing models defined by an Internet of Things platform through an interface of the Internet of Things platform, and then associates the selected thing model with the three-dimensional component.

[0054] For example, all thing models defined by an Internet of Things platform are provided to a digital twin platform in the form of a list of all thing models for selection of a thing model for association with a three-dimensional component.

[0055] In addition, a thing model for association with a three-dimensional component can also be obtained from an Internet of Things platform by querying a keyword.

[0056] In summary, in the execution of step S110, the associated thing model is determined from the Internet of Things platform by list selection or keyword query, and the associated physical entity is determined in this way.

[0057] Before configuring the three-dimensional components for the twin scene and associating the physical models, the twin scene will also request the associated physical models from at least one Internet of Things platform through the initiated request. Specifically, before step S110, the present application will also perform: for the three-dimensional component configuration in the twin scene, initiating a physical model association request for the twin scene to at least one Internet of Things platform, and the physical model association request for the twin scene is used to initiate the physical model association on the requested Internet of Things platform for at least one three-dimensional component configured for the twin scene.

[0058] That is, for the digital twin platform, it configures three-dimensional components for creating three-dimensional digital twins for the constructed twin scene, and for this three-dimensional component, it will initiate a physical model association request to the Internet of Things platform for requesting to associate the physical model of the corresponding physical entity, and different three-dimensional components may not be the same Internet of Things platform requested, that is, the construction of the twin scene across the Internet of Things platform, and then driven by each Internet of Things platform to run the three-dimensional digital twin in the twin scene.

[0059] Also see Figure 2 , Figure 2 According to Figure 1 The method flowchart for describing the steps of associating the three-dimensional components of the twin scene in the digital twin platform to the physical model of the Internet of Things platform is shown according to the corresponding embodiment.

[0060] The step S110 provided by the present application for associating the three-dimensional components of the twin scene in the digital twin platform to the physical model of the Internet of Things platform includes:

[0061] Step S111, the digital twin platform selects physical models for the three-dimensional components of the twin scene from all physical models defined by the Internet of Things platform through the interface of the Internet of Things platform;

[0062] Step S112, associate the selected all physical models with the three-dimensional components.

[0063] The two steps are described in detail below.

[0064] It should be pointed out that each Internet of Things platform digitizes the physical entities deployed by it, i.e. various sensors to obtain their respective physical models, and the Internet of Things platform also interacts with the digital twin platform through the exposed interface, so that the digital twin platform can initiate operations such as query and list acquisition to the digital twin platform by calling the interface.

[0065] The physical entities deployed by the IoT platform are configured with a digital representation of a thing model, which defines the attributes, services, and even events of the corresponding physical object, i.e., the physical entity, and further describes the physical entity in a static and / or dynamic manner. For example, the static description of the thing model refers to the definition of the physical entity by various dimensional attributes, and the dynamic description of the physical entity refers to the services or events defined by the thing model, such as the services that can be executed by the physical entity or the events that can trigger the abnormal or specific state of the physical entity.

[0066] The attributes, services, and events obtained by digitizing the physical entity are serialized to form a thing model and stored in the IoT platform where the physical entity is located. That is, each physical entity has a corresponding thing model in the IoT platform where it is located.

[0067] Therefore, in the execution of step S111, the thing model selected for the three-dimensional component of the twin scene can be obtained from all the thing models defined by the IoT platform through the interface of the IoT platform, and the digital twin platform associates the obtained thing model with the three-dimensional component, thereby determining the corresponding physical entity for the current three-dimensional digital twin.

[0068] Please refer to Figure 3 , Figure 3 According to the corresponding embodiments Figure 2 The method flowchart describes the step of selecting a thing model for a three-dimensional component of a twin scene from all thing models defined by an IoT platform through an interface of the digital twin platform.

[0069] The step S111 of selecting a thing model for a three-dimensional component of a twin scene from all thing models defined by an IoT platform through an interface of the digital twin platform provided by the embodiments of the present application includes:

[0070] In step S1111a, the digital twin platform obtains a list of all thing models defined by the three-dimensional component running in the twin scene through the interface of the IoT platform.

[0071] In step S1112a, the selected thing model for the three-dimensional component is determined by the triggered thing model selection in the list of all thing models.

[0072] This step will be described in detail below.

[0073] In step S1111a, the list of all thing models defined by the IoT platform is obtained through the interface of the IoT platform, i.e., the list of all thing models, and then the selected thing model for the three-dimensional component can be obtained by the triggered thing model selection operation on the list of all thing models in the execution of step S1112a.

[0074] Therefore, for the creation of a three-dimensional digital twin, the binding of the physical entity on the digital twin platform can be realized, under the action of the object model digitally describing the physical entity, the differences between the various Internet of Things platforms can not be considered, and the association of the twin of the physical entity under the Internet of Things platform can be realized under the action of the object model, which greatly enhances the compatibility of the various Internet of Things platforms.

[0075] Please also refer to Figure 4 , Figure 4 is according to Figure 2 The method flowchart shown in the corresponding embodiment describes the step of selecting an object model for a three-dimensional component of a twin scene from all object models defined by an Internet of Things platform by an interface of a digital twin platform.

[0076] The step S111 of selecting an object model for a three-dimensional component of a twin scene from all object models defined by an Internet of Things platform by an interface of a digital twin platform provided by the embodiments of the present application comprises:

[0077] Step S1111b, obtaining a keyword through the configuration of the three-dimensional component of the digital twin platform;

[0078] Step S1112b, initiating an object model query to the Internet of Things platform according to the keyword of the three-dimensional component, and determining the selected object model for the three-dimensional component through the keyword query.

[0079] The two steps will be described in detail below.

[0080] For the creation of a three-dimensional digital twin, the configuration of a three-dimensional component on a digital twin platform will be performed, and with the configuration of the three-dimensional component, the keyword of the physical entity bound to the three-dimensional component will be obtained. As previously pointed out, the three-dimensional component can be reused, so in the process of creating a three-dimensional digital twin with the currently available three-dimensional component as the carrier, the three-dimensional component is first obtained, and based on the physical entity it is about to bind, the keyword corresponding to the physical entity is obtained for querying the object model of the physical entity.

[0081] Illustratively, for the object models stored by each Internet of Things platform, the digital twin platform will initiate a query operation to query the object model corresponding to the keyword, and then associate the queried object model with the currently configured three-dimensional component.

[0082] After selecting an object model for a three-dimensional component, for the digital twin platform, on the one hand, the object model is associated with the Internet of Things platform, i.e. the Internet of Things platform will build an association relationship between the object model and the three-dimensional component. However, it should be understood that the physical entity on the Internet of Things platform, such as a sensor, can interact with at least one three-dimensional twin in at least one twin scene, so the corresponding object model can have an association relationship with at least one three-dimensional component.

[0083] In another aspect, the digital twin platform also constructs the association between the three-dimensional component and the selected thing model, so as to trigger the corresponding business process or event driven by the physical entity of the associated thing model.

[0084] After the execution of step S110, the digital twin platform associates the three-dimensional component with the thing model, and then in the execution of step S120, the digital twin platform obtains the definition information of the associated thing model as the thing model information.

[0085] As described above, the thing model is described by the definition of attributes, services, and events, and therefore the associated thing model in step S120 will obtain its definition information as the thing model information.

[0086] For example, the thing model exists in the form of definition information and is stored in the Internet of Things platform. Each physical entity deployed will be adapted to its attributes, services, and events to construct the thing model, and the definition information of its attributes, services, and events is the form of existence of the thing model, as the thing model information.

[0087] In step S120, the definition information of the associated thing model is obtained as the thing model information, and the thing model information is serialized and transmitted into the three-dimensional component. The three-dimensional component carries the thing model information as a carrier, so as to obtain the three-dimensional digital twin corresponding to the physical entity in the Internet of Things platform.

[0088] After the digital twin platform obtains the thing model information, it serializes the thing model information. For example, the serialization of the thing model information can be the process of converting the thing model information into JSON data format.

[0089] For example, the acquisition of the definition information of the associated thing model will not be limited to the acquisition of the definition information of the attributes, services, and events of the corresponding physical entity from the Internet of Things platform, but also based on the digital twin platform to acquire other definition information, such as the definition information of the geometric model of the corresponding physical entity.

[0090] At this point, for the geometric model, it should be noted that the geometric model is a parameterized three-dimensional model based on points, lines, surfaces, materials, and textures, rather than an image form model. The geometric model is expressed by a function, and therefore the function used to represent the geometric model will be the definition information of the geometric attribute of the thing model, forming the thing model information.

[0091] In addition, the executable behavior set and business logic created by the digital twin platform for the three-dimensional digital twin platform will also be the definition of the services and events of the thing model, and will be part of the thing model information.

[0092] Therefore, the object model information is obtained based on the object model and the physical entity corresponding to the object model, and is transmitted to the associated three-dimensional component. The object model information is bound to the three-dimensional component under the action of step S130 to obtain a three-dimensional digital twin encapsulating attributes, services and events.

[0093] Also please refer to Figure 5 , Figure 5 is according to Figure 1 The method flowchart is shown in the corresponding embodiment to describe the step of obtaining the definition information of the associated object model as the object model information and serializing the object model information.

[0094] The step S120 provided by the embodiment of the present application to obtain the definition information of the associated object model as the object model information and serialize the object model information includes:

[0095] In step S121, the attributes, services and events defined by the associated object model are obtained from the Internet of Things platform to obtain the definition information of the object model.

[0096] In step S122, the definition information is encapsulated to obtain the object model information of the three-dimensional component running in the scene.

[0097] In step S123, the object model information is serialized to obtain the serialized object model information transmitted to the associated three-dimensional component.

[0098] The step is described in detail below.

[0099] In step S121, the attributes, services and events of the physical entity corresponding to the object model are described, that is, the definition information of the object model is constituted. The object model information of the three-dimensional component running in the scene is obtained by encapsulating the definition information in step S122.

[0100] At this point, it should be noted that the scene referred to is the twin scene to which the three-dimensional digital twin created by the three-dimensional component is to be added.

[0101] The object model information is converted according to a specified data format, such as the JSON data format. The obtained JSON data is transmitted to the three-dimensional component as the existing form of the object model information.

[0102] With the transmission of the object model information, the object model information is bound to the three-dimensional component in the execution of step S130, so that the three-dimensional digital twin driven by the Internet of Things platform where the object model is located can be obtained.

[0103] In step S130, the binding of the physical model information to the three-dimensional component is achieved by constructing the binding relationship between the physical model information and the three-dimensional component. Exemplarily, the three-dimensional component has its corresponding identification information, and therefore the identification information created for the three-dimensional component, such as the component identification or even the twin identification, is not limited herein as long as it can uniquely identify the currently configured three-dimensional component.

[0104] The three-dimensional component with the bound physical model information is obtained by constructing the binding relationship between the identification information and the physical model information, that is, the binding of the physical model information to the three-dimensional component is achieved.

[0105] After the binding of the physical model information to the associated three-dimensional component, the three-dimensional component is further configured with an executable behavior set and a business logic to obtain a three-dimensional digital twin driven by the physical model and the Internet of Things platform where the physical model is located, and the three-dimensional digital twin instance runs in the twin scene.

[0106] So far, through the binding of the physical model information to the three-dimensional component, the three-dimensional component can be endowed with various definition information carried by the physical model information. As mentioned above, the definition information is a digital expression of the corresponding physical entity deployed on the Internet of Things platform, and therefore it will also become a digital expression of the created three-dimensional digital twin, and further achieve consistency between the created three-dimensional digital twin and the corresponding physical entity, so as to adapt to any Internet of Things platform to realize three-dimensional digital twin for any physical entity. The three-dimensional digital twin creation process can be performed for any Internet of Things platform without being limited by the differences between Internet of Things platforms.

[0107] In summary, the execution process of step S130 can include: first obtaining the identification information created for the three-dimensional component, then constructing the binding relationship between the identification information and the physical model information, obtaining the three-dimensional component with the bound physical model information, and finally configuring the three-dimensional component with the bound physical model information with an executable behavior set and a business logic to obtain a three-dimensional digital twin driven by the physical model and the Internet of Things platform where the physical model is located, and the three-dimensional digital twin as a twin instance runs in the twin scene.

[0108] The executable behavior set configured for the three-dimensional component is used to reproduce the behavior performance of the corresponding physical entity in the twin scene, and therefore in an exemplary embodiment, the executable behavior set can be in the form of a skeletal animation and perform the indicated behavior such as movement in response to the real-time data feedback of the corresponding physical entity.

[0109] The configuration of the behavior set will be adapted to the corresponding physical entity. The business logic configured for the three-dimensional component is adapted to the business process to which the physical entity is mapped, that is, the triggering of the business process will initiate the execution of the corresponding business logic.

[0110] The created three-dimensional digital twin will be added to the corresponding twin scene, and then run in the twin scene driven by the Internet of Things platform. Among them, the three-dimensional digital twin running in the twin scene is a specific and running instance, so the three-dimensional digital twin actually exists in the form of a three-dimensional digital twin instance.

[0111] By analogy, for the constructed and running twin scene, three-dimensional digital twins can be created for many Internet of Things platforms. Each time the three-dimensional digital twin is created, the execution process can create a three-dimensional digital twin for any physical entity deployed by the Internet of Things platform under the action of three-dimensional components and object models, and then there is no need for customized development for the Internet of Things platform. The digital twin platform and each Internet of Things platform are no longer in a fragmented state, and even the running of the twin scene across the Internet of Things platform is realized.

[0112] With the execution of steps S110 to S130, at least one three-dimensional digital twin will be created for the twin scene. The created three-dimensional digital twin is added to the twin scene, and the three-dimensional digital twin is run in the twin scene.

[0113] The creation and addition of various three-dimensional digital twins, as shown in step S140, enable the twin scene to be driven by the Internet of Things platform to run the corresponding three-dimensional digital twin instance.

[0114] In step S140, with the addition of the obtained three-dimensional data twin to the twin scene, and the interaction of the three-dimensional digital twin with the Internet of Things platform, the three-dimensional digital twin as an instance, i.e. the three-dimensional digital twin instance, runs in the twin scene and is controlled by the Internet of Things platform. Real-time data drives the corresponding business logic and / or behavior set.

[0115] Among them, real-time data includes runtime data and business data of the three-dimensional digital twin corresponding physical entity. The three-dimensional digital twin is driven by the real-time data of the Internet of Things platform to trigger the business logic and / or behavior set created by itself. The three-dimensional digital twin running in the twin scene will synchronize the real-time data with the corresponding physical entity deployed in the Internet of Things platform to obtain the runtime data of the physical entity.

[0116] For example, the runtime data can include the state of the physical entity, sensor data, operating parameters, etc., which describe the current state and performance indicators of the physical entity. The business data is data received by the three-dimensional digital twin during operation from the outside, such as the Internet of Things platform, other three-dimensional digital twins, which can drive its behavior, update its state and / or trigger business processes, which is not limited here.

[0117] In the twin scene, the running process of the three-dimensional data twin body, on the one hand, synchronizes the runtime data of the corresponding physical entity, and triggers its own business process or event in response to the synchronized runtime data; on the other hand, it also publishes messages along with its own running, and then cooperates with other three-dimensional digital twins to respond to messages to run its own business logic.

[0118] In an exemplary embodiment, the execution process of step S140 includes: the three-dimensional digital twin triggers its own defined event and / or calls the corresponding business process in response to the state change of the physical entity under the control of the real-time data of the Internet of Things platform in the twin scene, and the business process is controlled by the running of the physical entity; then according to the scheduled business process, the corresponding business logic is executed, and the execution of at least one task or operation is initiated through the execution of the business logic.

[0119] With the creation of the three-dimensional digital twin facing the Internet of Things platform, the three-dimensional digital twin as an instance of a twin scene is controlled by real-time data of the Internet of Things platform, such as runtime data of the corresponding physical entity, to trigger defined events or business processes during the running process.

[0120] For example, the three-dimensional digital twin listens to data and events through the digital twin platform where it is located. With the synchronization of real-time data, such as runtime data generated by the running of the physical entity, the real-time data of the physical model will be synchronized to the three-dimensional digital twin. After the three-dimensional digital twin listens to the data through the digital twin platform, it will serialize the data through the digital twin platform to convert all data consistently, so that the three-dimensional digital twin can obtain serialized data, such as JSON data, so that data in many formats of different Internet of Things platforms can be applied by the digital twin platform and the three-dimensional digital twin in the twin scene, without being limited by the differences and incompatibilities of various Internet of Things platforms.

[0121] That is, for the three-dimensional digital twin created for each twin scene, the three-dimensional digital twin will realize the acquisition, listening, message publishing, and event publishing of real-time data in the Internet of Things platform through the architecture built by the digital twin platform.

[0122] In other words, the real-time data acquisition, listening, message publishing, and event publishing performed by the three-dimensional digital twin are decoupled from the three-dimensional digital twin, which ensures the reliability and stability of the operation of multiple three-dimensional digital twins, while also enhancing the lightweight performance of the three-dimensional digital twin, making the construction of the three-dimensional digital twin simpler and faster.

[0123] Thus, the digital twin platform compares the created JSON data to confirm whether there is a change in the same data compared with the last synchronized data. If there is no change, no processing is performed, and the data listening continues. In an example embodiment, after confirming that the data has changed, the front-end display of the corresponding three-dimensional digital twin is controlled to perform corresponding updates in response to the change, such as updates to the corresponding parameterized three-dimensional model.

[0124] In another example embodiment, for the existing change, it is necessary to determine whether to trigger a certain business process or event, and then call the corresponding business process or trigger the event when needed.

[0125] The triggered business process calls will trigger, execute and / or call certain tasks or business logic, so that the three-dimensional digital twin triggered business process can be executed. The triggered event will also initiate the execution of the corresponding operation. Whether it is a business process call or an event trigger, an event message can be sent at a specific time at a specific link, and other three-dimensional digital twins will listen to the event message during their own operation through the digital twin platform and respond to the relevant event message to handle their own business logic.

[0126] Further explanation, the event message issued by the three-dimensional digital twin, i.e. the event publishing performed, will be implemented through the event bus under the control of the digital twin platform. The three-dimensional digital twin publishes events to the event bus, which goes through a series of execution processes such as event filtering, matching and conversion, and finally delivers to the target three-dimensional digital twin. The target three-dimensional digital twin will listen to and trigger the event, so that the three-dimensional digital twin driven by the Internet of Things platform can run autonomously, greatly enhancing the reliability and accuracy of the twin scene operation.

[0127] For example, as data synchronization and message listening are performed, calculations will also be performed on the parameters carried to determine whether to call the corresponding behavior set, such as the aforementioned skeletal animation and model animation, for front-end display.

[0128] And under the effect of the implemented three-dimensional digital twin, especially the geometric properties carried by the three-dimensional digital twin, i.e. the parameterized three-dimensional model, the front-end display will be accurately presented to the physical scene mapped across the Internet of Things platform and the dynamic physical entities under the physical scene, so that the display performed for the real environment is no longer a simple indication, and very high accuracy can be obtained in terms of timeliness and content.

[0129] Exemplarily, along with the receiving of the real-time data, the digital twin platform will also match the business process according to the obtained real-time data, especially the runtime data in the real-time data, obtain the process key, i.e. the process key, of the matched business process; at this time, the obtained process key is transmitted into the configured workflow scheduler, and the running of the business process is initiated to the process engine component under the initiation of the workflow scheduler, so that the corresponding business logic is executed. It should be understood that, at this time, under the action of the digital twin platform, the workflow scheduler and the process engine component configured by the digital twin platform, the runtime data required to initiate the business process can be timely and accurately called, and the situation that the business process is missed or discarded will not occur, thereby ensuring the reliable and accurate operation of the twin scene.

[0130] Along with the running of the business process, the publishing of the process message will be triggered when running to a specific process node.

[0131] The running of each three-dimensional digital twin in the twin scene may bring about the publishing of the process message. Therefore, for the published many messages, including the process message and the event message, the digital twin platform will adopt the asynchronous message listening and processing mode to improve the system performance of the twin scene, obtain high concurrency capability, and avoid the resource blocking that may be caused. The publishing and processing of the message are decoupled from the three-dimensional digital twin, which will greatly improve the scalability and reliability of the digital twin and the twin scene.

[0132] It is further illustrated that the published message will find the corresponding three-dimensional digital twin through the carried parameters, so that the corresponding three-dimensional digital twin can call the corresponding business process in response to the message and execute the corresponding business logic.

[0133] Therefore, the execution of step S140 also includes that the running three-dimensional digital twin publishes its own event message and listens to the event message published by other three-dimensional digital twins; when the event message published by other three-dimensional digital twins is listened to, the corresponding business logic is executed in response to the event message.

[0134] Therefore, the three-dimensional digital twins running in the twin scene can be made to cooperate with each other, and when the running state of a three-dimensional digital twin changes, the related other three-dimensional digital twins will also be linked, triggering the corresponding business process.

[0135] At this time, a specific example will be combined to illustrate the three-dimensional digital twin driven by the Internet of Things and the running process thereof realized by the present application.

[0136] Figure 6 The architecture schematic diagram of the digital twin platform and the third-party Internet of Things platform of one embodiment of the present application is shown.

[0137] It should be understood that the digital twin platform can not only interact with the custom-developed Internet of Things platform, but also can realize the construction and operation of the twin scene with other third-party Internet of Things platforms, that is, the twin scene runs across platforms.

[0138] Firstly, in the digital twin platform, the three-dimensional component is endowed with its geometric properties, data properties, and behaviors, etc., wherein the geometric properties are the form of the three-dimensional component, that is, the geometric model exists in the form of a parameterized three-dimensional model; the behaviors are defined and realized through the created skeletal animation, motion path, and business process; the data properties can include physical properties, specification properties, and running state data, such as physical data indicating the physical characteristics of the corresponding physical entity, which can be stainless steel, transparent glass, organic glass, specification properties indicating the specifications of the corresponding physical entity, such as maximum voltage and maximum power; running state data is data, state and behavior generated during operation, which can include error codes, running states and logs, etc., which are not listed one by one; in addition, the attributes, services and events of the physical model are also endowed through the synchronization of the attributes, services and events defined by the physical model.

[0139] It should be noted that since the geometric properties of the three-dimensional component are parameterized three-dimensional models, that is, the parameterized modeling is obtained in the form of a function, that is, the constructed parameterized three-dimensional model is represented based on the functions of points, lines, and surfaces.

[0140] It is precisely because of the model support provided by the parameterized three-dimensional model that it can be driven by the Internet of Things platform or other three-dimensional digital twin bodies to precisely act on a basic unit such as a surface, a line, etc. to trigger corresponding business processes and events, rather than acting on the entire model, greatly enhancing the accuracy of operation, and making the operation of the three-dimensional digital twin body more detailed and accurate with the help of the parameterized three-dimensional model.

[0141] The existing implemented models are mostly based on images, such as various static images, dynamic images, and even video streams, and this type of model does not fine to points, lines, and surfaces, nor does it have such ability, therefore, the response that can be implemented is limited to the model of the entire physical entity, and cannot respond to each part of the model.

[0142] For example, a constructed twin scene will be used to present the operation of a vehicle at a crossroads, at this time, in the existing implementation, the model of each vehicle is constructed based on images, and the created business processes and events are all acting on the vehicle as a whole.

[0143] The geometric properties obtained through parametric modeling are applied to the 3D digital twins constructed from 3D components. These twins can correspond to the entire vehicle as a whole, as well as each part of the vehicle, such as tires and bearings. This allows for the creation of their own business processes and events, which are driven by the IoT platform and other 3D digital twins, thus achieving precise response in the twin scenario.

[0144] The digital twin platform, through synchronization with a third-party IoT platform, enables 3D components to be associated with the object model on the third-party IoT platform. This allows the object model's attribute definitions, state definitions, condition judgment rules, and other definition information of the corresponding physical entity in the real environment to be synchronized to the 3D component, so that the 3D digital twin created by the 3D component is endowed with the synchronized object model information.

[0145] This allows for the creation of three-dimensional digital twins of physical entities deployed on IoT platforms, such as the aforementioned physical entities, and their addition to the twin scene.

[0146] Real-time data generated by the operation of the third-party IoT platform will be synchronized to the 3D digital twin to drive its operation.

[0147] To further explain, a mapping relationship is established between the created 3D digital twin and the object model based on the interaction between the digital twin platform and the third-party IoT platform.

[0148] Please also see Figure 7 , Figure 7 Is Figure 6 A schematic diagram illustrating the mapping relationship between the digital twin and the object model fields constructed under the architecture of the corresponding embodiment.

[0149] As mentioned above, the object model exists in the form of its various definition information, that is, each object model field constitutes a definition information of the object model.

[0150] Therefore, the definitions of attributes, services, and events made by the object model will be synchronized to the created 3D digital twin. The services defined by the object model are implemented in the twin scene through the business processes of the 3D digital twin. The events defined by the object model can be implemented by the behavior of the 3D digital twin, that is, the assigned skeletal animation, motion path, and business processes. The attributes defined by the physical model are synchronized to the geometric and data attributes of the 3D digital twin. The object model itself corresponds to a physical entity deployed on the IoT platform.

[0151] It should be clear that the skeleton animation defines various actions of the physical entity to reproduce in the twin scene, such as opening and closing of the gate of the gate machine, transfer of the fan, up and down movement of the elevator, etc. The skeleton animation is essentially a form of existence of the behavior set created by the three-dimensional digital twin.

[0152] The motion path is used to indicate the change of position, for example, to realize the motion of the forklift, etc. Exemplarily, the motion path can be a pre-set fixed path, or can be driven by the position change indicated in the real-time data, which is not limited here.

[0153] The digital twin platform is the twin scene that needs to be built at present. It can obtain a list of all things models defined by the Internet of Things platform through the interface of the third-party Internet of Things platform, that is, the aforementioned list of all things models, or select the thing model associated with the three-dimensional component according to the keyword or custom filtering method, to associate the three-dimensional component and the thing model, and then synchronize the thing model information of the thing model.

[0154] Specifically, all definition information of the thing model will express the thing model information in the form of JSON, and be transmitted into the three-dimensional component for storage.

[0155] As shown in Figure 8 , the Figure 8 is a simple schematic diagram of the digital twin data mapping process performed by the mapping relationship shown in Figure 7 .

[0156] That is, by querying all things models, a model is selected for the currently configured three-dimensional component, and then all attribute definitions of the thing model are obtained. The JSON data format is created to reflect the attribute definition, and the thing model information in the JSON data format is transmitted into the three-dimensional component to bind the corresponding identification information, such as model ID.

[0157] The created three-dimensional digital twin is added to the twin scene as an instance, that is, the three-dimensional digital twin instance runs. At this time, in the running twin scene, the three-dimensional digital twin will listen to the real-time data of the third-party Internet of Things platform through the interface, such as the runtime data transmitted by the physical entity.

[0158] The received real-time data will be first converted into a specific data format to avoid the situation that the three-dimensional digital twin cannot read the received real-time data. Exemplarily, the specific data format can also be the JSON data format.

[0159] The received real-time data is converted into a JSON digital string, and then the data in the JSON digital string is checked. For example, if a change occurs, an event or a business process is triggered according to the defined event or business process;

[0160] In addition, the business process can be matched according to the carried data item, and the matched business process is dispatched.

[0161] When the business process is executed, the business process initiates execution of a corresponding business sub-process, and the corresponding business logic of the business sub-process is executed, and the current process is returned after the execution is completed, and the execution of the current business process is continued. This is not limited.

[0162] In an example embodiment, the present application also provides a computer device, comprising a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the method as described above.

[0163] In an example embodiment, the present application also provides a computer program product, comprising a computer program, wherein the computer program is executed by a processor to implement the steps of the method as described above.

[0164] In an example embodiment, the present application also provides a computer readable storage medium, which stores a computer program, wherein the program is executed by a processor to implement the steps of the method as described above.

[0165] Through the above description of the embodiments, those skilled in the art can easily understand that the example embodiments described herein can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a U disk, a mobile hard disk, etc.) or a network, and includes a plurality of instructions to make a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) execute the method according to the embodiments of the present application.

[0166] In the example embodiments of the present application, a computer program medium is also provided, which stores computer readable instructions, and when the computer readable instructions are executed by a processor of a computer, the computer executes the method described in the method embodiment part.

[0167] According to an embodiment of the present application, a program product for implementing the method in the above method embodiment is also provided, which can be a portable compact disc read-only memory (CD-ROM) and includes program code, and can run on a terminal device, such as a personal computer. However, the program product of the present application is not limited to this, and in this document, the readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, device or apparatus.

[0168] The program product can take any combination of one or more computer-readable media. The computer-readable media can be a computer-readable storage medium or a computer-readable signal medium. The computer-readable storage medium can be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include the following: an electrical connection having one or more wires, a portable disc, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0169] The computer-readable signal medium can include a computer-readable storage medium that is configured to store and deliver a computer-readable program code. The computer-readable program code can be propagated as a computer-readable signal medium.

[0170] The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination of the foregoing.

[0171] The program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++, etc., and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device or entirely on the remote computing device or server. In the latter scenario, the remote computing device can be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computing device, such as through the Internet using an Internet Service Provider.

[0172] It should be noted that, although several modules or units for device for action execution are mentioned in the foregoing detailed description, such a division into modules or units is not mandatory. Indeed, according to an embodiment of the present application, features and functionalities of two or more modules or units described above can be embodied in one module or unit. Conversely, features and functionalities of one module or unit described above can be further divided into several modules or units.

[0173] Moreover, although individual steps of the methods in the present application are described in a particular order in the drawings, this is not required or implied as to the order of the steps, nor is it required that all of the steps be performed to achieve the desired result. Additionally or alternatively, certain steps can be omitted, multiple steps can be combined into one step, one step can be broken into multiple steps, etc.

[0174] Those skilled in the art will readily understand that the example embodiments described herein can be implemented by software and / or by hardware coupled with software, as described above. Thus, the technical solutions according to the embodiments of the present application can be embodied in the form of a software product. The software product can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash disk, a mobile hard disk, etc.) or a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to perform the methods according to the embodiments of the present application.

[0175] Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. It is intended that the present application cover any and all variations of the application that come within the scope of the general inventive concepts described herein. The specification and examples are illustrative only and not restrictive of the present application. The true scope and spirit of the application is indicated by the appended claims.

Claims

1. A method for implementing an Internet of Things driven three-dimensional digital twin, characterized in that, The method comprises: For a digital twin platform across a twin scene in an Internet of Things platform, a three-dimensional component is associated with a thing model of at least one Internet of Things platform, the thing model is a digital representation of a corresponding physical entity on the Internet of Things platform, and the twin scene is a scene in which the three-dimensional component is configured to run; Definition information of the associated thing model is obtained as thing model information, the thing model information is serialized and input into the three-dimensional component, and the three-dimensional component is a carrier of geometric properties, behaviors, and data properties; including: obtaining the properties, services, and events defined by the associated thing model on the Internet of Things platform to obtain the definition information of the thing model; encapsulating the definition information to obtain the thing model information in which the three-dimensional component runs in the scene; and serializing the thing model information for inputting the serialized thing model information into the associated three-dimensional component; The thing model information is bound to the three-dimensional component to obtain a three-dimensional digital twin driven by the Internet of Things platform where the thing model is located, and the three-dimensional digital twin is created with an executable behavior set and business logic; The three-dimensional digital twin is run in the twin scene, the three-dimensional digital twin running in the twin scene is driven by real-time data of the Internet of Things platform to trigger the business logic and / or behavior set created by itself; the three-dimensional digital twin running publishes its own event messages and listens to event messages published by other three-dimensional digital twins; when the event messages published by the other three-dimensional digital twins are listened to, corresponding business logic is executed in response to the event messages.

2. The method of claim 1, wherein, The real-time data includes runtime data of a physical entity corresponding to the three-dimensional digital twin and business data.

3. The method of claim 1, wherein, The method comprises: The digital twin platform selects a thing model for a three-dimensional component of a twin scene from all thing models defined by the Internet of Things platform through an interface of the Internet of Things platform; The three-dimensional component is associated with the selected thing model.

4. The method of claim 3, wherein, The digital twin platform selects a thing model for a three-dimensional component of a twin scene from all thing models defined by the Internet of Things platform through an interface of the Internet of Things platform, comprising: The digital twin platform obtains a list of all thing models defined by the Internet of Things platform through an interface of the Internet of Things platform for a three-dimensional component configured to run in the twin scene; The selected thing model is determined for the three-dimensional component by triggering the thing model in the list of all models.

5. The method of claim 3, wherein, The digital twin platform selects a thing model for a three-dimensional component of a twin scene from all thing models defined by the Internet of Things platform through an interface of the Internet of Things platform, comprising: A keyword is obtained through configuration of the three-dimensional component of the digital twin platform; The three-dimensional component determines the selected thing model through the keyword by initiating a thing model query to the Internet of Things platform according to the keyword of the three-dimensional component.

6. The method of claim 1, wherein, The Internet of Things platform that provides the thing model to which the three-dimensional component can be associated is multiple, and the Internet of Things platform is adapted to the scene in which the three-dimensional component is configured to run.

7. A computer device comprising a memory, a processor, and a computer program stored on the memory, wherein the computer program comprises instructions that, when executed by the processor, cause the processor to perform the method of any one of claims 1-6. The processor executes the computer program to implement the steps of the method of any one of claims 1-6.

8. A computer program product comprising a computer program, characterized in that, The computer program, which is executed by a processor, implements the steps of the method according to any one of claims 1 to 6.

9. A computer readable storage medium having stored thereon a computer program, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 6.

Images