Implementation method, equipment and product of three-dimensional digital twinborn body driven by Internet of Things, and medium

Abstract

The invention provides an Internet of Things-driven three-dimensional digital twinborn implementation method, device, product and medium, which can realize connection and interaction of physical entities corresponding to object models on each Internet of Things platform by means of mapping of three-dimensional components to the object models. The object model which is digitally represented by the physical entity on the Internet of Things platform does not need to be additionally customized and developed, the realized twinborn scene and the three-dimensional digital twinborn body which runs in the twinborn scene do not need to be realized through customized development, the digital twinborn platform can obtain the cross-platform capability, and the implementation efficiency is improved. Therefore, the three-dimensional digital twinborn body and the operation of the three-dimensional digital twinborn body in a twinborn scene are realized in a plurality of internet-of-things platform cross

Description

Technical Field

[0001] The present application relates to the field of digital twin technology, and specifically to an Internet of Things-driven three-dimensional digital twin implementation method, a computer device and a computer program product, and a computer-readable storage medium. Background Art

[0002] With the development of digital twin technology, attempts to build various digital twin platforms are being made in all walks of life and in various scenarios in all industries, in the hope that real-time monitoring, simulation, prediction and optimization can be achieved in the scenario with the help of the digital twin platform. Ultimately, it is expected that the digital twin platform will greatly improve flexibility and response speed in many fields such as industry, intelligent manufacturing, and smart cities.

[0003] The digital twin platform needs to be connected to the Internet of Things, and with the help of the Internet of Things, it can learn about the operating conditions and changes of various physical entities in the corresponding real environment. However, since each industry and each scenario has its own Internet of Things platform, and the Internet of Things platform and the digital twin platform are in a relatively separate state. Therefore, for an existing Internet of Things platform in a scenario, customized development is often required to build the corresponding digital twin platform and the twin scene in the digital twin platform. The twin of the digital twin platform will run on the model in the twin scene.

[0004] In other words, for various IoT platforms, especially many third-party IoT platforms, it is necessary to customize the applicable twin scenarios and the models in the twin scenarios respectively, so as to realize the corresponding digital twin applications. The existing implementation of the digital twin platform cannot connect to multiple IoT platforms across platforms. Summary of the invention

[0005] One purpose of this application is to be able to implement three-dimensional digital twins and their operation in twin scenarios across many IoT platforms, so that the constructed digital twin platform has cross-platform capabilities.

[0006] According to one aspect of an embodiment of the present application, a method for realizing a three-dimensional digital twin driven by the Internet of Things is disclosed, the method comprising:

[0007] For the twin scene in the digital twin platform, associate the three-dimensional component with the physical model of the Internet of Things platform, where the physical model is a digital representation of the corresponding physical entity on the Internet of Things platform, and the twin scene is the scene where the three-dimensional component will be configured to run;

[0008] Obtaining definition information of the associated object model as object model information, serializing the object model information and transferring it into the three-dimensional component;

[0009] Binding the object model information to the three-dimensional component to obtain a three-dimensional digital twin driven by the Internet of Things platform where the object model is located, wherein the three-dimensional digital twin is created with an executable behavior set and business logic;

[0010] The three-dimensional digital twin is run in the twin scene, and the three-dimensional digital twin running in the twin scene is driven by real-time data of the Internet of Things platform to trigger the business logic and / or behavior set created by itself.

[0011] According to one aspect of an embodiment of the present application, a computer device is disclosed, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the method as described above.

[0012] According to one aspect of an embodiment of the present application, a computer program product is disclosed, including a computer program, wherein when the computer program is executed by a processor, the steps of the method described above are implemented.

[0013] According to one aspect of an embodiment of the present application, a computer-readable storage medium is disclosed, on which a computer program is stored, and when the program is executed by a processor, the steps of the method described above are implemented.

[0014] In the embodiment of the present application, for the twin scene of the digital twin platform, in order to construct the three-dimensional digital twin it runs and finally complete the addition of the three-dimensional digital twin of the twin scene, the corresponding three-dimensional component is first associated with the physical model of the Internet of Things platform. Under the action of the associated physical model, the digital representation of the corresponding physical entity of this three-dimensional component on the Internet of Things platform can be obtained. After an Internet of Things platform is associated with a physical model, its definition information is obtained as the physical model information, and the physical model information is serialized and then passed into the three-dimensional component. The passed physical model information is bound to the three-dimensional component. The three-dimensional digital twin can be obtained by binding the physical model information and the executable behavior set and business logic to the three-dimensional component. The three-dimensional digital twin runs in the twin scenario and is driven by the real-time data of the IoT platform to trigger its own business logic and / or behavior set. Similarly, each IoT platform can use the mapping of three-dimensional components to object models to realize the connection and interaction of physical entities corresponding to the object models on the IoT platform. The object model, which is a digital representation of the physical entity on the IoT platform, does not require additional customized development, and the realized twin scenario and the three-dimensional digital twin running in the twin scenario no longer need to be realized through customized development. The digital twin platform has acquired cross-platform capabilities, and then realizes the three-dimensional digital twin and its operation in the twin scenario across many IoT platforms.

[0015] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.

[0016] It should be understood that the foregoing general description and the following detailed description are exemplary only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above and other objects, features and advantages of the present application will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings.

[0018] Figure 1 It is a flowchart of a method for implementing a three-dimensional digital twin driven by the Internet of Things according to an exemplary embodiment of the present application.

[0019] Figure 2 is based on Figure 1 The corresponding embodiment shows a method flow chart describing the steps of associating three-dimensional components with physical models of the Internet of Things platform for the twin scene in the digital twin platform.

[0020] Figure 3 is based on Figure 2 The corresponding embodiment shows a method flow chart describing the steps of selecting object models for three-dimensional components of the twin scene from all object models defined by the Internet of Things platform through the interface of the Internet of Things platform by the digital twin platform.

[0021] Figure 4 is based on Figure 2 The corresponding embodiment shows a method flow chart describing the steps of selecting object models for three-dimensional components of the twin scene from all object models defined by the Internet of Things platform through the interface of the Internet of Things platform by the digital twin platform.

[0022] Figure 5 is based on Figure 1 A flowchart of a method for describing the steps of obtaining definition information of an associated object model as object model information and serializing the object model information is shown in the corresponding embodiment.

[0023] Figure 6 A schematic diagram of the architecture of a digital twin platform and a third-party Internet of Things platform according to an embodiment of the present application is shown.

[0024] Figure 7 is Figure 6 Schematic diagram of the mapping relationship between the digital twin and physical model fields constructed under the architecture of the corresponding embodiment.

[0025] Figure 8 Is the construction Figure 7 The mapping relationship shown is a simple illustration of the digital twin data mapping process. DETAILED DESCRIPTION

[0026] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these example embodiments are provided so that the description of the present application will be more comprehensive and complete and the concepts of the example embodiments will be fully conveyed to those skilled in the art. The accompanying drawings are only schematic illustrations of the present application and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted.

[0027] In addition, the described features, structures or characteristics may be combined in one or more example embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the example embodiments of the present application. However, those skilled in the art will appreciate that the technical solution of the present application may be practiced while omitting one or more of the specific details, or other methods, components, steps, etc. may be adopted. In other cases, known structures, methods, implementations or operations are not shown or described in detail to avoid obscuring the present application and making the various aspects of the present application obscure.

[0028] Some of the blocks shown in the accompanying drawings are functional entities that do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0029] The embodiment of the present application builds a digital twin platform and constructs various twin scenarios to adapt to various twin needs. Both the digital twin platform and the constructed twin scenarios have cross-platform capabilities and can realize three-dimensional digital twins for physical entities of at least one Internet of Things platform.

[0030] At this point, it should be noted that the various IoT platforms are independent of each other and have no interaction, and the construction of each IoT platform is customized without unified standards. Therefore, in the existing implementation, it is only suitable for a single IoT platform to achieve a specific twin requirement, and it is difficult to quickly realize a twin scenario and the three-dimensional digital twin of the twin scenario for multiple IoT platforms.

[0031] For example, in the field of intelligent manufacturing, an Internet of Things platform is deployed and built for a factory, and an exclusive digital twin platform is customized and developed for monitoring and optimizing the production process. However, this digital twin platform is not suitable for the Internet of Things platform of a smart city. If the digital twin platform needs to be connected to the Internet of Things platform of a smart city, a lot of costs will be required to solve the linkage relationship between the Internet of Things platform and the digital twin platform. This linkage relationship includes but is not limited to data mapping, behavior mapping and other aspects.

[0032] Due to this limitation, the implementation threshold of digital twins and digital twin scenarios is very high and is limited to a single IoT platform. The access of other IoT platforms will require re-development, and it may not even be possible to achieve simultaneous access to multiple IoT platforms on a single digital twin platform or twin scenario.

[0033] The three-dimensional digital twin implemented on the digital twin platform based on this application, and the twin scene it runs, will not be limited to a single IoT platform, and three-dimensional digital twins can be built and run for twin scenes across platforms.

[0034] See also Figure 1 , Figure 1 It is a flowchart of a method for implementing a three-dimensional digital twin driven by the Internet of Things according to an exemplary embodiment of the present application.

[0035] The method for implementing a three-dimensional digital twin driven by the Internet of Things provided in the embodiment of the present application includes:

[0036] Step S110, for the twin scene in the digital twin platform, associate the three-dimensional component with the physical model of the Internet of Things platform. The physical model is a digital representation of the corresponding physical entity on the Internet of Things platform, and the twin scene is the scene where the three-dimensional component will be configured and run;

[0037] Step S120, obtaining definition information of the associated object model as object model information, serializing the object model information and transferring it into the three-dimensional component;

[0038] Step S130, binding the object model information to the three-dimensional component, obtaining a three-dimensional digital twin driven by the Internet of Things platform where the object model is located, and creating an executable behavior set and business logic for the three-dimensional digital twin;

[0039] Step S140, running the three-dimensional digital twin in the twin scene. The three-dimensional digital twin running in the twin scene is driven by the real-time data of the Internet of Things platform to trigger the business logic and / or behavior set created by itself.

[0040] These steps are described in detail below.

[0041] First of all, it should be explained that the digital twin platform is used to create, manage and maintain three-dimensional digital twins, and provides at least one specific application environment, namely the twin scene. The three-dimensional digital twin runs in the twin scene as a twin instance, and is driven by at least one connected IoT platform to trigger corresponding events and / or business logic.

[0042] The digital twin platform implemented in the present application is connected to at least one Internet of Things platform, so that the constructed twin scene can be connected to at least one Internet of Things platform, so that the multiple twin entities configured in the twin scene can correspond to different Internet of Things platforms respectively, and then operate under the drive of at least one Internet of Things platform.

[0043] In step S110, the digital twin platform may create a twin scene, which will be adapted to at least one IoT platform, and then trigger corresponding events or business processes in the twin scene in response to dynamic changes of the physical entity connected to the IoT platform.

[0044] The digital twin platform creates twin scenes across the Internet of Things platform and then adds three-dimensional digital twins to the created twin scenes. That is, in the process of adding three-dimensional digital twins, the three-dimensional components used to create the three-dimensional digital twins are first determined. The three-dimensional components are the core components for building three-dimensional digital twins and are the carriers of various contents such as the geometric properties, behaviors, and data attributes of the created three-dimensional digital twins.

[0045] To further explain, the three-dimensional component is an independent unit in the digital twin platform system. It can form a unit that can independently execute specific business processes, tasks or functions by assigning geometric properties, behaviors, data attributes, etc. The three-dimensional component has input and output and can interact with other components, such as other three-dimensional components.

[0046] Three-dimensional components that carry geometric properties, behaviors, data attributes, etc. constitute three-dimensional digital twins, which can then perceive the state changes of physical entities bound to the Internet of Things platform in the twin scenarios where they run, and drive themselves to trigger specific business processes or events.

[0047] Therefore, it should be clearly pointed out that the three-dimensional component as a carrier is a reusable unit. For example, it can be reused in different twin scenarios, so that the digital twin platform can be quickly integrated, modified and adjusted in multiple twin scenarios to obtain the required three-dimensional digital twin. It has the advantages of high versatility, flexibility and strong scalability, and will significantly reduce the development cost for the construction and operation of twin scenarios.

[0048] For the three-dimensional components selected for creating three-dimensional digital twins, it is necessary to achieve their physical entity binding on the Internet of Things platform. In order to adapt to the Internet of Things platform and realize the binding of physical entities, the three-dimensional components are associated with the object model that digitally represents the physical entity, and then the binding of the three-dimensional components and the physical entity is realized through the mapping of the object model and the physical entity.

[0049] Exemplarily, the physical entity may be a sensor on the IoT platform, and the sensor is digitized to obtain a corresponding physical model. The digital twin platform uses a three-dimensional component as a carrier to construct a three-dimensional digital twin of the sensor. At this time, step S110 is executed to select and associate a corresponding physical model for the three-dimensional component to the IoT platform to create a three-dimensional digital twin of the physical entity corresponding to the physical model in the twin scene.

[0050] When creating a twin scene and adding a three-dimensional digital twin in a twin scene, step S110 will be executed to achieve the association of the three-dimensional components of the three-dimensional digital twin with the physical entities on the Internet of Things platform, and to achieve the association of the twin scene with at least one physical entity in at least one Internet of Things platform. Through the realization of the association, the twin scene is driven by the Internet of Things platform, and the constructed twin scene can be quickly connected to at least one Internet of Things platform, and is no longer limited to a single Internet of Things platform.

[0051] The twin scene is the scene where the three-dimensional component will be configured and run. In other words, the twin scene is the scene where the three-dimensional digital twin created by the three-dimensional component will be placed. The twin scene corresponds to the physical scene constructed by the physical entity in at least one IoT platform, and the twin scene is the digital expression of the physical scene.

[0052] With the configuration and operation of several three-dimensional components, the twin scene is composed of multiple three-dimensional digital twins. Multiple three-dimensional digital twins will self-drive interaction and collaboration in the twin scene to realize the operation of the twin scene.

[0053] In an exemplary embodiment, the digital twin platform selects a physical model for a three-dimensional component of the twin scene from all physical models defined by the IoT platform through an interface of the IoT platform, and then associates the selected physical model with the three-dimensional component.

[0054] For example, all object models defined for the Internet of Things platform will be provided to the digital twin platform in the form of a list of all object models for selection of object models for associating three-dimensional components.

[0055] In addition, a physical model for association may be obtained for a three-dimensional component from an IoT platform by querying keywords.

[0056] In summary, in the execution of step S110, the associated object model is determined from the Internet of Things platform by list selection or keyword query, and the associated physical entity is then determined.

[0057] Before configuring the three-dimensional components for the twin scene and associating the object model, the object model will be requested to be associated for the twin scene from at least one IoT platform through the initiated request. Specifically, before step S110, the present application will also execute: configuring the three-dimensional components in the twin scene, initiating an object model association request for the twin scene to at least one IoT platform, and the object model association request for the twin scene is used to initiate the object model association on the requested IoT platform for at least one three-dimensional component configured for the twin scene.

[0058] That is to say, for the digital twin platform, it is the constructed twin scene, configured with three-dimensional components for creating three-dimensional digital twins. For this three-dimensional component, it will initiate a physical model association request to the Internet of Things platform to request the physical model associated with the corresponding physical entity. Different three-dimensional components may request different Internet of Things platforms, that is, the twin scene is constructed across Internet of Things platforms, and then the three-dimensional digital twins in the twin scene are driven by each Internet of Things platform to run.

[0059] See also Figure 2 , Figure 2 is based on Figure 1 The corresponding embodiment shows a method flow chart describing the steps of associating three-dimensional components with physical models of the Internet of Things platform for the twin scene in the digital twin platform.

[0060] The embodiment of the present application provides a twin scene in a digital twin platform, and step S110 of associating a three-dimensional component with a physical model of an Internet of Things platform includes:

[0061] Step S111, the digital twin platform selects an object model for the three-dimensional component of the twin scene from all object models defined by the Internet of Things platform through the interface of the Internet of Things platform;

[0062] Step S112, associating the three-dimensional component with the selected object model.

[0063] These two steps are described in detail below.

[0064] It should be pointed out that each IoT platform digitizes the physical entities it deploys, such as various sensors, to obtain their own object models, and the IoT platform also interacts with the digital twin platform through exposed interfaces, so that the digital twin platform can initiate operations to the digital twin platform by calling the interface, such as initiating queries and list retrieval operations.

[0065] The physical entities deployed by the IoT platform are all equipped with a physical model for digital expression. The physical model defines the properties, services and even events of the corresponding physical objects, i.e., the physical entities, and further describes the physical entities in a static and / or dynamic manner. For example, the static description of the physical model refers to the definition of the physical entity through the attributes of each dimension; the dynamic description of the physical entity refers to the services or events defined by the physical model. For example, the service can be an operation or function that can be performed by the physical entity, and the event can be a trigger mechanism for the abnormality or specific state of the physical entity.

[0066] The various properties, services, and events obtained by digitizing the physical entity will be serialized into a physical model and stored in the IoT platform where the physical entity is located. In other words, each physical entity has a corresponding physical model in the IoT platform where it is located.

[0067] Therefore, in the execution of step S111, the object model can be selected from all the object models defined by the Internet of Things platform for the three-dimensional component of the twin scene through the interface of the Internet of Things platform. The digital twin platform associates the obtained object model with the three-dimensional component, and thus determines the corresponding physical entity for the current three-dimensional digital twin.

[0068] See also Figure 3 , Figure 3 is based on Figure 2 The corresponding embodiment shows a method flow chart describing the steps of selecting object models for three-dimensional components of the twin scene from all object models defined by the Internet of Things platform through the interface of the Internet of Things platform by the digital twin platform.

[0069] The digital twin platform provided in the embodiment of the present application selects a physical model for a three-dimensional component of a twin scene from all physical models defined by the Internet of Things platform through an interface of the Internet of Things platform, step S111, including:

[0070] Step S1111a, the digital twin platform obtains a list of defined object models for the three-dimensional components configured to run in the twin scene through the interface of the Internet of Things platform;

[0071] Step S1112a, determining the selected object model for the three-dimensional component by selecting the object model triggered in the list of all object models.

[0072] This step is described in detail below.

[0073] In step S1111a, a list of all object models defined by the IoT platform, i.e., the object model list, is obtained through the interface of the IoT platform, so that the object model selected for the three-dimensional component can be obtained by triggering the object model selection operation on the object model list during the execution of step S1112a.

[0074] Therefore, for the creation of a three-dimensional digital twin, the binding of physical entities can be realized on the digital twin platform. Under the action of the physical model that digitally describes the physical entity, the differences among various IoT platforms can be ignored. Under the action of the physical model, the association of twins can be realized for the physical entities under the IoT platform, which greatly enhances the compatibility of various IoT platforms.

[0075] See also Figure 4 , Figure 4 is based on Figure 2 The corresponding embodiment shows a method flow chart describing the steps of selecting object models for three-dimensional components of the twin scene from all object models defined by the Internet of Things platform through the interface of the Internet of Things platform by the digital twin platform.

[0076] The digital twin platform provided in the embodiment of the present application selects a physical model for a three-dimensional component of a twin scene from all physical models defined by the Internet of Things platform through an interface of the Internet of Things platform, step S111, including:

[0077] Step S1111b, obtaining keywords through the configuration of the three-dimensional components of the digital twin platform;

[0078] Step S1112b, initiating a physical model query to the Internet of Things platform according to the keyword of the three-dimensional component, and determining the selected physical model for the three-dimensional component through the keyword query.

[0079] The following describes these two steps in detail.

[0080] To create a 3D digital twin, the 3D components on the digital twin platform will be configured. As the 3D components are configured, the keywords of the physical entities bound to the 3D components will be obtained. As mentioned above, 3D components are reusable. Therefore, in the process of creating a 3D digital twin with the currently available 3D components as carriers, the 3D components are first obtained, and based on the physical entity to which they are about to be bound, the keywords corresponding to the physical entity are obtained so as to be used to query the physical model of the physical entity.

[0081] Exemplarily, for the object models stored in each IoT platform, the digital twin platform will initiate a query operation to query the object model corresponding to the keyword, and then associate the queried object model with the currently configured three-dimensional component.

[0082] After selecting the object model for the three-dimensional component, the digital twin platform will associate the object model with the IoT platform, that is, the IoT platform will establish an association relationship between the object model and the three-dimensional component. However, it should be understood that the physical entities on the IoT platform, such as sensors, can interact with at least one three-dimensional twin in at least one twin scene, so the corresponding object model can be associated with at least one three-dimensional component.

[0083] On the other hand, the digital twin platform will also build an association relationship between the three-dimensional components and the selected object models, so as to trigger corresponding business processes or events driven by the physical entities of the associated object models.

[0084] With the execution of step S110, the digital twin platform associates the physical model with the three-dimensional component, and then in the execution of step S120, the digital twin platform can obtain the definition information of the associated physical model as the physical model information.

[0085] As mentioned above, the object model describes the corresponding physical entity through the definition of attributes, services and even events, so step S120 will obtain the definition information of the associated object model as the object model information.

[0086] Exemplarily, the object model exists in the form of definition information and is stored on the IoT platform. Each physical entity deployed will construct an object model based on its attributes, services, and events. The definition information that defines its attributes, services, and events is the form of existence of the object model, which serves as the object model information.

[0087] In step S120, the definition information of the associated object model is obtained as the object model information, the object model information is serialized and passed into the three-dimensional component. The three-dimensional component is used as a carrier to carry the object model information so as to obtain a three-dimensional digital twin corresponding to the physical entity in the Internet of Things platform.

[0088] After obtaining the object model information, the digital twin platform serializes the object model information. Exemplarily, the object model information serialization may be an execution process of converting the object model information into a JSON data format.

[0089] Exemplarily, obtaining the definition information of the associated physical model will not be limited to obtaining the definition information describing the properties, services and events of the corresponding physical entity from the Internet of Things platform, but will also obtain other definition information based on the digital twin platform, such as the definition information describing the geometric model of the corresponding physical entity.

[0090] So far, it should be noted that the geometric model is a parametric three-dimensional model based on points, lines, surfaces, materials and textures, rather than an image-based model. The geometric model is expressed by a function, so the function used to characterize the geometric model will serve as the definition information of the geometric properties of the object model, forming the object model information.

[0091] In addition, the executable behavior set and business logic created by the digital twin platform for the three-dimensional digital twin platform will also serve as the definition of the services and events of the object model and constitute part of the object model information.

[0092] Therefore, based on the physical model and the physical entity corresponding to the physical model, the physical model information is obtained and passed into the associated three-dimensional component. Under the action of step S130, the physical model information is bound to the three-dimensional component to obtain a three-dimensional digital twin that encapsulates properties, services and events.

[0093] See also Figure 5 , Figure 5 is based on Figure 1 A flowchart of a method for describing the steps of obtaining definition information of an associated object model as object model information and serializing the object model information is shown in the corresponding embodiment.

[0094] The step S120 of obtaining the definition information of the associated object model as the object model information and serializing the object model information provided in the embodiment of the present application includes:

[0095] Step S121, acquiring the attributes, services and events defined by the associated object model on the Internet of Things platform to obtain definition information of the object model;

[0096] Step S122, encapsulating the definition information to obtain the object model information of the three-dimensional component running in the scene;

[0097] Step S123: serialize the object model information to obtain serialized object model information for transmitting to the associated three-dimensional component.

[0098] This step is described in detail below.

[0099] In step S121, the physical model describes the properties, services and events of the corresponding physical entity, which constitutes the definition information of the physical model. The physical model information of the three-dimensional component running in the scene is obtained by encapsulating the definition information in step S122.

[0100] At this point, it should be noted that the scene referred to is the twin scene to which the three-dimensional digital twin created for this three-dimensional component is about to be added.

[0101] The object model information is converted according to a specified data format, such as a JSON data format, and the obtained JSON data is passed to the three-dimensional component as an existence form of the object model information.

[0102] As the object model information is input, the object model information will be bound to the three-dimensional component during the execution of step S130, so that a three-dimensional digital twin driven by the Internet of Things platform where the object model is located can be obtained.

[0103] In step S130, the binding relationship between the object model information and the three-dimensional component is constructed to achieve the binding of the object model information to the three-dimensional component. Exemplarily, the three-dimensional component has its corresponding identification information, so the identification information created for the three-dimensional component, such as the component identification or even the twin identification, is not limited here, as long as it can uniquely identify the currently configured three-dimensional component.

[0104] The three-dimensional component bound with the physical model information is obtained by constructing a binding relationship between the identification information and the physical model information, that is, the physical model information is bound to the three-dimensional component.

[0105] After binding the object model information to the associated three-dimensional component, the three-dimensional component will also be configured with an executable behavior set and business logic to obtain a three-dimensional digital twin driven by the object model and the Internet of Things platform where the object model is located. The three-dimensional digital twin instance will run in the twin scene.

[0106] At this point, through the binding of the object model information to the three-dimensional component, the three-dimensional component can be given various definition information carried by the object model information. As mentioned above, the definition information is a digital expression of the corresponding physical entity deployed on the IoT platform. Therefore, it will also become a digital expression of the created three-dimensional digital twin, thereby achieving consistency between the created three-dimensional digital twin and the corresponding physical entity, and being able to adapt to any IoT platform to realize a three-dimensional digital twin for any physical entity. The three-dimensional digital twin creation can be oriented to any IoT platform, and is no longer limited by the differences of IoT platforms.

[0107] In summary, the execution process of step S130 may include: first, obtaining the identification information created for the three-dimensional component, then constructing a binding relationship between the identification information and the object model information, obtaining the three-dimensional component bound to the object model information, and finally configuring an executable behavior set and business logic for the three-dimensional component bound to the object model information to obtain a three-dimensional digital twin driven by the object model and the Internet of Things platform where the object model is located. The three-dimensional digital twin runs as a twin instance in the twin scene.

[0108] The executable behavior set configured for the three-dimensional component is used to reproduce the behavioral performance of the corresponding physical entity in the twin scene. Therefore, in an exemplary embodiment, the executable behavior set can be in the form of skeletal animation, and executes the indicated behavior, such as movement, in response to real-time data fed back by the corresponding physical entity.

[0109] The configuration of the behavior set will adapt to the corresponding physical entity. The business logic configured for the three-dimensional component will adapt to the business process mapped to the physical entity, that is, the triggering of the business process will initiate the execution of the corresponding business logic.

[0110] The created 3D digital twin will be added to the corresponding twin scene, and then driven by the IoT platform to run in the twin scene. Among them, the 3D digital twin running in the twin scene is a specific and running instance, so the 3D digital twin actually exists in the form of a 3D digital twin instance.

[0111] By analogy, for the twin scenarios built and run, three-dimensional digital twins can be created for many IoT platforms. Each execution process of creating a three-dimensional digital twin can create a three-dimensional digital twin for the physical entity deployed on any IoT platform under the action of three-dimensional components and object models. Therefore, there is no need for customized development for the IoT platform, and the digital twin platform and various IoT platforms are no longer in a state of separation. It can even realize the operation of twin scenarios across IoT platforms.

[0112] As steps S110 to S130 are executed, at least one three-dimensional digital twin will be created for the twin scene. By adding the created three-dimensional digital twin to the twin scene, the three-dimensional digital twin can be run in the twin scene.

[0113] The creation and addition of various three-dimensional digital twins are completed, as shown in step S140, so that the twin scene is driven by the Internet of Things platform and runs the corresponding three-dimensional digital twin instance.

[0114] In step S140, as the obtained three-dimensional data twin is added to the twin scene and the three-dimensional digital twin interacts with the Internet of Things platform, the three-dimensional digital twin runs in the twin scene as an instance, that is, the three-dimensional digital twin instance is controlled by the real-time data of the Internet of Things platform to drive the corresponding business logic and / or behavior set.

[0115] Among them, real-time data includes runtime data and business data of the physical entity corresponding to the three-dimensional digital twin. The three-dimensional digital twin is driven by the real-time data of the IoT platform to trigger the business logic and / or behavior set created by itself. The three-dimensional digital twin running in the twin scene will synchronize real-time data with the corresponding physical entity deployed on the IoT platform to obtain the runtime data of the physical entity.

[0116] Exemplarily, the runtime data may include the state of the physical entity, sensor data, operating parameters, etc., describing the current state and performance indicators of the physical entity. Business data refers to data received from the outside, such as the Internet of Things platform, and other three-dimensional digital twins during the operation of the three-dimensional digital twin, which can drive its own behavior, update its own state and / or trigger business processes, and is not limited here.

[0117] In the twin scenario, the operation process of the three-dimensional data twin, on the one hand, synchronizes the runtime data of the corresponding physical entity, and triggers its own business process or events in response to the synchronized runtime data; on the other hand, it will also publish messages as it runs, and then coordinate with other three-dimensional digital twins to respond to the messages and run its own business logic.

[0118] In an exemplary embodiment, the execution process of step S140 includes: the three-dimensional digital twin is controlled by the real-time data of the Internet of Things platform in the twin scene to trigger its own defined events and / or call the corresponding business process, the event responds to the state change of the physical entity, and the business process is controlled by the operation of the physical entity; then the corresponding business logic is executed according to the scheduled business process, and the execution of at least one task or operation is initiated through the execution of the business logic.

[0119] As the three-dimensional digital twin is created for the Internet of Things platform, the three-dimensional digital twin, as an instance of a twin scene, is controlled by the real-time data of the Internet of Things platform during operation, such as the runtime data of the corresponding physical entity to trigger defined events or business processes.

[0120] Exemplarily, the three-dimensional digital twin monitors data and events through the digital twin platform where it is located. As real-time data is synchronized, such as runtime data generated by the operation of the physical entity, the real-time data of its object model will be synchronized to the three-dimensional digital twin. After the three-dimensional digital twin monitors the data through the digital twin platform where it is located, it will serialize the data through the data twin platform to convert all data consistently so that the three-dimensional digital twin can obtain serialized data, such as JSON data, so that data in many formats of different IoT platforms can be used by the digital twin platform and the three-dimensional digital twins in its twin scenarios, without being limited by the differences and incompatibilities of the IoT platforms.

[0121] In other words, in order to create and add three-dimensional digital twins for each twin scene, the three-dimensional digital twins will realize the acquisition, monitoring, message publishing, event publishing, etc. of real-time data in the Internet of Things platform through the architecture built by the digital twin platform.

[0122] In other words, the real-time data acquisition, monitoring, message publishing, event publishing, etc. performed by the three-dimensional digital twin are decoupled from the three-dimensional digital twin, which ensures the reliability and stability of the operation of many three-dimensional digital twins while also enhancing the lightweight performance of the three-dimensional digital twin, making the construction of the three-dimensional digital twin simpler and faster.

[0123] Therefore, the digital twin platform will compare the created JSON data to confirm whether the same type of data has changed compared to the data obtained by the last synchronization. If there is no change, no processing will be performed and data monitoring will continue. In an exemplary embodiment, after confirming that the data has changed, the corresponding front-end display of the three-dimensional digital twin will be controlled to perform a corresponding update in response to the change, such as the update of the corresponding parameterized three-dimensional model.

[0124] In another exemplary embodiment, for the existing changes, it is necessary to determine whether to trigger a certain business process or event, and then call the corresponding business process or trigger the event when necessary.

[0125] The triggered business process will trigger, execute and / or call certain tasks or business logic, so that the business process triggered by the three-dimensional digital twin can be executed. The triggered event will also initiate the execution of the corresponding operation. Regardless of the call of the business process or the triggering of the event, an event message can be issued at a specific link and time, and other three-dimensional digital twins will listen to the event message through the digital twin platform during their own operation, and process their own business logic in response to the relevant event message.

[0126] Further explanation: the event message sent by the 3D digital twin, that is, the event release, will be realized through the event bus under the control of the digital twin platform. The 3D digital twin publishes the event to the event bus, and after a series of execution processes such as event filtering, matching and conversion, it is finally delivered to the target 3D digital twin, which will monitor and trigger the event. Thus, the 3D digital twin can be driven by the IoT platform to run autonomously, which greatly enhances the reliability and accuracy of the twin scene operation.

[0127] Exemplarily, as data synchronization and message monitoring proceed, the carried parameters will also be calculated to determine whether to call a corresponding set of behaviors, such as the aforementioned skeletal animation and model animation, for front-end display.

[0128] With the implementation of the three-dimensional digital twin, especially the geometric properties carried by the three-dimensional digital twin, that is, the parametric three-dimensional model, the front-end display will be able to accurately present the physical scenes mapped across the Internet of Things platform and the dynamics of physical entities under the physical scenes, so that the display for the real environment is no longer a simple schematic, and very high accuracy can be achieved in terms of timeliness and content.

[0129] Exemplarily, as real-time data is received, the digital twin platform will also match the business process based on the obtained real-time data, especially the runtime data in the real-time data, to obtain the process keyword of the matched business process, that is, the process key; at this time, the obtained process key is passed to the configured workflow scheduler, and the workflow scheduler initiates the operation of the business process to the process engine component, so that the corresponding business logic is executed. It should be understood that at this point, under the action of the digital twin platform, as well as the workflow scheduler and process engine components configured by the digital twin platform, the business process required to initiate the runtime data can be called in a timely and accurate manner, and the business process will not be omitted or discarded, thereby ensuring the reliable and accurate operation of the twin scene.

[0130] As the business process runs, when it reaches a specific process node, the release of the process message will be triggered.

[0131] The operation of each three-dimensional digital twin in the twin scene may lead to the release of process messages. Therefore, facing the many messages released, including process messages and event messages, the digital twin platform will adopt asynchronous message monitoring and processing to improve the system performance of the twin scene, obtain high concurrency capabilities, and avoid possible resource blocking. The release and processing of messages are decoupled from the three-dimensional digital twin, which will greatly improve the scalability and reliability of the twin and the twin scene.

[0132] To further illustrate, the published message will find the corresponding three-dimensional digital twin through the parameters it carries, so that the corresponding three-dimensional digital twin can respond to the message and call the corresponding business process to execute the corresponding business logic.

[0133] Therefore, the execution of step S140 also includes: the running three-dimensional digital twin publishes its own event messages and monitors the event messages published by other three-dimensional digital twins; when the event messages published by other three-dimensional digital twins are obtained through monitoring, the corresponding business logic is executed in response to the event messages.

[0134] In this way, the three-dimensional digital twins running in the twin scene can cooperate with each other. When the operating status of a three-dimensional digital twin changes, other related three-dimensional digital twins will also be linked accordingly, triggering the corresponding business process.

[0135] At this point, the three-dimensional digital twin driven by the Internet of Things and its operation process implemented in this application will be explained in detail with reference to a specific example.

[0136] Figure 6 A schematic diagram of the architecture of a digital twin platform and a third-party Internet of Things platform according to an embodiment of the present application is shown.

[0137] It should be understood that in addition to being able to interact with custom-developed IoT platforms, the digital twin platform can also build and run twin scenarios with other third-party IoT platforms. In other words, the twin scenarios run across platforms.

[0138] First, on the digital twin platform, the three-dimensional components are given their geometric properties, data properties, and behaviors, among which the geometric properties are the form presented by this three-dimensional component, that is, the geometric model exists in the form of a parameterized three-dimensional model; the behavior is defined and implemented through the created skeletal animation, motion path, and business process; the data attributes may include physical properties, specification properties, and operating state data. For example, the physical data indicates the physical characteristics of the corresponding physical entity, which may be stainless steel, transparent glass, or plexiglass, and the specification properties indicate the specifications of the corresponding physical entity, such as the maximum voltage and maximum power; the operating state data refers to the data, status, and behavior generated during the operation process, which may include error codes, operating status, and logs, which are not listed here one by one; in addition, the properties, services, and events of the physical entity corresponding to the object model will be given through the synchronization of the properties, services, and events defined by the object model.

[0139] It should be noted that since the geometric properties assigned to the three-dimensional components are parametric three-dimensional models, that is, the results of parametric modeling, they exist in the form of functions, that is, the constructed parametric three-dimensional models are characterized by functions based on points, lines, and surfaces.

[0140] It is precisely because of the model support provided by the parametric three-dimensional model, driven by the Internet of Things platform or other three-dimensional digital twins, that it can accurately act on a certain surface, a certain line and other basic units to trigger corresponding business processes and events, rather than just acting on the model as a whole, greatly enhancing the accuracy of operation. With the help of parametric three-dimensional models, the operation of three-dimensional digital twins is more detailed and accurate.

[0141] Most of the currently implemented models are based on images, such as various static images, dynamic images, and even models constructed by video streams. This type of model is not detailed to the point, line, or surface, nor does it have such capabilities. Therefore, the responses that can be implemented are limited to the overall model corresponding to a physical entity, and it is not possible to respond to each part of the overall model separately.

[0142] For example, a twin scene constructed will be used to present the operation of vehicles at an intersection. At this time, in the existing implementation, the model of each vehicle is built based on an image, and the business processes and events created are all applied to the vehicle as a whole.

[0143] The geometric properties obtained through parametric modeling are assigned to the three-dimensional digital twins constructed by three-dimensional components. They will be oriented to the vehicle as a whole, and each part of the vehicle, such as tires and bearings, can correspond to a sub-twin, and then create their own business processes and events, which will be driven by the Internet of Things platform and other three-dimensional digital twins, realizing accurate response to twin scenarios.

[0144] The digital twin platform synchronizes with a third-party IoT platform, enabling the three-dimensional components to be associated with the physical models on the third-party IoT platform, and then the various definition information corresponding to the physical entities running in the real environment, such as the property definition, state definition, and condition judgment rules of the physical model, are synchronized to the three-dimensional components, so that the three-dimensional digital twins created by the three-dimensional components are endowed with the synchronized physical model information.

[0145] Therefore, for the physical entities deployed on the IoT platform, such as the aforementioned physical entities, three-dimensional digital twins are realized and added to the twin scenarios.

[0146] The real-time data generated by the operation of the third-party Internet of Things platform will be synchronized to the three-dimensional digital twin to drive the operation of the three-dimensional digital twin.

[0147] It is further explained that based on the interaction between the digital twin platform and the third-party Internet of Things platform, a mapping relationship is established between the created three-dimensional digital twin and the object model.

[0148] See also Figure 7 , Figure 7 is Figure 6 Schematic diagram of the mapping relationship between the digital twin and physical model fields constructed under the architecture of the corresponding embodiment.

[0149] As mentioned above, the object model exists in the form of its various definition information, that is, each object model field constitutes each definition information of the object model.

[0150] Therefore, the definitions of properties, services and events performed by the object model will be synchronized to the created three-dimensional digital twin. The services defined by the object model will be implemented through the business processes of the three-dimensional digital twin in the twin scene. The events defined by the object model can be realized by the behavior of the three-dimensional digital twin, that is, the assigned skeletal animation, motion path and business process. The properties defined by the physical model will be synchronized with the geometric properties and data properties of the three-dimensional digital twin, and the object model itself corresponds to a physical entity deployed on the Internet of Things platform.

[0151] Among them, it should be clear that skeletal animation defines various actions of physical entities to be reproduced in the twin scene, such as the opening and closing of gates, the transportation of fans, the up and down movement of elevators, etc. Skeletal animation is essentially a form of existence of a set of behaviors created by three-dimensional digital twins.

[0152] The motion path is used to indicate a position change, for example, to realize the movement of a forklift, etc. Exemplarily, the motion path may be a pre-set fixed path, or may be driven by a position change indicated in real-time data, which is not limited here.

[0153] The digital twin platform is the twin scene that needs to be built at present. It may obtain the list of all object models defined by the IoT platform through the interface of the third-party IoT platform, that is, the list of all object models referred to above, or select the object model associated with the three-dimensional component based on keywords or custom filtering to associate the three-dimensional component with the object model, and then synchronize the object model information to the object model.

[0154] Specifically, all definition information of the object model will be expressed in the form of JSON and passed to the three-dimensional component for storage.

[0155] like Figure 8 As shown, Figure 8 Is the construction Figure 7 The mapping relationship shown is a simple illustration of the digital twin data mapping process.

[0156] That is, by querying all object models, a model is selected for the currently configured three-dimensional component, and then all attribute definitions of the object model are obtained, and a JSON data format is created to reflect the attribute definition. The object model information in the JSON data format is passed to the three-dimensional component to bind the corresponding identification information, such as the model ID.

[0157] The created 3D digital twin is added to the twin scene and runs as an instance, i.e., the 3D digital twin instance. At this point, in the running twin scene, the 3D digital twin will monitor the real-time data of the third-party IoT platform through the interface, such as the runtime data transmitted by the physical entity.

[0158] The received real-time data will first be converted into a specific data format to avoid the situation where the three-dimensional digital twin cannot read the received real-time data. Exemplarily, the specific data format can also be a JSON data format.

[0159] The received real-time data is converted into a JSON digital string, and the data in the JSON digital string is checked. For example, if a change occurs, an event or business process is triggered according to a defined event or business process;

[0160] In addition, the business process can also be matched according to the data items carried, and then the matched business process can be scheduled.

[0161] As the business process is scheduled and executed, the business process will also initiate the execution of the corresponding business sub-process. At this time, the business logic corresponding to the corresponding business sub-process will be executed. After the execution is completed, it will return to the current process and continue to schedule and execute the current business process. There is no limitation here.

[0162] In an exemplary embodiment, the present application further provides a computer device, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the method described above.

[0163] In an exemplary embodiment, the present application further provides a computer program product, including a computer program, wherein the computer program implements the steps of the above-mentioned method when executed by a processor.

[0164] In an exemplary embodiment, the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the method described above are implemented.

[0165] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation methods of the present application.

[0166] In an exemplary embodiment of the present application, a computer program medium is further provided, on which computer-readable instructions are stored. When the computer-readable instructions are executed by a processor of a computer, the computer is enabled to execute the method described in the above method embodiment.

[0167] According to one embodiment of the present application, a program product for implementing the method in the above method embodiment is also provided, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited to this. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0168] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0169] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0170] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0171] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0172] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0173] In addition, although the steps of the method in the present application are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0174] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the implementation methods of the present application.

[0175] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the appended claims.

Claims

1. A method for realizing a three-dimensional digital twin driven by the Internet of Things, characterized in that: The method comprises: For the twin scene in the digital twin platform, associate the three-dimensional component with the physical model of the Internet of Things platform, where the physical model is a digital representation of the corresponding physical entity on the Internet of Things platform, and the twin scene is the scene where the three-dimensional component will be configured to run; Obtaining definition information of the associated object model as object model information, serializing the object model information and transferring it into the three-dimensional component; Binding the object model information to the three-dimensional component to obtain a three-dimensional digital twin driven by the Internet of Things platform where the object model is located, wherein the three-dimensional digital twin is created with an executable behavior set and business logic; The three-dimensional digital twin is run in the twin scene, and the three-dimensional digital twin running in the twin scene is driven by real-time data of the Internet of Things platform to trigger the business logic and / or behavior set created by itself.

2. The method according to claim 1, characterized in that The real-time data includes runtime data of the physical entity corresponding to the three-dimensional digital twin, as well as business data.

3. The method according to claim 1, characterized in that The twin scene in the digital twin platform is used to associate the three-dimensional components with the physical model of the Internet of Things platform, including: The digital twin platform selects a physical model for the three-dimensional component of the twin scene from all physical models defined by the Internet of Things platform through an interface of the Internet of Things platform; The three-dimensional component is associated with the selected object model.

4. The method according to claim 3, characterized in that The digital twin platform selects a physical model for a three-dimensional component of the twin scene from all physical models defined by the Internet of Things platform through an interface of the Internet of Things platform, including: The digital twin platform configures the three-dimensional components running in the twin scene and obtains a list of defined object models through an interface of the Internet of Things platform; By selecting the triggered object models in all model lists, the selected object model is determined for the three-dimensional component.

5. The method according to claim 3, characterized in that: The digital twin platform selects a physical model for a three-dimensional component of the twin scene from all physical models defined by the Internet of Things platform through an interface of the Internet of Things platform, including: Obtaining keywords through configuration of three-dimensional components of the digital twin platform; Initiate a physical model query to the Internet of Things platform according to the keyword of the three-dimensional component, and determine a selected physical model for the three-dimensional component through the keyword query.

6. The method according to claim 1, characterized in that The acquiring definition information of the associated object model as object model information, serializing the object model information and transferring the object model information to the three-dimensional component includes: Acquire the attributes, services and events defined by the associated object model on the Internet of Things platform to obtain definition information of the object model; Encapsulating the definition information to obtain the object model information of the three-dimensional component running in the scene; The object model information is serialized to obtain serialized object model information for transferring to an associated three-dimensional component.

7. The method according to claim 1, characterized in that There are multiple Internet of Things platforms that provide the three-dimensional component-associated object model, and the Internet of Things platforms are adapted to the scenarios in which the three-dimensional components are configured and operated.

8. A computer device comprising a memory, a processor and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the steps of the method according to any one of claims 1 to 7.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images