A three-dimensional scene welding method for digital twinning

By interacting with the model library, spline welding module, and terrain welding module, and using terrain parameters to render 3D scenes, the problem of long development cycles and inability to adapt to dynamic changes in existing technologies is solved, and 3D scenes that can be generated quickly and dynamically are supported are realized.

CN117671154BActive Publication Date: 2026-06-19ZHEJIANG UNIV

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
ZHEJIANG UNIV
Filing Date
2023-12-13
Publication Date
2026-06-19

AI Technical Summary

Technical Problem

Existing digital twin technology is time-consuming to develop in a customized manner and cannot be reused, failing to meet the needs of dynamically changing physical entity scenarios such as rivers.

Method used

By interacting with the model library, spline welding module, and terrain welding module, and utilizing the latitude, longitude, and altitude information in the terrain parameters, the system dynamically renders 3D scenes, enabling rapid generation and dynamic changes of 3D scenes.

Benefits of technology

It reduces the development cycle, improves the efficiency of 3D scene generation, can adapt to the needs of dynamically changing physical entity scenes, and provides faster development and interaction support.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117671154B_ABST
    Figure CN117671154B_ABST
Patent Text Reader

Abstract

This invention discloses a three-dimensional scene welding method for digital twins, belonging to the field of computer technology. The specific process is as follows: a scene model object is selected from a model library; the model library exposes a public interface, which interacts with a spline welding module and a terrain welding module; several terrain parameters are acquired, each including latitude, longitude, and altitude information; the quantity of latitude and longitude information in each terrain parameter is determined, and rendering is performed on different three-dimensional scenes based on the determination result; when all terrain parameters have been traversed, the corresponding three-dimensional scenes are rendered, thus achieving three-dimensional scene welding. This invention utilizes the spline welding module and the terrain welding module to quickly construct and reproduce scenes, saving significant development time in the field of digital twins, allowing researchers to better focus on the development of computational models while reducing the proportion of front-end (client) development.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the field of computer technology, and specifically relates to a three-dimensional scene welding method for digital twins. Background Technology

[0002] Digital twins are virtual models of physical entities created digitally. They simulate the behavior of these physical entities in the real world using data, and through virtual-real interaction, data fusion analysis, and iterative decision optimization, add or expand new capabilities to the physical entities. As a technology that fully utilizes models, data, intelligence, and integrates multiple disciplines, digital twins serve as a bridge between the physical and information worlds throughout the entire product lifecycle, providing more real-time, efficient, and intelligent services.

[0003] Customized development solutions are often used when building digital twins, but these solutions require a long development cycle, and the twin system scenarios under development cannot be reused. Moreover, they cannot meet the requirements of certain specific tasks. For example, rivers in water conservancy systems are often dynamic and change in location and shape over time. Summary of the Invention

[0004] The purpose of this invention is to solve the problems existing in the prior art and to provide a three-dimensional scene welding method for digital twins.

[0005] The specific technical solution adopted in this invention is as follows:

[0006] A welding method for a 3D scene in digital twins includes the following steps:

[0007] S1. Select the set scene model object from the model library. The model library exposes a public interface, which interacts with the spline welding module and the terrain welding module for data exchange.

[0008] S2. Obtain several terrain parameters, each including latitude, longitude, and altitude information; determine the amount of latitude and longitude information in each terrain parameter, and perform rendering on different 3D scenes based on the determination result:

[0009] When each terrain parameter contains latitude and longitude information, each terrain parameter is passed to the terrain welding module through the public interface, and the terrain welding module is used to perform rendering on each terrain feature scene.

[0010] When each terrain parameter contains two or more latitude and longitude information, each terrain parameter is passed to the spline welding module through the public interface, and the spline welding module is used to perform rendering on each spline feature scene.

[0011] S3. Once all terrain parameters have been traversed, the corresponding 3D scene rendering is complete, thus achieving 3D scene welding.

[0012] Preferably, the model library construction process is as follows:

[0013] S11. Use 3D modeling tools to create several different scene model objects of different types;

[0014] S12. Classify and number the scene model objects of different types for different scenarios, and design the data structure for each scene model object. The data structure for each scene model object includes the scene model object's attributes, name, type, and preview image.

[0015] S13. Design the model library interface, which consists of a card list and a type selection button; the card list is used to display a preview image of each scene model object, and the type selection button is used to filter the entries of each scene model object displayed in the card list.

[0016] S14. Construct a public interface for the model library, which includes a query interface and an retrieval interface; wherein, the query interface takes the type of each scene model object as input and returns a list of scene model objects of the same scene but different types; the retrieval interface takes the number parameter of each scene model object as input and returns the attributes of each scene model object.

[0017] Preferably, the terrain parameters are a two-dimensional parsed array of JSON with terrain numbers.

[0018] Preferably, the specific process of the spline welding module is as follows:

[0019] First, each terrain parameter and each scene model object number parameter are passed to the spline welding module. The scene model object number parameter is used to obtain the corresponding scene model object.

[0020] The position of the spline points is set by the input terrain parameters. Each array index of the terrain parameter corresponds to each spline point. Each spline point is connected sequentially by the array index of each terrain parameter to form a master spline curve corresponding to each terrain parameter.

[0021] Using the spline welding method, each final spline curve is obtained from each master spline curve; using the scene model object number parameter, a call is made to the model library acquisition interface to obtain the scene model object corresponding to the number;

[0022] Calculate the length, width, and height of the scene model objects, and divide the length of each final spline curve by the length of each scene model object to obtain the number of spline scene model objects that each final spline curve can fill.

[0023] The number of spline scene model objects is used to fill each scene model object along each corresponding final spline curve in any way through a loop, thereby realizing the spline feature scene rendering at the connection point.

[0024] Preferably, the specific process of the spline welding method is as follows:

[0025] The first latitude and longitude information in each terrain parameter is used as the head of each master spline curve, and the last latitude and longitude information in each terrain parameter is used as the tail of each master spline curve. The head and tail are connected and extended. The direction of the extension line of the head and the tail is used as the baseline. A transparent cylindrical collision object of fixed length is placed on the left and right sides and in front of the baseline, forming a preset angle with the baseline. The transparent cylindrical collision object does not need to be rendered. The transparent cylindrical collision object corresponds to the same type as each master spline curve.

[0026] Determine whether the type of the transparent cylindrical colliding object is consistent with the type of each scene model object, and obtain the final spline curve based on the determination result:

[0027] When the type of the transparent cylindrical collision object is consistent with the type of each scene model object, the transparent cylindrical collision object is associated with each scene model object through one or more collisions. At the collision position, multiple associated splines corresponding to each master spline curve are generated. The tangent and height of each master spline curve at the collision position are obtained. The tangent and height of each associated spline corresponding to each master spline curve at the collision position are obtained. Each master spline curve and its corresponding multiple associated splines are interpolated and connected at the collision position to obtain each final spline curve.

[0028] When the type of the transparent cylindrical collision object is inconsistent with the type of each scene model object, the transparent cylindrical collision object will not collide with each scene model object, and each master spline curve will be used as each final spline curve.

[0029] Preferably, the preset angle is set to 60 degrees.

[0030] Preferably, the fixed length is set to 3 meters.

[0031] Preferably, the specific process of the terrain welding module is as follows:

[0032] First, each terrain parameter and each scene model object number parameter are passed to the terrain welding module. Then, using the terrain stitching method, rendering is performed on each terrain feature scene. This process iterates through each terrain feature scene to ultimately render the complete terrain feature scene. The specific process of the terrain stitching method is as follows:

[0033] Read each terrain parameter, determine whether each terrain parameter contains height information, and perform rendering on each terrain feature scene based on the determination result:

[0034] When the terrain parameters contain both latitude and longitude information and height information, the model library acquisition interface is called using the scene model object number parameter to obtain the scene model object corresponding to the number. The scene model object is placed at the position corresponding to the latitude and longitude information, the scene model object is stretched according to the height information, and rendering is performed on each terrain feature scene.

[0035] When the terrain parameters only contain latitude and longitude information but not height information, the model library acquisition interface is called using the scene model object number parameter to obtain the scene model object corresponding to the number, and a scene model object of fixed height is placed at the position corresponding to the latitude and longitude information to perform rendering for each terrain feature scene.

[0036] When the terrain parameters contain only altitude information and not latitude and longitude information, the terrain parameters are considered corrupted and no rendering is required.

[0037] Preferably, the fixed height is set to zero.

[0038] Compared with the prior art, the present invention has the following advantages:

[0039] This invention is based on terrain parameter data. Utilizing the latitude, longitude, and altitude information within this data, it interacts with the spline welding module and the terrain welding module through a public interface exposed by the model library. This allows the spline welding module and the terrain welding module to retrieve the corresponding scene model object from the model library using the object number parameter for each scene model, creating scene model objects in 3D space, rendering terrain feature scenes and spline feature scenes, and dynamically generating 3D scenes. Compared to existing customized development methods, this reduces the development cycle, allowing researchers to focus on developing computational models, while also providing technical support for scenes where the twin needs to dynamically change. Attached Figure Description

[0040] Figure 1 This is a flowchart illustrating a 3D scene welding method for digital twins. Detailed Implementation

[0041] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Many specific details are set forth in the following description to provide a thorough understanding of the present invention. However, the present invention can be practiced in many other ways different from those described herein, and those skilled in the art can make similar modifications without departing from the spirit of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below. Technical features in the various embodiments of the present invention can be combined accordingly without mutual conflict.

[0042] In a preferred embodiment of the present invention, such as Figure 1 The diagram illustrates the workflow of a 3D scene welding method for user digital twins provided by this invention. This method mainly includes a model library, a spline welding module, and a terrain welding module. The model library manages scene model objects used in the 3D scene; the spline welding module uses scene model objects from the model library to weld and fuse spline features of the scene; and the terrain welding module uses terrain model objects from the model library to dynamically construct the scene terrain. Finally, it can be connected to the Unreal Engine client as a front-end for user interaction.

[0043] S1. Select the set scene model object from the model library. The model library exposes a public interface, which interacts with the spline welding module and the terrain welding module for data exchange.

[0044] It should be noted that, in this embodiment, the model library includes several scene model objects commonly used by the system. The data structure of each scene model object includes the scene model object's attributes, name, type, and preview image. The model library interface is used to interact with the user, and the model library exposes a public interface for data interaction with the spline welding module and the terrain welding module.

[0045] It should be noted that the model library construction process described above in this invention is as follows:

[0046] S11. Use 3D modeling tools to create several commonly used scene model objects of different types.

[0047] It should be noted that, in the embodiments of the present invention, several commonly used scene model objects of different types are created using 3D model creation tools. Specifically, these include: water scene model objects, sluice gate scene model objects, and scene model objects of various terrains, which belong to different scenes and different types; artificial river scene model objects and mud river scene model objects, which belong to the same scene but different types; in addition, scene model objects of various terrains, such as river terrain scene model objects, mountain road terrain scene model objects, and flat area terrain scene model objects, which also belong to the same scene but different types.

[0048] S12. Classify and number the scene model objects of different scenarios and types, and design the data structure for each scene model object. The data structure for each scene model object includes the scene model object's attributes, name, type, and preview image.

[0049] S13. Design the model library interface, which consists of a card-style list and a type selection button. The card-style list is used to display a preview image of each scene model object, and the type selection button is used to filter the entries of each scene model object displayed in the card list.

[0050] S14. Construct a public interface for the model library, which includes a query interface and a retrieval interface; wherein, the query interface takes the type of each scene model object as input, and the query interface returns a list of scene model objects of the same scene but different types; the retrieval interface takes the ID parameter of each scene model object as input, and the retrieval interface returns the attributes of each scene model object.

[0051] S2. Obtain several terrain parameters, each including latitude, longitude, and altitude information; determine the amount of latitude and longitude information in each terrain parameter, and perform rendering on different 3D scenes based on the determination result:

[0052] When each terrain parameter contains latitude and longitude information, the public interface passes each terrain parameter to the terrain welding module, which then performs rendering on each terrain feature scene.

[0053] When each terrain parameter contains two or more latitude and longitude information, each terrain parameter is passed to the spline welding module through the public interface, and the spline welding module is used to perform rendering on each spline feature scene.

[0054] It should be noted that each terrain parameter is a two-dimensional JSON parsed array with a terrain number. Each terrain parameter contains latitude, longitude and altitude information, dividing the three-dimensional scene into several square regions with fixed length and width, and numbering these square regions, which are called terrain numbers.

[0055] It should be noted that, in this embodiment, the specific process of the above-mentioned spline welding module is as follows:

[0056] First, each terrain parameter and each scene model object number parameter are passed to the spline welding module. The scene model object number parameter is used to obtain the corresponding scene model object.

[0057] The positions of spline points are set by the input terrain parameters. Each array index of the terrain parameter corresponds to each spline point. Each spline point is connected sequentially by the array index of each terrain parameter to form a master spline curve corresponding to each terrain parameter. That is, the connection order of the spline points corresponds to the array index (subscript order) of each terrain parameter.

[0058] Using the spline welding method, each final spline curve is obtained from each master spline curve; using the scene model object number parameter, a call is made to the model library's acquisition interface to obtain the scene model object corresponding to the number.

[0059] Calculate the length, width, and height of the scene model objects, and divide the length of each final spline curve by the length of each scene model object to obtain the number of spline scene model objects that each final spline curve can fill.

[0060] The number of spline scene model objects is used to fill each scene model object along each corresponding final spline curve in any way through a loop, thereby rendering the spline feature scene (such as river, pipeline, highway, etc.) at the associated location.

[0061] It should be noted that the specific process of the spline welding method in this embodiment of the invention is as follows:

[0062] The first latitude and longitude information in each terrain parameter is used as the head of each master spline curve, and the last latitude and longitude information in each terrain parameter is used as the tail of each master spline curve. The head and tail are connected and extended. The direction of the extension line of the head and tail is used as the baseline. A transparent cylindrical collision object of fixed length is placed on the left and right sides and in front of the baseline, forming a preset angle with the baseline. The transparent cylindrical collision objects do not need to be rendered. The transparent cylindrical collision objects correspond to the same type as each master spline curve.

[0063] Determine whether the type of the transparent cylindrical colliding object matches the type of each scene model object, and obtain the final spline curve based on the determination result:

[0064] When the type of the transparent cylindrical collision object is consistent with the type of each scene model object, the transparent cylindrical collision object is associated with each scene model object through one or more collisions. At the collision position, multiple associated splines corresponding to each master spline curve are generated. The tangent and height of each master spline curve at the collision position (at its own associated node) are obtained. The tangent and height of each associated spline corresponding to each master spline curve at the collision position (at the connected object node) are obtained. Each master spline curve and its corresponding multiple associated splines are interpolated and connected at the collision position to achieve a relatively smooth spline curve, which is used as each final spline curve.

[0065] When the type of the transparent cylindrical collision object is inconsistent with the type of each scene model object, the transparent cylindrical collision object will not collide with each scene model object, and each master spline curve will be used as each final spline curve.

[0066] It should be noted that, in this invention, the above-mentioned preset angle can be set by those skilled in the art according to the actual situation. In this embodiment, the above-mentioned preset angle is set to 60 degrees.

[0067] It should be noted that, in this invention, the above-mentioned fixed length can be set by those skilled in the art according to the actual situation. In this embodiment, the above-mentioned fixed length is set to 3 meters.

[0068] It should be noted that, in this embodiment, the specific process of the above-mentioned terrain welding module is as follows:

[0069] First, each terrain parameter and each scene model object number parameter are passed to the terrain welding module. Then, the terrain stitching method is used to render each terrain feature scene. By traversing each terrain feature scene, the complete terrain feature scene is finally rendered.

[0070] It should be noted that, in this embodiment of the invention, the specific process of the above-mentioned terrain stitching method is as follows:

[0071] Read each terrain parameter, determine whether each terrain parameter contains height information, and perform rendering on each terrain feature scene based on the determination result:

[0072] When the terrain parameters contain both latitude and longitude information and height information, the system calls the model library's acquisition interface using the scene model object number parameter to obtain the scene model object corresponding to the number. The scene model object is then placed at the position corresponding to the latitude and longitude information. The scene model object is stretched according to the height information. Terrain creation and stitching are performed for each terrain feature scene, and rendering is then executed.

[0073] When the terrain parameters only contain latitude and longitude information but not height information, the system calls the model library's acquisition interface using the scene model object number parameter to obtain the scene model object corresponding to the number. The system then places the scene model object at a fixed height at the position corresponding to the latitude and longitude information, creates and stitches the terrain for each terrain feature scene, and performs rendering.

[0074] When the terrain parameters contain only altitude information and not latitude and longitude information, the terrain parameters are considered corrupted and no rendering is required.

[0075] It should be noted that, in this invention, the above-mentioned fixed height can be set by those skilled in the art according to the actual situation. In this embodiment, the above-mentioned height is set to zero.

[0076] The embodiments described above are merely preferred embodiments of the present invention and are not intended to limit the invention. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, all technical solutions obtained through equivalent substitution or transformation fall within the protection scope of the present invention.

Claims

1. A three-dimensional scene welding method for digital twinning, characterized by, Includes the following steps: S1. Select the set scene model object from the model library. The model library exposes a public interface, which interacts with the spline welding module and the terrain welding module for data exchange. S2. Obtain several terrain parameters, each including latitude, longitude, and altitude information; determine the amount of latitude and longitude information in each terrain parameter, and perform rendering on different 3D scenes based on the determination result: When each terrain parameter contains latitude and longitude information, each terrain parameter is passed to the terrain welding module through the public interface, and the terrain welding module is used to perform rendering on each terrain feature scene. When each terrain parameter contains two or more latitude and longitude information, each terrain parameter is passed to the spline welding module through the public interface, and the spline welding module is used to perform rendering on each spline feature scene. S3. Once all terrain parameters have been traversed, the corresponding 3D scene rendering is complete, thus achieving 3D scene welding. The specific process of the spline welding module is as follows: First, each terrain parameter and each scene model object number parameter are passed to the spline welding module. The scene model object number parameter is used to obtain the corresponding scene model object. The position of the spline points is set by the input terrain parameters. The array index of each terrain parameter corresponds to each spline point. The array index of each terrain parameter is connected to each spline point in sequence to form a master spline curve corresponding to each terrain parameter. Using the spline welding method, each final spline curve is obtained from each master spline curve; using the scene model object number parameter, a call is made to the model library acquisition interface to obtain the scene model object corresponding to the number; Calculate the length, width, and height of the scene model objects, and divide the length of each final spline curve by the length of each scene model object to obtain the number of spline scene model objects that each final spline curve can fill. The number of spline scene model objects is used to fill each scene model object along each corresponding final spline curve in any way through a loop, thereby realizing the spline feature scene rendering at the connection point.

2. The three-dimensional scene welding method for digital twinning of claim 1, wherein, The model library construction process is as follows: S11. Use 3D modeling tools to create several different scene model objects of different types; S12. Classify and number the scene model objects of different types for different scenarios, and design the data structure for each scene model object. The data structure for each scene model object includes the scene model object's attributes, name, type, and preview image. S13. Design the model library interface, which consists of a card list and a type selection button; the card list is used to display a preview image of each scene model object, and the type selection button is used to filter the entries of each scene model object displayed in the card list. S14. Construct a public interface for the model library, which includes a query interface and an retrieval interface; wherein, the query interface takes the type of each scene model object as input and returns a list of scene model objects of the same scene but different types; the retrieval interface takes the number parameter of each scene model object as input and returns the attributes of each scene model object.

3. The method of claim 1, wherein, The terrain parameters are two-dimensional parsed arrays of JSON with terrain numbers.

4. The method of claim 1, wherein, The specific process of the spline welding method is as follows: The first latitude and longitude information in each terrain parameter is used as the head of each master spline curve, and the last latitude and longitude information in each terrain parameter is used as the tail of each master spline curve. The head and tail are connected and extended. The direction of the extension line of the head and the tail is used as the baseline. A transparent cylindrical collision object of fixed length is placed on the left and right sides and in front of the baseline, forming a preset angle with the baseline. The transparent cylindrical collision object does not need to be rendered. The transparent cylindrical collision object corresponds to the same type as each master spline curve. Determine whether the type of the transparent cylindrical colliding object is consistent with the type of each scene model object, and obtain the final spline curve based on the determination result: When the type of the transparent cylindrical collision object is consistent with the type of each scene model object, the transparent cylindrical collision object is associated with each scene model object through one or more collisions. At the collision position, multiple associated splines corresponding to each master spline curve are generated. The tangent and height of each master spline curve at the collision position are obtained. The tangent and height of each associated spline corresponding to each master spline curve at the collision position are obtained. Each master spline curve and its corresponding multiple associated splines are interpolated and connected at the collision position to obtain each final spline curve. When the type of the transparent cylindrical collision object is inconsistent with the type of each scene model object, the transparent cylindrical collision object will not collide with each scene model object, and each master spline curve will be used as each final spline curve.

5. A three-dimensional scene welding method for digital twinning according to claim 4, characterized in that, The preset angle is set to 60 degrees.

6. The three-dimensional scene welding method for digital twinning of claim 4, wherein, The fixed length is set at 3 meters.

7. The three-dimensional scene welding method for digital twinning of claim 1, wherein, The specific process of the terrain welding module is as follows: First, each terrain parameter and each scene model object number parameter are passed to the terrain welding module. Then, using the terrain stitching method, rendering is performed on each terrain feature scene. This process iterates through each terrain feature scene to ultimately render the complete terrain feature scene. The specific process of the terrain stitching method is as follows: Read each terrain parameter, determine whether each terrain parameter contains height information, and perform rendering on each terrain feature scene based on the determination result: When the terrain parameters contain both latitude and longitude information and height information, the model library acquisition interface is called using the scene model object number parameter to obtain the scene model object corresponding to the number. The scene model object is placed at the position corresponding to the latitude and longitude information, the scene model object is stretched according to the height information, and rendering is performed on each terrain feature scene. When the terrain parameters only contain latitude and longitude information but not height information, the model library acquisition interface is called using the scene model object number parameter to obtain the scene model object corresponding to the number, and a scene model object of fixed height is placed at the position corresponding to the latitude and longitude information to perform rendering for each terrain feature scene. When the terrain parameters contain only altitude information and not latitude and longitude information, the terrain parameters are considered corrupted and no rendering is required.

8. The three-dimensional scene welding method for digital twinning of claim 7, wherein, The fixed height is set to zero.