Hybrid modeling method, device and equipment

Abstract

The invention relates to the technical field of three-dimensional modeling, and discloses a hybrid modeling method, device and equipment, and the method comprises the steps: constructing a three-dimensional model for any part of a target structure in modeling software, the three-dimensional model being a grid model or a curved surface model; fusing the three-dimensional models of all the components under geometric constraints to obtain a first mixed model; flattening the first mixed model in a two-dimensional plane to obtain a two-dimensional coordinate; superposing image textures on the two-dimensional coordinates and performing data compression to obtain texture coordinates; mapping the texture coordinates to a three-dimensional space to obtain a second mixed model; and individually setting the second hybrid model, and exporting a third hybrid model of the target structure through rendering. According to the method, a systematic mixed modeling process is formed by integrating the steps of geometric modeling, seamless fusion, flattening, texture superposition, rendering and the like, the working efficiency is improved, it is ensured that the finally output model has high precision and high visual effect, and meanwhile consumption of storage and computing resources is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of three-dimensional modeling, and in particular to a hybrid modeling method, device and equipment. Background Art

[0002] In fields such as aerospace, automotive manufacturing, architectural design, and medical imaging, high-precision 3D modeling and rendering of complex structures are often required. These fields require models to not only have extremely high geometric accuracy but also to realistically reflect material properties, surface textures, and lighting effects to meet design, analysis, and visualization needs.

[0003] Depending on the characteristics of a structure, either a mesh model or a surface model can be constructed. Mesh models are suitable for representing complex, irregular structures, while surface models are more suitable for accurately describing irregular, streamlined geometries. To combine the advantages of both, hybrid models are often constructed, combining mesh and surface models to achieve more refined and flexible modeling.

[0004] However, currently, when constructing hybrid models, the fusion process between the mesh model and the surface model can leave gaps or overlaps, resulting in poor fusion and an inability for the hybrid model to accurately reflect the actual structure. Furthermore, adding high-resolution textures to the hybrid model in 3D space consumes significant computational resources. Summary of the Invention

[0005] In view of this, the present invention provides a hybrid modeling method, apparatus and device to solve the problems of poor fusion effect and high computing resource consumption in the existing hybrid modeling process.

[0006] In a first aspect, the present invention provides a hybrid modeling method, the method comprising:

[0007] In the modeling software, for any component of the target structure, a three-dimensional model of the component is constructed. The three-dimensional model is a mesh model or a surface model.

[0008] The three-dimensional models of all components are fused under geometric constraints to obtain the first hybrid model of the target structure;

[0009] Flatten the first mixed model in a two-dimensional plane to obtain corresponding two-dimensional coordinates;

[0010] Superimpose image texture on two-dimensional coordinates and perform data compression to obtain texture coordinates;

[0011] Mapping the texture coordinates to the three-dimensional space to obtain a second hybrid model;

[0012] The second hybrid model is personalized, and a third hybrid model of the target structure is derived by rendering.

[0013] The hybrid modeling method provided by an embodiment of the present invention constructs a suitable three-dimensional model for the component in the modeling software, fuses the three-dimensional models of all components under geometric constraints, generates a first hybrid model, ensures a smooth transition between the components, avoids cracks or mutations, and then flattens the three-dimensional model to a two-dimensional plane to obtain the corresponding two-dimensional coordinates to reduce computing resource consumption and facilitate subsequent texture mapping. The image texture is then superimposed on the two-dimensional coordinates and data compression is performed to generate efficient texture coordinates, giving the model rich surface details and improving visual effects while reducing file size and improving rendering and storage efficiency. The two-dimensional texture coordinates are remapped back to the three-dimensional space to form a second hybrid model with texture. Finally, personalized settings are performed and a third hybrid model of the target structure is exported after rendering. By integrating multiple steps such as geometric modeling, seamless fusion, flattening, texture superposition and rendering, a systematic hybrid modeling process is formed, which improves work efficiency and ensures that the final output model has high precision and high visual effects while reducing the consumption of storage and computing resources.

[0014] In an optional embodiment, for any component of the target structure, before building the three-dimensional model of the component, the method further includes:

[0015] For any component, build an initial model of the component, which is a mesh model or a surface model;

[0016] Determine whether to convert the initial model of the component;

[0017] In the case of converting the initial model of the component, converting the initial model to obtain a three-dimensional model of the component; or,

[0018] Without converting the initial model of the component, the initial model is used as the three-dimensional model of the component.

[0019] The hybrid modeling method provided by an embodiment of the present invention creates an initial model of a component and determines whether the initial model needs to be converted. If conversion is required, the initial model is converted into a three-dimensional model that is more suitable for the final application. If no conversion is required, the initial model is directly used as the three-dimensional model. Through selective conversion, it is ensured that the model of each component is highly matched with the design requirements, which helps to improve the model quality.

[0020] In an optional embodiment, the initial model is a grid model;

[0021] Convert the initial model to a 3D model of the component, including:

[0022] Simplify all meshes in the initial model;

[0023] Perform curve fitting based on the mesh vertices of all simplified meshes in the initial model to obtain a curve structure skeleton;

[0024] Generate multiple surfaces based on the curve structure skeleton;

[0025] Smoothing, splicing and repairing are performed on multiple surfaces to obtain a surface model, which is used as a three-dimensional model of the component.

[0026] The hybrid modeling method provided by an embodiment of the present invention simplifies the initial mesh model, reduces unnecessary vertices and facets, retains the main structural features, reduces the amount of calculation, uses the simplified mesh vertices to perform curve fitting, and generates a curved structural skeleton that can represent the appearance of the component. Based on the curved structural skeleton, multiple surface segments are generated, and the generated multiple surfaces are smoothed, spliced and repaired to ensure a smooth transition between the surfaces, and finally a complete surface model is formed. The initial mesh model is converted into a surface model, which can meet the design requirements while ensuring that the model can maintain the original geometric features.

[0027] In an optional embodiment, the initial model is a surface model;

[0028] Convert the initial model to a 3D model of the component, including:

[0029] Sampling the initial model of the component to generate multiple grid points;

[0030] generating a plurality of quadrilateral grids based on continuous grid points among the plurality of grid points;

[0031] Generate multiple mesh patches based on discrete mesh points among the multiple mesh points;

[0032] A mesh model is obtained based on the multiple quadrilateral meshes and the multiple mesh patches, and the mesh model is used as a three-dimensional model of the component. The normal vector of the three-dimensional model is consistent with the normal vector of the initial model.

[0033] The hybrid modeling method provided by an embodiment of the present invention samples the initial surface model, generates multiple discrete grid points on the surface, uses continuous grid points to generate multiple quadrilateral grids to form structured grid fragments, uses discrete grid points to generate multiple irregular grid patches to fill the blank areas on the surface, combines the generated quadrilateral grids and grid patches to form a final grid model, and converts the initial surface model to a grid model, which can meet design requirements and ensure that the normal vector of the newly generated grid model is consistent with the normal vector of the initial surface model, retaining the original geometric features.

[0034] In an optional embodiment, the three-dimensional models of all components are fused under geometric constraints to obtain a first hybrid model of the target structure, including:

[0035] Storing model parameters of the three-dimensional models of all components in a hybrid data structure;

[0036] Based on the hybrid data structure, geometric processing is performed on the three-dimensional models of all components to obtain processed three-dimensional models;

[0037] A fusion algorithm is used to geometrically match the boundaries of the three-dimensional models after all components are processed based on a hybrid data structure to obtain a first hybrid model, in which the normal vector of the mesh model is consistent with the normal vector of the surface model.

[0038] The hybrid modeling method provided by an embodiment of the present invention can conveniently manage and operate different types of three-dimensional models by storing the model parameters of the three-dimensional models of all components in a hybrid data structure. According to the information in the hybrid data structure, necessary geometric processing is performed on the three-dimensional models of all components to enable them to be better integrated. Using a fusion algorithm, based on the information stored in the hybrid data structure, the boundaries of the processed three-dimensional models of all components are geometrically matched to form a seamless whole, eliminating visible gaps or discontinuities, and at the same time ensuring that the normal vectors of the mesh model and the surface model in the first hybrid model after fusion are consistent, thereby improving the quality and reliability of the final model.

[0039] In an optional embodiment, geometric processing is performed on the three-dimensional models of all components to obtain processed three-dimensional models, including:

[0040] For any component, if the three-dimensional model of the component is a mesh model, the mesh model is simplified, smoothed, and topology is reconstructed to obtain a processed three-dimensional model;

[0041] When the three-dimensional model of the component is a surface model, the surface model is fitted, subdivided, and Boolean operated to obtain a processed three-dimensional model.

[0042] The hybrid modeling method provided by the embodiment of the present invention improves processing efficiency and flexibility, reduces unnecessary computational burden, and enhances overall performance by adopting different geometric processing methods for different types of three-dimensional models. The processed three-dimensional models have higher quality, providing a basis for subsequent fusion.

[0043] In an optional embodiment, flattening the first hybrid model in a two-dimensional plane to obtain corresponding two-dimensional coordinates includes:

[0044] Parameterizing the first hybrid model to obtain initial two-dimensional coordinates of all three-dimensional vertices in the first hybrid model on a two-dimensional plane;

[0045] Perform seamless splicing based on the initial two-dimensional coordinates to obtain splicing two-dimensional coordinates;

[0046] Optimization is performed based on the splicing of the two-dimensional coordinates to obtain the two-dimensional coordinates.

[0047] The hybrid modeling method provided by an embodiment of the present invention parameterizes the first hybrid model, that is, maps all its three-dimensional vertices to a two-dimensional plane to obtain initial two-dimensional coordinates, seamlessly splices the boundaries between different components to obtain spliced two-dimensional coordinates, and performs optimization processing based on the spliced two-dimensional coordinates to obtain final two-dimensional coordinates. The method can better preserve the geometric shape and topological structure of the three-dimensional model on the two-dimensional plane, convert the three-dimensional problem into a two-dimensional problem, facilitate subsequent geometric processing and optimization, and reduce computational complexity.

[0048] In an optional embodiment, superimposing an image texture on a two-dimensional coordinate and performing data compression to obtain texture coordinates includes:

[0049] Generate 2D parameters based on 2D coordinates;

[0050] Superimpose the two-dimensional parameters with the image texture;

[0051] The two-dimensional parameters after texture superposition are mesh simplified and texture compressed to obtain texture coordinates.

[0052] The hybrid modeling method provided by the embodiment of the present invention converts complex three-dimensional models and texture processing into efficient two-dimensional operations by generating two-dimensional parameters, superimposing image textures and performing data compression, thereby reducing unnecessary computational burdens, simplifying the processing flow, and ensuring that the final model can accurately reflect the real effect of the texture through reasonable mesh simplification and texture compression algorithms.

[0053] In a second aspect, the present invention provides a hybrid modeling device, comprising:

[0054] A first modeling module is used to construct a three-dimensional model of any component of the target structure in the modeling software, where the three-dimensional model is a mesh model or a surface model;

[0055] A fusion module is used to fuse the three-dimensional models of all components under geometric constraints to obtain a first hybrid model of the target structure;

[0056] A flattening module, configured to flatten the first hybrid model in a two-dimensional plane to obtain corresponding two-dimensional coordinates;

[0057] A compression module is used to superimpose image textures on two-dimensional coordinates and perform data compression to obtain texture coordinates;

[0058] A restoration module, configured to map the texture coordinates into a three-dimensional space to obtain a second hybrid model;

[0059] The export module is used to personalize the second hybrid model and export the third hybrid model of the target structure through rendering.

[0060] In a third aspect, the present invention provides a computer device comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the hybrid modeling method of the first aspect or any corresponding embodiment thereof by executing the computer instructions.

[0061] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the hybrid modeling method of the first aspect or any corresponding embodiment thereof.

[0062] In a fifth aspect, the present invention provides a computer program product comprising computer instructions for causing a computer to execute the hybrid modeling method of the first aspect or any corresponding embodiment thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the specific embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0064] Figure 1 is a flow chart of a hybrid modeling method according to an embodiment of the present invention;

[0065] Figure 2 is a schematic diagram of model conversion according to an embodiment of the present invention;

[0066] Figure 3 is a structural block diagram of a hybrid modeling device according to an embodiment of the present invention;

[0067] Figure 4 Schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0068] To make the purpose, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of the present invention.

[0069] At present, in the process of building a hybrid model, there may be gaps or overlaps in the fusion process of the mesh model and the surface model, resulting in poor fusion effect, which makes the hybrid model unable to accurately reflect the actual structure. In addition, when adding high-resolution textures to the hybrid model in three-dimensional space, computing resources are consumed. The hybrid modeling method provided by the embodiment of the present invention forms a systematic hybrid modeling process by integrating multiple steps such as geometric modeling, seamless fusion, flattening, texture overlay and rendering, thereby improving work efficiency, ensuring that the final output model has high precision and high visual effects, and reducing the consumption of storage and computing resources.

[0070] According to an embodiment of the present invention, an embodiment of a hybrid modeling method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0071] In this embodiment, a hybrid modeling method is provided, which can be used in a terminal, such as a computer, etc., in which modeling software is installed. Figure 1 is a flow chart of a hybrid modeling method according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0072] Step S101 : In the modeling software, for any component of the target structure, a three-dimensional model of the component is constructed. The three-dimensional model is a mesh model or a surface model.

[0073] Specifically, the modeling software supports the construction of both mesh and surface models, sharing a common editing system and configuration options for both modeling algorithms. These include global selection, movement, rotation, scaling, undo / return mechanisms, show / hide mechanisms, system snapping, and grouping / ungrouping mechanisms. Editing operations not only work on basic elements of mesh models, such as points, edges, and faces, but also on related components of surface models, such as curves, surfaces, control vertices, edit points, curves-on-surfaces, and natural edges. Because target structures typically consist of multiple components, each with varying design requirements, corresponding mesh or surface models can be constructed for each component. The geometric representations of mesh and surface models differ. Mesh models are typically represented using a mesh, which is described using data structures such as vertices, edges, and faces. Each edge consists of a set of vertices, and each face consists of a set of edges. Surface models are represented using parametric surfaces, whose shapes are precisely defined by mathematical equations. For example, when constructing a model of a complex, irregular building, the glass curtain wall structure is a smooth, hyperbolic ring shape, and a surface model is usually constructed to better represent its smooth, continuous surface. The saddle-shaped roof and foyer connected to the curtain wall have relatively simple geometric shapes, so constructing a mesh model is more efficient. When constructing a complete vehicle model, when rapid prototyping is required or when dealing with complex structures, such as the center grille, wheel hub, etc., a mesh model can be constructed. This modeling method is fast, accurate in shaping, and easy to modify. When pursuing high-precision surface quality or requiring complex surfaces, such as a streamlined body, surface modeling is used to generate a smooth, smooth, and high-precision model that meets production and processing requirements. By constructing a corresponding mesh model or surface model for each component of the target structure, support is provided for building hybrid models.

[0074] Step S102 : fusing the three-dimensional models of all components under geometric constraints to obtain a first hybrid model of the target structure.

[0075] Specifically, since each component is constructed as a separate 3D model during modeling, in order to obtain a complete 3D model of the target structure, the 3D models of all components must be fused. During fusion, 3D models of the same type generally do not have gaps, but 3D models of different types need to consider whether gaps or overlaps may occur. Embodiments of the present invention facilitate seamless fusion by introducing geometric constraints when fusing mesh models and surface models, thereby improving the fusion effect and producing an accurate hybrid model.

[0076] Step S103: flatten the first hybrid model in a two-dimensional plane to obtain corresponding two-dimensional coordinates.

[0077] Specifically, after modeling, it's often necessary to add textures to the model to simulate real-world effects. Related techniques directly add textures to hybrid models in three-dimensional space, which consumes significant computing resources. However, the present invention first flattens the first hybrid model in a two-dimensional plane without changing the topological structure of the three-dimensional model during the flattening process, thereby overlaying textures on the two-dimensional plane and reducing resource consumption.

[0078] Step S104: superimpose the image texture on the two-dimensional coordinates and perform data compression to obtain texture coordinates.

[0079] Specifically, image textures are superimposed on the two-dimensional coordinates obtained by flattening the three-dimensional model. However, two-dimensional image textures usually occupy a large storage space. Therefore, data compression is used to reduce the amount of data to reduce storage space and transmission bandwidth while maintaining visual quality.

[0080] Step S105 , mapping the texture coordinates to a three-dimensional space to obtain a second hybrid model.

[0081] Specifically, the texture coordinates with the image texture are remapped back to the three-dimensional space to obtain a second hybrid model containing texture information, thereby ensuring that the texture can be correctly attached to the three-dimensional model.

[0082] Step S106 , personalizing the second hybrid model and deriving a third hybrid model of the target structure by rendering.

[0083] Specifically, the second hybrid model is personalized, such as setting material properties and lighting conditions for the second hybrid model, and then final rendering is performed to export a high-quality third hybrid model of the target structure, which can accurately simulate the real effect of the target structure.

[0084] The hybrid modeling method provided by an embodiment of the present invention constructs a suitable three-dimensional model for the component in the modeling software, fuses the three-dimensional models of all components under geometric constraints, generates a first hybrid model, ensures a smooth transition between the components, avoids cracks or mutations, and then flattens the three-dimensional model to a two-dimensional plane to obtain the corresponding two-dimensional coordinates to reduce computing resource consumption and facilitate subsequent texture mapping. The image texture is then superimposed on the two-dimensional coordinates and data compression is performed to generate efficient texture coordinates, giving the model rich surface details and improving visual effects while reducing file size and improving rendering and storage efficiency. The two-dimensional texture coordinates are remapped back to the three-dimensional space to form a second hybrid model with texture. Finally, personalized settings are performed and a third hybrid model of the target structure is exported after rendering. By integrating multiple steps such as geometric modeling, seamless fusion, flattening, texture superposition and rendering, a systematic hybrid modeling process is formed, which improves work efficiency and ensures that the final output model has high precision and high visual effects while reducing the consumption of storage and computing resources.

[0085] In this embodiment, a hybrid modeling method is provided, which can be used for the above-mentioned terminal. The method specifically includes the following steps:

[0086] Step S201: For any component, construct an initial model of the component, where the initial model is a mesh model or a surface model.

[0087] Specifically, according to the design requirements of the component, an initial model is created for it. This initial model can be a mesh model or a surface model.

[0088] Step S202: Determine whether to convert the initial model of the component.

[0089] Specifically, based on performance, accuracy or other design considerations, it is determined whether the current initial model needs to be converted into another type of model, that is, from a mesh model to a surface model or from a surface model to a mesh model.

[0090] Step S203 : in the case of converting the initial model of the component, converting the initial model to obtain a three-dimensional model of the component.

[0091] Specifically, the above step S203 converts the initial model to obtain a three-dimensional model of the component, including:

[0092] Step S2031: The initial model is a mesh model, and all meshes in the initial model are simplified.

[0093] Specifically, if the initial model is a mesh model, the modeling software converts the mesh model into a surface model through steps S2031 to S2034. Mesh models often contain a large number of redundant vertices and facets, such as data obtained through scanning and reverse engineering. Therefore, to improve conversion efficiency, the mesh is first simplified. The mesh surface can be segmented, retaining key geometric features and deleting features that do not affect the overall shape. At the same time, the model is ensured to have no broken or duplicated faces, ensuring the accuracy of subsequent fitting.

[0094] Step S2032 : performing curve fitting based on the mesh vertices of all simplified meshes in the initial model to obtain a curve structure skeleton.

[0095] Specifically, by analyzing the distribution of the simplified mesh vertices, key modeling features are identified, and smooth lines consistent with the general shape of the mesh are fitted. The fitting process can use methods such as least squares fitting and B-spline fitting to form a structural skeleton based on NURBS (Non-Uniform Rational B-Splines) curves.

[0096] Step S2033: Generate multiple curved surfaces based on the curve structure skeleton.

[0097] Specifically, a plurality of corresponding NURBS surfaces are generated through the curve structure skeleton.

[0098] Step S2034: Smoothing, splicing, and repairing are performed based on the multiple curved surfaces to obtain a curved surface model, which is used as a three-dimensional model of the component.

[0099] Specifically, multiple NURBS surfaces are smoothed, spliced or repaired to eliminate discontinuous points or redundant control points. When processing local areas, spline curve interpolation algorithms, Laplace smoothing algorithms and other algorithms are used to gradually approximate the entire model by splicing small fragments of surfaces, thereby obtaining a surface model, which replaces the initial model as the three-dimensional model of the component.

[0100] Step S2035: The initial model is a surface model, and the initial model of the component is sampled to generate multiple grid points.

[0101] Specifically, when the initial model is a surface model, the surface model is converted into a mesh model in the modeling software through steps S2035 to S2038. The NURBS surface of the surface model is defined by a set of control points, weights, and parameterizations. The internal shape of the surface can be represented by isoparametric lines in two directions (curves running along the U and V directions of the surface). At this time, uniform sampling is performed through the intersection of the isoparametric lines to generate regular grid points. The sampling density can be adjusted by the designer according to their needs. Dense sampling will generate more vertices and faces, thereby producing a fine mesh, while sparse sampling will generate a coarser mesh.

[0102] Step S2036: Generate a plurality of quadrilateral grids based on the continuous grid points among the plurality of grid points.

[0103] Specifically, continuous grid points among the plurality of grid points obtained by sampling are connected to form grid edges, and the surfaces enclosed by the grid edges form a plurality of four-sided grids.

[0104] Step S2037: Generate multiple mesh patches based on the discrete mesh points among the multiple mesh points.

[0105] Specifically, for discrete grid points among multiple grid points, a triangulation algorithm can be used to generate a reasonable triangular grid structure, that is, a grid patch, while ensuring the quality of the grid.

[0106] Step S2038: A mesh model is obtained based on the multiple quadrilateral meshes and the multiple mesh patches, and the mesh model is used as a three-dimensional model of the component. The normal vector of the three-dimensional model is consistent with the normal vector of the initial model.

[0107] Specifically, all generated quadrilateral meshes and mesh patches are integrated to form a complete mesh model, which replaces the initial model as the 3D model of the part. The normal vectors of the resulting mesh model are consistent with those of the initial model, preserving the directional characteristics of the original surface.

[0108] In some optional embodiments, Figure 2 is a schematic diagram of model conversion according to an embodiment of the present invention, such as Figure 2 As shown, the left side is a surface model and the right side is a mesh model. Through the above steps S2031 to S2034, the surface model on the left side can be converted into the mesh model on the right side, and through the above steps S2035 to S2038, the mesh model on the right side can be converted into the surface model on the left side.

[0109] Alternatively, in step S204 , the initial model of the component is used as the three-dimensional model of the component without converting the initial model of the component.

[0110] Specifically, if the designer believes that the initial model of the component can meet the design requirements, that is, no conversion is required, the initial model can be directly used as the three-dimensional model of the component.

[0111] Step S205: In the modeling software, for any component of the target structure, a 3D model of the component is constructed. The 3D model is a mesh model or a surface model. Figure 1 Step S101 of the illustrated embodiment will not be described in detail here.

[0112] Step S206 , fusing the three-dimensional models of all components under geometric constraints to obtain a first hybrid model of the target structure.

[0113] Specifically, the above step S206 includes:

[0114] Step S2061: store the model parameters of the three-dimensional models of all components in a hybrid data structure.

[0115] Specifically, mesh models and surface models differ in their underlying data structures, so a hybrid data structure is designed into modeling software to support different geometric representations. This hybrid data structure contains basic elements such as vertices, edges, faces, and control points; the vertices, edges, faces, normals, and topology information of mesh models; and the NURBS control points, weights, and parameterized data of surface models. This hybrid data structure not only supports seamless switching between different types of geometry, but also allows only the affected geometric data to be updated when a local area of the model changes, eliminating the need to recalculate the entire model.

[0116] Step S2062 : Based on the hybrid data structure, geometric processing is performed on the three-dimensional models of all components to obtain processed three-dimensional models.

[0117] In some optional implementations, the above step S2062 includes:

[0118] Step a1: for any component, when the three-dimensional model of the component is a mesh model, simplify and smooth the mesh model and reconstruct the topology to obtain a processed three-dimensional model.

[0119] Specifically, if the component's 3D model is a mesh, methods such as edge collapse or vertex merging are used to reduce the number of cells in the mesh model to improve processing speed. Then, methods such as smoothing within the modeling software are used to remove noise from the mesh and make it smoother. For non-manifold or porous meshes, topology reconstruction algorithms are used to repair their geometric structure.

[0120] Step a2: When the three-dimensional model of the component is a surface model, fitting, subdividing and Boolean operations are performed on the surface model to obtain a processed three-dimensional model.

[0121] Specifically, if the component's 3D model is a curved surface, a smooth surface is calculated using methods such as least squares fitting or Newton's method. Subdividing the surface creates a more refined geometric structure. Boolean operations on the surface, including intersection, union, and difference, are then performed to enable the free-form construction of complex geometric shapes.

[0122] In step S2063, a fusion algorithm is used to geometrically match the boundaries of the three-dimensional models after all components are processed based on the hybrid data structure to obtain a first hybrid model, in which the normal vector of the mesh model is consistent with the normal vector of the surface model.

[0123] Specifically, seamless fusion between mesh models and surface models is a core technology for hybrid modeling. The goal of seamless fusion is to merge different 3D models without creating noticeable visual creases or geometric breaks. To achieve seamless fusion, the common boundary between the mesh model and the surface model must first be found. Geometric matching of this common boundary ensures that the mesh and surface models are aligned in space. Techniques such as nearest point search or curvature matching can be used to find the most appropriate matching points. These matching points are then calibrated, and interpolation methods such as bilinear interpolation and cubic spline interpolation are used to fine-tune the positions of the matching points so that they precisely fall on the surface boundary. The distribution of the matching points is then locally smoothed to avoid abrupt changes or discontinuities between matching points. Furthermore, a transition zone is generated at the common boundary to gradually transform the mesh into a smooth surface. This transition zone can be generated using interpolation algorithms such as linear or bilinear interpolation. Seamless fusion is achieved through geometric matching and setting transition zones, thereby obtaining the first hybrid model composed of all components, and the normal vectors of the mesh vertices of the mesh model are consistent with the normal vectors of the surface control points of the surface model, indicating that a smooth transition is achieved and sharp creases at the geometric seams are eliminated.

[0124] Step S207: flatten the first hybrid model in a two-dimensional plane to obtain corresponding two-dimensional coordinates.

[0125] Specifically, the above step S207 includes:

[0126] Step S2071 : parameterize the first hybrid model to obtain initial two-dimensional coordinates of all three-dimensional vertices in the first hybrid model on a two-dimensional plane.

[0127] Specifically, the modeling software is designed with a flattening editing module that can flatten the three-dimensional model into a two-dimensional space. This process does not change the topological structure of the three-dimensional model. The key to flattening is to maintain the topological invariance of the three-dimensional model, which means that during any geometric transformation process, the connection relationship between the vertices, edges, and faces of the model cannot be changed. First, the first hybrid model needs to be parameterized. This requires finding a flattening method that is non-overlapping and minimizes deformation so that the three-dimensional vertices can be accurately represented in the two-dimensional plane. This process can adopt progressive parameterization, Laplacian (Laplace Operator) parameterization, or disk parameterization in the modeling software. Among them, progressive parameterization is to gradually flatten the three-dimensional model through continuous iterative optimization, minimizing the deformation generated during the parameterization process; Laplacian parameterization is based on the Laplace equation and flattens by maintaining the stability of the relative positions of the mesh vertices, which can avoid extreme distortion and deformation and maintain the geometric characteristics of the original three-dimensional model; disk parameterization is suitable for models with circular boundaries. By mapping the model to a two-dimensional disk, complex three-dimensional surfaces can be flattened. The common goal of the above parameterization methods is to minimize the stretching and compression during the flattening process to avoid structural changes. At the same time, they rely on the shortest path algorithm and matrix optimization algorithm in graph theory to calculate the coordinates of each vertex in the three-dimensional model in the two-dimensional plane to obtain the initial two-dimensional coordinates.

[0128] Step S2072: Perform seamless splicing based on the initial two-dimensional coordinates to obtain spliced two-dimensional coordinates.

[0129] Specifically, since 3D surfaces are inherently non-planar, fragmentation is unavoidable during the flattening process. Therefore, a complex surface can be divided into multiple sub-regions, each of which is flattened separately. First, the boundaries of regions where fragmentation occurs during fusion are interpolated so that the flattened boundaries align as smoothly as possible in the 2D plane, minimizing visual discrepancies. Next, the flattened regions adjacent to the fragmented regions are reassembled, and the flattened structures at the fragmented regions are corrected so that these regions can be seamlessly joined in the 2D plane, resulting in the resulting joined 2D coordinates.

[0130] Step S2073: Optimize based on the spliced two-dimensional coordinates to obtain two-dimensional coordinates.

[0131] Specifically, the flattened two-dimensional coordinates need to maintain the key geometric features of the three-dimensional model, such as local details, curvature, etc. During the flattening process, in order to avoid excessive deformation of the geometric information, multiple iterative optimizations must be performed to ensure that the flattened two-dimensional coordinates can accurately retain the important features of the three-dimensional model. The above-mentioned iterative optimization process can be implemented by minimizing the distortion function in the modeling software. By defining a distortion metric function, such as area distortion, angular distortion, etc., the distortion metric function is continuously optimized during the flattening process to minimize the value of the distortion metric function. At the same time, multi-resolution processing is introduced during the flattening process. First, the low-resolution model is flattened, and then high-resolution details are gradually introduced to ensure that both large-scale and small-scale geometric features can be accurately displayed.

[0132] Step S208: superimpose the image texture on the two-dimensional coordinates and perform data compression to obtain texture coordinates.

[0133] Specifically, after flattening, each flattened vertex has a corresponding coordinate (X, Y) in the two-dimensional plane. These two-dimensional coordinates are typically normalized to the range [0, 1] to facilitate mapping image textures of any resolution. Overlaying image textures refers to applying an image texture to the original three-dimensional model surface. This typically involves blending the model's surface color, normals, and lighting information to produce a more realistic appearance. Since the three-dimensional model has been flattened into two-dimensional coordinates, the image texture can be smoothly overlaid onto the surface of the three-dimensional model by matching the pixel values in the image texture with the two-dimensional vertices using techniques such as bilinear interpolation. After overlaying the image texture, the modeling software can use various editing functions for the flattened data, such as switching between flattening points, flattening edges, and flattening planes, element selection, moving, rotating, scaling, aligning, flipping, unfolding, optimizing, cutting, and blending. In the event of stretching, compression, or overlap, the texture can be automatically unfolded or manually adjusted for precise adjustments. After achieving high-quality texture overlay, the two-dimensional image texture typically occupies a large amount of storage space, so texture compression techniques are needed to reduce the data volume. The modeling software converts texture data into frequency information through discrete cosine transform, and then quantizes the high-frequency part to obtain texture coordinates, thereby achieving a compression effect for more efficient rendering and storage.

[0134] Step S209: Map the texture coordinates to the three-dimensional space to obtain a second hybrid model. Figure 1 Step S105 of the illustrated embodiment will not be described in detail here.

[0135] Step S2010 , personalizing the second hybrid model and deriving a third hybrid model of the target structure by rendering.

[0136] Specifically, the modeling software includes a material editor that allows designers to customize material properties for the second hybrid model, such as color, texture, reflectivity, and transparency, achieving rich material rendering effects. Furthermore, the modeling software includes a lighting editor that allows designers to freely arrange lights and adjust lighting parameters to simulate real-world lighting. After the designer has set up the materials and lighting, the modeling software's rendering engine allows them to adjust rendering parameters such as rendering quality, speed, and export format as needed. The software also supports a render preview function, allowing designers to instantly view the rendering effect and export the third hybrid model of the target structure.

[0137] The hybrid modeling method provided by an embodiment of the present invention constructs a suitable three-dimensional model for the component in the modeling software, fuses the three-dimensional models of all components under geometric constraints, generates a first hybrid model, ensures a smooth transition between the components, avoids cracks or mutations, and then flattens the three-dimensional model to a two-dimensional plane to obtain the corresponding two-dimensional coordinates to reduce computing resource consumption and facilitate subsequent texture mapping. The image texture is then superimposed on the two-dimensional coordinates and data compression is performed to generate efficient texture coordinates, giving the model rich surface details and improving visual effects while reducing file size and improving rendering and storage efficiency. The two-dimensional texture coordinates are remapped back to the three-dimensional space to form a second hybrid model with texture. Finally, personalized settings are performed and a third hybrid model of the target structure is exported after rendering. By integrating multiple steps such as geometric modeling, seamless fusion, flattening, texture superposition and rendering, a systematic hybrid modeling process is formed, which improves work efficiency and ensures that the final output model has high precision and high visual effects while reducing the consumption of storage and computing resources.

[0138] In this embodiment, a hybrid modeling device is also provided, which is used to implement the above-mentioned embodiments and preferred embodiments. Details that have already been described will not be repeated. As used below, the term "module" may refer to a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation using hardware, or a combination of software and hardware, is also possible and contemplated.

[0139] This embodiment provides a hybrid modeling device, such as Figure 3 As shown, including:

[0140] The first modeling module 301 is used to construct a three-dimensional model of any component of the target structure in the modeling software. The three-dimensional model is a mesh model or a surface model.

[0141] The fusion module 302 is used to fuse the three-dimensional models of all components under geometric constraints to obtain a first hybrid model of the target structure.

[0142] The flattening module 303 is configured to flatten the first hybrid model in a two-dimensional plane to obtain corresponding two-dimensional coordinates.

[0143] The compression module 304 is used to superimpose the image texture on the two-dimensional coordinates and perform data compression to obtain texture coordinates.

[0144] The restoration module 305 is configured to map the texture coordinates to a three-dimensional space to obtain a second hybrid model.

[0145] The export module 306 is configured to personalize the second hybrid model and export a third hybrid model of the target structure by rendering.

[0146] In some optional implementations, before the first modeling module 301, the apparatus further includes:

[0147] The second modeling module is used to construct an initial model of any component, where the initial model is a mesh model or a surface model.

[0148] The judgment module is used to judge whether to convert the initial model of the component.

[0149] The conversion module is used to convert the initial model to obtain a three-dimensional model of the component when converting the initial model of the component.

[0150] Alternatively, a determination module is configured to use the initial model as the three-dimensional model of the component without converting the initial model of the component.

[0151] In some optional embodiments, the initial model is a grid model;

[0152] The conversion module includes:

[0153] Simplified elements, used to simplify all meshes in the initial model.

[0154] The fitting unit is used to perform curve fitting based on the mesh vertices of all simplified meshes in the initial model to obtain a curve structure skeleton.

[0155] The first generating unit is used to generate multiple curved surfaces based on the curve structure skeleton.

[0156] The first determining unit is used to perform smoothing, splicing and repairing based on multiple curved surfaces to obtain a curved surface model, and use the curved surface model as a three-dimensional model of the component.

[0157] In some optional embodiments, the initial model is a surface model;

[0158] The conversion module includes:

[0159] The sampling unit is used to sample the initial model of the component and generate multiple grid points.

[0160] The second generating unit is configured to generate a plurality of quadrilateral grids based on continuous grid points among the plurality of grid points.

[0161] The third generating unit is configured to generate a plurality of mesh patches based on discrete mesh points among the plurality of mesh points.

[0162] The second determining unit is used to obtain a mesh model based on the multiple quadrilateral meshes and the multiple mesh patches, and use the mesh model as a three-dimensional model of the component, wherein the normal vector of the three-dimensional model is consistent with the normal vector of the initial model.

[0163] In some optional implementations, the fusion module 302 includes:

[0164] The storage unit is used to store model parameters of the three-dimensional models of all components in a hybrid data structure.

[0165] The processing unit is used to perform geometric processing on the three-dimensional models of all components based on the hybrid data structure to obtain a processed three-dimensional model.

[0166] The fusion unit is used to use a fusion algorithm to geometrically match the boundaries of the three-dimensional models after all components are processed based on a hybrid data structure to obtain a first hybrid model, in which the normal vector of the grid model is consistent with the normal vector of the surface model.

[0167] In some optional embodiments, the processing unit includes:

[0168] The first processing subunit is configured to simplify, smooth, and reconstruct the topology of any component, if the three-dimensional model of the component is a mesh model, to obtain a processed three-dimensional model.

[0169] The second processing subunit is used for, when the three-dimensional model of the component is a surface model, performing fitting, subdivision and Boolean operations on the surface model to obtain a processed three-dimensional model.

[0170] In some optional embodiments, the flattening module 303 includes:

[0171] The parameterization unit is used to parameterize the first hybrid model to obtain initial two-dimensional coordinates of all three-dimensional vertices in the first hybrid model on a two-dimensional plane.

[0172] The splicing unit is used to perform seamless splicing based on the initial two-dimensional coordinates to obtain splicing two-dimensional coordinates.

[0173] The optimization unit is used to perform optimization based on the spliced two-dimensional coordinates to obtain the two-dimensional coordinates.

[0174] In some optional implementations, the compression module 304 includes:

[0175] The fourth generating unit is configured to generate two-dimensional parameters based on the two-dimensional coordinates.

[0176] The texture overlay unit is used to overlay the two-dimensional parameters with the image texture.

[0177] The compression unit is used to perform mesh simplification and texture compression on the two-dimensional parameters after texture superposition to obtain texture coordinates.

[0178] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0179] The hybrid modeling device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0180] The embodiment of the present invention also provides a computer device having the above Figure 3 The hybrid modeling setup shown.

[0181] See also Figure 4 , Figure 4 is a structural diagram of a computer device provided by an optional embodiment of the present invention, such as Figure 4 As shown, the computer device includes: one or more processors 10, memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components utilize different buses to communicate with each other and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in the memory or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Equally, multiple computer devices can be connected, and each device provides part of the necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 4 A processor 10 is taken as an example.

[0182] The processor 10 may be a central processing unit, a network processor, or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic, or any combination thereof.

[0183] The memory 20 stores instructions that can be executed by at least one processor 10, so as to enable at least one processor 10 to execute the method shown in the above embodiment.

[0184] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created based on the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely located relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0185] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid-state drive; the memory 20 may also include a combination of the above types of memory.

[0186] The computer device further includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30 and the output device 40 may be connected via a bus or other means. Figure 4 The bus connection is taken as an example.

[0187] The input device 30 can receive input digital or character information and generate key signal input related to user settings and function control of the computer device, such as a touch screen, a keypad, a mouse, a trackpad, a touch pad, an indicator stick, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 can include a display device, an auxiliary lighting device (e.g., an LED), and a tactile feedback device (e.g., a vibration motor). The above-mentioned display device includes but is not limited to a liquid crystal display, a light emitting diode, a display, and a plasma display. In some optional embodiments, the display device can be a touch screen.

[0188] The embodiment of the present invention also provides a computer-readable storage medium. The above-mentioned method according to the embodiment of the present invention can be implemented in hardware, firmware, or implemented as a computer code that can be recorded in a storage medium, or implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and downloaded through a network and will be stored in a local storage medium, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memory. It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor or hardware, the method shown in the above embodiment is implemented.

[0189] A portion of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the form in which the computer program instruction exists in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc. Accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium that can be accessed by the computer.

[0190] Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention. Such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A hybrid modeling method, characterized in that: The method comprises: In the modeling software, for any component of the target structure, a three-dimensional model of the component is constructed, wherein the three-dimensional model is a mesh model or a surface model; fusing the three-dimensional models of all components under geometric constraints to obtain a first hybrid model of the target structure; Flattening the first hybrid model in a two-dimensional plane to obtain corresponding two-dimensional coordinates; Superimposing an image texture on the two-dimensional coordinates and performing data compression to obtain texture coordinates; Mapping the texture coordinates to a three-dimensional space to obtain a second hybrid model; The second hybrid model is personalized, and a third hybrid model of the target structure is derived by rendering.

2. The method according to claim 1, characterized in that For any component of the target structure, before constructing the three-dimensional model of the component, the method further includes: For any component, construct an initial model of the component, wherein the initial model is a mesh model or a surface model; determining whether to convert the initial model of the component; In the case of converting the initial model of the component, converting the initial model to obtain a three-dimensional model of the component; or, Without converting the initial model of the component, the initial model is used as a three-dimensional model of the component.

3. The method according to claim 2, characterized in that The initial model is a grid model; The converting the initial model to obtain the three-dimensional model of the component includes: Simplify all meshes in the initial model; Performing curve fitting based on mesh vertices of all simplified meshes in the initial model to obtain a curve structure skeleton; generating a plurality of curved surfaces based on the curved structure skeleton; Smoothing, splicing and repairing are performed on the multiple curved surfaces to obtain a curved surface model, which is used as a three-dimensional model of the component.

4. The method according to claim 2, characterized in that The initial model is a surface model; The converting the initial model to obtain the three-dimensional model of the component includes: Sampling the initial model of the component to generate a plurality of grid points; generating a plurality of quadrilateral grids based on continuous grid points among the plurality of grid points; generating a plurality of mesh patches based on discrete mesh points among the plurality of mesh points; A mesh model is obtained based on the multiple quadrilateral meshes and the multiple mesh facets, and the mesh model is used as a three-dimensional model of the component. The normal vector of the three-dimensional model is consistent with the normal vector of the initial model.

5. The method according to claim 1, wherein The fusing of the three-dimensional models of all components under geometric constraints to obtain a first hybrid model of the target structure includes: Storing model parameters of the three-dimensional models of all components in a hybrid data structure; Based on the hybrid data structure, geometrically processing the three-dimensional models of all components to obtain processed three-dimensional models; A fusion algorithm is used to geometrically match the boundaries of the three-dimensional models after processing all components based on the hybrid data structure to obtain the first hybrid model, in which the normal vector of the mesh model is consistent with the normal vector of the surface model.

6. The method according to claim 5, characterized in that The three-dimensional models of all components are geometrically processed to obtain processed three-dimensional models, including: For any component, if the three-dimensional model of the component is a mesh model, simplifying, smoothing and reconstructing the topology of the mesh model to obtain a processed three-dimensional model; In the case that the three-dimensional model of the component is a curved surface model, fitting, subdivision and Boolean operation are performed on the curved surface model to obtain a processed three-dimensional model.

7. The method according to claim 1, characterized in that Flattening the first hybrid model in a two-dimensional plane to obtain corresponding two-dimensional coordinates includes: Parameterizing the first hybrid model to obtain initial two-dimensional coordinates of all three-dimensional vertices in the first hybrid model on a two-dimensional plane; Perform seamless splicing based on the initial two-dimensional coordinates to obtain splicing two-dimensional coordinates; Optimization is performed based on the spliced two-dimensional coordinates to obtain the two-dimensional coordinates.

8. The method according to claim 1, characterized in that The step of superimposing an image texture on the two-dimensional coordinates and performing data compression to obtain texture coordinates includes: generating two-dimensional parameters based on the two-dimensional coordinates; Superimposing the two-dimensional parameters with the image texture; The two-dimensional parameters after texture superposition are mesh simplified and texture compressed to obtain the texture coordinates.

9. A hybrid modeling device, characterized in that: The device comprises: A first modeling module is used to construct a three-dimensional model of any component of the target structure in the modeling software, wherein the three-dimensional model is a mesh model or a surface model; a fusion module, configured to fuse the three-dimensional models of all components under geometric constraints to obtain a first hybrid model of the target structure; a flattening module, configured to flatten the first hybrid model in a two-dimensional plane to obtain corresponding two-dimensional coordinates; A compression module, configured to superimpose an image texture on the two-dimensional coordinates and perform data compression to obtain texture coordinates; A restoration module, configured to map the texture coordinates to a three-dimensional space to obtain a second hybrid model; An export module is used to personalize the second hybrid model and export a third hybrid model of the target structure by rendering.

10. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the hybrid modeling method according to any one of claims 1 to 8 by executing the computer instructions.

Images