Three-dimensional structured model texture rendering method, device and computer equipment

By screening the perspective, projection area and line of sight occlusion relationships in the real scene model in a multi-dimensional way, the target rendered image is determined for structured model mapping, which solves the problem of texture deformation after real scene model simplification, and improves the accuracy and visualization effect of the map.

CN118657867BActive Publication Date: 2024-11-12GUANGDONG LAB OF ARTIFICIAL INTELLIGENCE & DIGITAL ECONOMY (SZ) +1
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202411143075.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-20
Publication Date
2024-11-12
Estimated Expiration
2044-08-20

AI Technical Summary

Technical Problem

In model mapping technology, the geometric outline changes in the real scene model during simplification process lead to texture deformation during structured model mapping, reducing the visualization effect.

Method used

By obtaining rendered images from multiple perspectives in the real scene model, multi-dimensional filtering is performed based on the perspective, projection area and line of sight occlusion relationships, the target rendered image is determined to accurately map, ensuring the consistency and accuracy of textures.

Benefits of technology

It improves the accuracy and visualization of structured model maps, reduces texture deformation, and enhances the visual performance of the model.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118657867B_ABST
    Figure CN118657867B_ABST
Patent Text Reader

Abstract

The present application relates to the field of model mapping technology, and in particular to a three-dimensional structured model mapping rendering method, device and computer equipment. The method includes: obtaining rendering images corresponding to each viewing angle in a real scene model; screening and obtaining a first reference rendering image set of each surface according to the angle relationship between the viewing angle corresponding to the rendering image and the corresponding structured model surface; screening and obtaining a second reference rendering image set of each surface according to the projection area relationship between the rendering image and the corresponding structured model surface; screening and obtaining a third reference rendering image set of each surface according to the line of sight occlusion relationship between the viewpoint corresponding to the rendering image and the corresponding structured model surface; determining the target rendering image and obtaining the texture of the corresponding structured model surface, and mapping the structured model based on the texture corresponding to each structured model surface. The present method can accurately map the structured model.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of model mapping technology, and in particular to a three-dimensional structured model mapping rendering method, device, computer equipment, computer-readable storage medium and computer program product. Background Art

[0002] In the field of model mapping technology, it involves simplifying the details of a real-scene model, and then mapping the simplified structured model to obtain the mapped structured model.

[0003] However, during the simplification process, the geometric outline of the real-scene model changes. When mapping the simplified structured model, texture deformation is more likely to occur, thereby reducing the visualization effect of the structured model. Summary of the invention

[0004] Based on this, it is necessary to provide a three-dimensional structured model mapping rendering method, device, computer equipment, computer-readable storage medium and computer program product that can efficiently and accurately map the structured model in order to solve the above technical problems.

[0005] In a first aspect, the present application provides a three-dimensional structured model texture rendering method, comprising:

[0006] Acquire a structured model to be mapped and a real scene model corresponding to the structured model to be mapped;

[0007] A rendering image corresponding to each viewing angle is obtained in the real scene model; each structured model surface of the structured model corresponds to a plurality of viewing angles;

[0008] According to the angle relationship between the viewing angles corresponding to the respective rendered images and the corresponding structured model surfaces, a first reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0009] According to the relationship between the projection area of ​​each rendering image and the corresponding structured model surface, a second reference rendering image set corresponding to each structured model surface is screened from the rendering images;

[0010] According to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0011] Based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set and the third reference rendering image set for each structured model surface, a target rendering image corresponding to each structured model surface is determined, a texture of the corresponding structured model surface is obtained according to the target rendering image, and the structured model to be mapped is mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, the target rendering image whose viewing angle is closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0012] In one of the embodiments, the method further includes: if the target structured model surface does not match the corresponding target rendered image, obtaining a new viewing angle within a preset viewing angle range corresponding to the target structured model surface; based on the new viewing angle, obtaining a new rendered image in the real scene model, and re-screening the new rendered image until the target rendered image corresponding to the target structured model surface is obtained.

[0013] In one of the embodiments, according to the angular relationship between the viewing angle corresponding to each rendered image and the corresponding structured model surface, a first reference rendered image set corresponding to each structured model surface is screened from the respective rendered images, including: obtaining reference lines corresponding to each structured model surface; the reference lines are used to characterize the orientation of the structured model surface; according to the angular difference between the viewing angle corresponding to each rendered image and the reference lines of the corresponding structured model surface, the rendered image whose angular difference satisfies the corresponding threshold condition is used as the rendered image in the first reference rendered image set corresponding to the structured model surface.

[0014] In one of the embodiments, according to the relationship between the projection area of ​​each rendered image and the corresponding structured model surface, a second reference rendered image set corresponding to each structured model surface is screened from the various rendered images, including: obtaining the projection image of each structured model surface on the corresponding reference surface; the reference surface is used to characterize the projection position and projection direction of the structured model surface; according to the contour difference between each rendered image and the projection image of the corresponding structured model surface, the rendered image whose contour difference meets the corresponding threshold condition is used as the rendered image in the second reference rendered image set of the corresponding structured model surface.

[0015] In one of the embodiments, according to the line of sight occlusion relationship between the viewpoints corresponding to each rendered image and the corresponding structured model surface, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images, including: obtaining detection points on each structured model surface and viewpoints of the corresponding viewing angles of each rendered image; according to the line of sight occlusion results between the viewpoints corresponding to each rendered image and the detection points of the corresponding structured model surface, a rendered image whose line of sight occlusion result satisfies a corresponding threshold condition is used as a rendered image in the third reference rendered image set of the corresponding structured model surface.

[0016] In one of the embodiments, the obtaining of the structured model to be mapped and the real-scene model corresponding to the structured model to be mapped includes: obtaining the plane coverage corresponding to the structured model to be mapped on a reference plane; obtaining the global real-scene model, and dividing the real-scene model corresponding to the structured model to be mapped in the global real-scene model according to the plane coverage corresponding to the structured model to be mapped.

[0017] In a second aspect, the present application also provides a three-dimensional structured model texture rendering device, comprising:

[0018] A first acquisition module is used to acquire a structured model to be mapped and a real scene model corresponding to the structured model to be mapped;

[0019] A second acquisition module is used to obtain rendering images corresponding to each viewing angle in the real scene model; each structured model surface of the structured model corresponds to multiple viewing angles;

[0020] A first screening module is used to screen and obtain a first reference rendering image set corresponding to each structured model surface from each rendering image according to the angular relationship between the viewing angle corresponding to each rendering image and the corresponding structured model surface;

[0021] A second screening module is used to screen and obtain a second reference rendering image set corresponding to each structured model surface from each rendering image according to the relationship between each rendering image and the projection area of ​​the corresponding structured model surface;

[0022] A third screening module is used to screen and obtain a third reference rendering image set corresponding to each structured model surface from each rendered image according to the line of sight occlusion relationship between the viewpoint corresponding to each rendered image and the corresponding structured model surface;

[0023] A mapping module is used to determine the target rendering image corresponding to each structured model surface based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set, and the third reference rendering image set for each structured model surface, obtain the texture of the corresponding structured model surface according to the target rendering image, and map the structured model to be mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, then the target rendering image with a viewing angle closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0024] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0025] Acquire a structured model to be mapped and a real scene model corresponding to the structured model to be mapped;

[0026] A rendering image corresponding to each viewing angle is obtained in the real scene model; each structured model surface of the structured model corresponds to a plurality of viewing angles;

[0027] According to the angle relationship between the viewing angles corresponding to the respective rendered images and the corresponding structured model surfaces, a first reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0028] According to the relationship between the projection area of ​​each rendering image and the corresponding structured model surface, a second reference rendering image set corresponding to each structured model surface is screened from the rendering images;

[0029] According to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0030] Based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set and the third reference rendering image set for each structured model surface, a target rendering image corresponding to each structured model surface is determined, a texture of the corresponding structured model surface is obtained according to the target rendering image, and the structured model to be mapped is mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, the target rendering image whose viewing angle is closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0031] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0032] Acquire a structured model to be mapped and a real scene model corresponding to the structured model to be mapped;

[0033] A rendering image corresponding to each viewing angle is obtained in the real scene model; each structured model surface of the structured model corresponds to a plurality of viewing angles;

[0034] According to the angle relationship between the viewing angles corresponding to the respective rendered images and the corresponding structured model surfaces, a first reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0035] According to the relationship between the projection area of ​​each rendering image and the corresponding structured model surface, a second reference rendering image set corresponding to each structured model surface is screened from the rendering images;

[0036] According to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0037] Based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set and the third reference rendering image set for each structured model surface, a target rendering image corresponding to each structured model surface is determined, a texture of the corresponding structured model surface is obtained according to the target rendering image, and the structured model to be mapped is mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, the target rendering image whose viewing angle is closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0038] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0039] Acquire a structured model to be mapped and a real scene model corresponding to the structured model to be mapped;

[0040] A rendering image corresponding to each viewing angle is obtained in the real scene model; each structured model surface of the structured model corresponds to a plurality of viewing angles;

[0041] According to the angle relationship between the viewing angles corresponding to the respective rendered images and the corresponding structured model surfaces, a first reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0042] According to the relationship between the projection area of ​​each rendering image and the corresponding structured model surface, a second reference rendering image set corresponding to each structured model surface is screened from the rendering images;

[0043] According to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0044] Based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set and the third reference rendering image set for each structured model surface, a target rendering image corresponding to each structured model surface is determined, a texture of the corresponding structured model surface is obtained according to the target rendering image, and the structured model to be mapped is mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, the target rendering image whose viewing angle is closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0045] The above-mentioned three-dimensional structured model mapping rendering method, device, computer equipment, computer-readable storage medium and computer program product obtain rendering images corresponding to each viewing angle in the real scene model, and perform multi-dimensional and accurate screening of the rendering images corresponding to each structured model surface of the structured model according to the angular relationship between the viewing angle corresponding to each rendering image and the corresponding structured model surface, as well as the projection area relationship between each rendering image and the corresponding structured model surface, and the line of sight occlusion relationship between the viewpoint corresponding to each rendering image and the corresponding structured model surface, so as to obtain a mapping image suitable for the structured model surface of the structured model, thereby improving the accuracy of mapping the structured model. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0047] Figure 1A schematic diagram of a process of a three-dimensional structured model texture rendering method in one embodiment;

[0048] Figure 2 A schematic diagram of a flow chart of a three-dimensional structured model texture rendering method in another embodiment;

[0049] Figure 3 It is a structural block diagram of a three-dimensional structured model mapping rendering device in one embodiment;

[0050] Figure 4 is an internal structure diagram of a computer device in one embodiment;

[0051] Figure 5 FIG. 4 is a diagram showing the internal structure of a computer device in another embodiment. DETAILED DESCRIPTION

[0052] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0053] In an exemplary embodiment, Figure 1 As shown, a three-dimensional structured model texture rendering method is provided. This embodiment takes the method applied to a server as an example. It can be understood that the method can also be applied to a terminal, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. In this embodiment, the method includes the following steps S102 to S112, wherein:

[0054] Step S102, obtaining the structured model to be mapped and the real scene model corresponding to the structured model to be mapped.

[0055] Among them, the real-scene model is a three-dimensional model that accurately replicates the scene, and the structured model is a three-dimensional model that presents the real-scene model in a simplified manner, that is, the complex structure, details or features in the real-scene model are simplified so as to show the three-dimensional shape and structure of the real-scene model more clearly and easier to understand; the structured model to be mapped is a structured model whose surface has not yet been mapped.

[0056] Optionally, in the field of architecture, a realistic model is a three-dimensional model that accurately replicates a building, accurately presenting the appearance, structure, material and other details and features of the real building; a structured model is a model that presents the building in a simplified manner, discarding unnecessary details and features and focusing on highlighting the structure and function of the building.

[0057] Alternatively, in the field of architecture, the structured model may be represented as a simplified model of a building unit, that is, a model that presents a single building in a simplified manner.

[0058] Step S104, obtaining rendering images corresponding to respective viewing angles in the real scene model; each structured model surface of the structured model corresponds to a plurality of viewing angles.

[0059] Exemplarily, when a real-scene model is observed through a viewing angle, the image content presented by the real-scene model at this time is the rendered image corresponding to the viewing angle; a rendered image corresponding to a viewing angle is used to map the structured model surface corresponding to the viewing angle in the structured model.

[0060] Exemplarily, in a structured model, the structured model surface to be mapped is determined; according to the preset viewing angle range corresponding to each structured model surface, the viewing angle corresponding to each structured model surface is determined; in the real-scene model, corresponding rendering images are obtained according to each viewing angle.

[0061] Optionally, each structured model surface in the structured model can be used as the structured model surface to be mapped; or each structured model surface in the structured model can be screened according to parameters such as area and shape, and the screened structured model surfaces can be used as the structured model surfaces to be mapped; or inherent and conventional structured model surfaces to be mapped can be determined based on empirical knowledge or specification parameters of the structured model.

[0062] Optionally, the viewing angle corresponding to the structured model surface can be expressed as the viewing angle corresponding to the structured model, for example, the structured model can be rotated based on the center, horizontal axis or vertical axis of the structured model to achieve viewing angle switching of the structured model; the preset viewing angle range corresponding to the structured model surface can be expressed as the visible field of view angle range for accurate observation of the structured model surface.

[0063] Optionally, the viewing angle for observing the structured model corresponds to the viewing angle for observing the rendered image in the real-scene model, that is, when a structured model surface of the structured model is observed through a viewing angle, it corresponds to the rendered image corresponding to the structured model surface observed through the viewing angle in the real-scene model.

[0064] Optionally, for a model surface in the structured model, a rendered image may be observed in the real scene model through a single viewing angle; or multiple rendered images may be observed in the real scene model through multiple viewing angles within a preset viewing angle range.

[0065] Optionally, based on a preset angle acquisition step, a viewing angle for observing the corresponding structured model surface and the real scene model may be selected within a preset viewing angle range corresponding to each structured model surface.

[0066] Step S106 , selecting and obtaining a first reference rendering image set corresponding to each structured model surface from each rendering image according to the angle relationship between the viewing angle corresponding to each rendering image and the corresponding structured model surface.

[0067] Exemplarily, the angular relationship between the viewing angle corresponding to the rendered image and the corresponding structured model surface can be expressed as the angular relationship between the viewing angle corresponding to the rendered image and the corresponding structured model surface, or can be expressed as the angular relationship between the viewing angle corresponding to the rendered image and the normal of the corresponding structured model surface.

[0068] Optionally, the angular relationship between the viewing angle corresponding to the rendered image and the corresponding structured model surface can also be expressed as a directional relationship between the viewing angle corresponding to the rendered image and the corresponding structured model surface, such as the relationship between the viewpoint position and viewpoint direction corresponding to the viewing angle, and the orientation of the structured model surface.

[0069] Exemplarily, among multiple rendering images corresponding to a structured model surface, the multiple rendering images are screened according to the angular relationship between the viewing angles corresponding to each rendering image and the structured model surface, and the screened rendering images are combined to obtain a first reference rendering image set corresponding to the structured model surface.

[0070] Step S108 : According to the relationship between the projection area of ​​each rendering image and the corresponding structured model surface, a second reference rendering image set corresponding to each structured model surface is screened from each rendering image.

[0071] Exemplarily, the relationship between the rendered image and the projection area of ​​the corresponding structured model surface can be expressed as projecting the structured model surface onto a preset plane to obtain the projection area corresponding to the structured model surface, and comparing the contour shapes of the projection area corresponding to the structured model surface and the rendered image.

[0072] Optionally, the relationship between the projection area of ​​the rendered image and the corresponding structured model surface can also be expressed as projecting the rendered image onto a preset plane, obtaining the projection area corresponding to the rendered image, and comparing the projection area corresponding to the rendered image with the structured model surface.

[0073] Optionally, the relationship between the projection area of ​​the rendered image and the corresponding structured model surface can also be expressed as projecting the rendered image and the structured model surface onto a preset plane respectively, obtaining the projection area of ​​the rendered image and the projection area of ​​the corresponding structured model surface respectively, and comparing the projection area of ​​the rendered image with the projection area of ​​the corresponding structured model surface.

[0074] Exemplarily, among multiple rendering images corresponding to a structured model surface, the multiple rendering images are screened according to the relationship between each rendering image and the projection area of ​​the model surface, and the screened rendering images are combined to obtain a second reference rendering image set corresponding to the structured model surface.

[0075] Step S110 , according to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images.

[0076] The rendered image is observed through a specified observation direction and observation position, the observation direction corresponds to the viewing angle, and the observation position corresponds to the viewpoint, that is, the viewpoint can be represented as a coordinate point for observing the scene.

[0077] Among them, the line of sight corresponding to the viewpoint is expressed as a ray extending from the viewpoint along the specified observation direction; that is, the line of sight starts from the viewpoint, extends towards the observation direction, and extends to the observed target scene, or extends infinitely.

[0078] Exemplarily, the line of sight occlusion relationship between the viewpoint corresponding to the rendered image and the corresponding structured model surface can be expressed as, based on the viewpoint corresponding to the rendered image, extending multiple lines of sight toward preset points on the corresponding structured model surface, and obtaining a quantitative relationship between the lines of sight extended to the preset points and the total number of lines of sight.

[0079] Optionally, the line of sight occlusion relationship between the viewpoint corresponding to the rendered image and the corresponding structured model surface can also be expressed as extending multiple lines of sight based on the viewpoint corresponding to the rendered image, and obtaining a quantitative relationship between the lines of sight extended to the corresponding structured model surface and the total number of lines of sight.

[0080] Exemplarily, among multiple rendered images corresponding to a structured model surface, the multiple rendered images are screened according to the line of sight occlusion relationship between the viewpoints corresponding to each rendered image and the model surface, and the screened rendered images are combined to obtain a third reference rendered image set corresponding to the structured model surface.

[0081] Step S112, based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set, and the third reference rendering image set for each structured model surface, determine the target rendering image corresponding to each structured model surface, obtain the texture of the corresponding structured model surface according to the target rendering image, and map the structured model to be mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, then the target rendering image with a viewing angle closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0082] Exemplarily, if a rendering image exists in the first reference rendering image set, the second reference rendering image set, and the third reference rendering image set, the rendering image is used as the target rendering image corresponding to the structured model surface; if there are multiple target rendering images for a structured model surface, then among the multiple target rendering images, the target rendering image with the closest viewing angle to the structured model surface is used as the target rendering image for mapping the structured model surface; the image content in the target rendering image is used as the texture of the corresponding structured model surface to achieve mapping rendering processing of the model surface. The front-view viewing angle can be expressed as a viewing angle in which the observation direction is perpendicular to the model surface, or a viewing angle in which the observation direction is parallel to the normal of the model surface.

[0083] Optionally, if the rendered image does not exist in any of the first reference rendered image set, the second reference rendered image set, and the third reference rendered image set, it means that the rendered image cannot be used as a target rendered image for mapping the corresponding structured model surface.

[0084] In this embodiment, by obtaining rendering images corresponding to each viewing angle in the real scene model, according to the angular relationship between the viewing angle corresponding to each rendering image and the corresponding structured model surface, according to the projection area relationship between each rendering image and the corresponding structured model surface, and according to the line of sight occlusion relationship between the viewpoint corresponding to each rendering image and the corresponding structured model surface, the rendering images corresponding to each structured model surface of the structured model are screened in a multi-dimensional and accurate manner, so as to obtain a mapping image suitable for the structured model surface of the structured model, thereby improving the accuracy of mapping the structured model.

[0085] In an exemplary embodiment, the method further includes steps S202 to S204, wherein:

[0086] Step S202: if the target structured model surface does not match the corresponding target rendered image, a new viewing angle is obtained within a preset viewing angle range corresponding to the target structured model surface.

[0087] Step S204: Based on the new viewing angle, a new rendering image is obtained in the real scene model, and the new rendering image is re-screened until a target rendering image corresponding to the surface of the target structured model is obtained.

[0088] Wherein, each structured model surface of the structured model corresponds to a preset viewing angle range, that is, a visible viewing angle range for accurately observing the structured model surface;

[0089] Exemplarily, if a structured model surface does not match the corresponding target rendered image, it means that the rendered image observed in the real-scene model is not suitable for the structured model surface, and a new viewing angle must be obtained within the preset viewing angle range corresponding to the structured model surface to reacquire the rendered image and re-screen it until the target rendered image corresponding to the structured model surface is obtained.

[0090] Optionally, the orthographic viewing angle can be directly selected within the preset viewing angle range; based on the orthographic viewing angle, a corresponding rendering image is obtained in the real-scene model, and it is only necessary to determine whether the rendering image exists in the second reference rendering image set and the third reference image set, without having to determine whether the rendering image exists in the first reference rendering image set.

[0091] Optionally, a new viewing angle may be selected within a preset viewing angle range based on a preset angle acquisition step.

[0092] In this embodiment, when the structured model surface does not match the corresponding target rendered image, a new viewing angle is obtained within the preset viewing angle range corresponding to the structured model surface to reacquire the rendered image and re-screen it, thereby improving the adaptability and fault tolerance of mapping the structured model.

[0093] In an exemplary embodiment, according to the angle relationship between the viewing angles corresponding to the respective rendered images and the corresponding structured model surfaces, a first reference rendered image set corresponding to each structured model surface is screened from each rendered image, including steps S302 to S304, wherein:

[0094] Step S302 , obtaining reference lines corresponding to each structured model surface; the reference lines are used to characterize the orientation of the structured model surface.

[0095] Exemplarily, the normal line of the structured model surface may be used as a reference line of the model surface.

[0096] Step S304 , according to the angle differences between the viewing angles corresponding to the respective rendered images and the reference lines of the corresponding structured model surface, the rendered images whose angle differences satisfy the corresponding threshold conditions are used as the rendered images in the first reference rendered image set of the corresponding structured model surface.

[0097] Exemplarily, when the reference line of the structured model surface is the normal of the model surface, the angular difference between the viewing angle corresponding to the rendered image and the reference line of the corresponding structured model surface can be expressed as the angle value between the viewing angle corresponding to the rendered image and the normal of the corresponding structured model surface.

[0098] Exemplarily, the threshold condition corresponding to the angle difference can be expressed as the threshold of the angle between the normal of the structured model surface and the viewing angle of the rendered image, which is equivalent to the threshold of the angle between the orthographic viewing angle of the structured model surface and the actual viewing angle of the rendered image.

[0099] Optionally, if the angle difference satisfies the corresponding threshold condition, it means that the viewing angle of the rendered image matches the front view viewing angle of the structured model surface, that is, the viewing angle of the rendered image is consistent with the front view viewing angle of the structured model surface, or the viewing angle of the rendered image is within the front view range of the structured model surface, wherein, by observing the structured model surface through the viewing angle in the front view range, the corresponding front view or approximate front view of the structured model on the structured model surface can be clearly obtained.

[0100] In this embodiment, according to the angle difference between the viewing angle corresponding to the rendered image and the reference line of the corresponding structured model surface, the rendered image is screened in the dimension of the angle relationship, and a rendered image that meets a specific viewing angle is adaptively obtained.

[0101] In an exemplary embodiment, according to the relationship between the projection area of ​​each rendered image and the corresponding structured model surface, a second reference rendered image set corresponding to each structured model surface is screened from each rendered image, including steps S402 to S404, wherein:

[0102] Step S402, obtaining a projection image of each structured model surface on a corresponding reference surface; the reference surface is used to characterize the projection position and projection direction of the structured model surface.

[0103] Exemplarily, a surface perpendicular to the viewing angle corresponding to the rendered image may be used as a reference surface, and the corresponding structured model surface may be projected onto the reference surface to obtain a projection image of the structured model surface on the reference surface.

[0104] Optionally, the projection direction may be expressed as the normal direction of the reference surface; and the projection position may be expressed as the position projected onto the reference surface along the projection direction.

[0105] Optionally, each point of the corresponding structured model surface may be projected onto the reference surface along a specified projection direction in a straight line, so that the points in the projection image correspond one-to-one to the points in the structured model surface.

[0106] Step S404 : according to the contour differences between each rendered image and the projection image of the corresponding structured model surface, the rendered images whose contour differences satisfy the corresponding threshold conditions are used as the rendered images in the second reference rendered image set corresponding to the structured model surface.

[0107] Exemplarily, the difference in contour between the rendered image and the projection image of the corresponding structured model surface is also expressed as the difference in shape, position, size, etc. of the contour between the rendered image and the projection image.

[0108] Optionally, the contour difference corresponding threshold condition can be expressed as a threshold of the contour difference between the projected image and the rendered image; if the contour difference satisfies the corresponding threshold condition, it means that the contour corresponding to the projected image of the structured model surface is within the contour corresponding to the rendered image, so that the rendered image can be completely fitted on the structured model surface.

[0109] Optionally, if the contour difference satisfies the corresponding threshold condition, it can also be expressed as the contour corresponding to the projected image of the structured model surface is outside the contour corresponding to the rendered image, that is, the projected image has pixel points that exceed the contour corresponding to the rendered image, but the number of exceeding pixel points has not reached the maximum number threshold.

[0110] In this embodiment, according to the contour difference between the rendered image and the projection image of the corresponding structured model surface, the rendered image is screened in the dimension of the projection area relationship, and the rendered image that satisfies the mapping integrity is adaptively obtained.

[0111] In an exemplary embodiment, according to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from each rendered image, including steps S502 to S504, wherein:

[0112] Step S502: acquiring detection points on the surface of each structured model and viewpoints corresponding to the viewing angles of each rendered image.

[0113] Optionally, the structured model surface can be divided into uniform grids, and monitoring points can be set at each grid intersection or center point; the structured model surface can be divided into multiple regions, and then monitoring points can be evenly set in each region; the position of the monitoring point can be dynamically adjusted according to the surface characteristics of the structured model surface.

[0114] Step S504, according to the line of sight occlusion results between the viewpoints corresponding to the rendered images and the detection points of the corresponding structured model surface, the rendered images whose line of sight occlusion results meet the corresponding threshold conditions are used as the rendered images in the third reference rendered image set of the corresponding structured model surface.

[0115] Exemplarily, in a rendered image, the line of sight is extended from the viewpoint to each detection point on the surface of the corresponding structured model. If the line of sight can be extended to the detection point, it means that the line of sight is not blocked; if the line of sight cannot be extended to the detection point, it means that the line of sight is blocked.

[0116] Exemplarily, in a rendered image, according to the line of sight occlusion results corresponding to each line of sight, a line of sight occlusion result corresponding to the rendered image is obtained comprehensively, that is, the quantitative relationship between unobstructed lines of sight and all lines of sight.

[0117] Optionally, the line of sight occlusion result corresponding to the threshold condition can be expressed as a threshold of the ratio between the unobstructed line of sight and the total line of sight; if the line of sight occlusion result satisfies the corresponding threshold condition, it means that the ratio between the unobstructed line of sight and the total line of sight has not reached the maximum ratio threshold, and when the structured model surface is observed through this viewpoint and the corresponding viewing angle, the visible field of view is large and the probability of restricted line of sight is low.

[0118] Optionally, if the line of sight occlusion result does not meet the corresponding threshold condition, different viewpoints may be switched on the same viewing angle to reacquire the rendered image; or different viewing angles may be directly switched.

[0119] In this embodiment, according to the line of sight occlusion result between the corresponding viewpoint of the rendered image and the detection point on the corresponding structured model surface, the rendered image is screened in the dimension of the line of sight occlusion relationship, and the rendered image that satisfies the line of sight observation integrity is adaptively obtained.

[0120] In an exemplary embodiment, obtaining a structured model to be mapped and a real scene model corresponding to the structured model to be mapped includes steps S602 to S604, wherein:

[0121] Step S602: obtaining the plane coverage of the structured model to be mapped corresponding to the reference plane.

[0122] Exemplarily, the horizontal plane where the structured model is located may be used as a reference plane, and the planar coverage of the structured model on the horizontal plane may be obtained according to the projection contour of the structured model on the reference plane.

[0123] Step S604, obtaining a global real scene model, and dividing the global real scene model to obtain a real scene model corresponding to the structured model to be mapped according to the plane coverage corresponding to the structured model to be mapped.

[0124] Among them, the global real scene model is a large scene model composed of multiple real scene models; in the global real scene model, each real scene model can represent a specific area, building, object or scenery in the scene, which are combined together to create a large and continuous scene environment.

[0125] Exemplarily, in the global real-scene model, a model structure corresponding to the structured model is matched, and the model structure includes the real-scene model from which the global real-scene model has not yet been separated; according to the plane coverage range corresponding to the structured model, the real-scene model corresponding to the plane coverage range is circled in the above-matched model structure, and the circled real-scene model is used as the real-scene model corresponding to the structured model to be mapped.

[0126] In this embodiment, according to the plane coverage of the structured model to be mapped on the reference plane, the real scene model corresponding to the structured model to be mapped is divided in the global real scene model, so as to efficiently and accurately obtain the real scene model for providing the rendered image.

[0127] In an exemplary embodiment, Figure 2 As shown, the plane coverage of the structured model to be mapped on the horizontal plane is obtained; according to the plane coverage, the real scene model corresponding to the structured model is obtained by dividing in the global real scene model.

[0128] Optionally, for conventional buildings, the structured model can be presented in the form of an Oriented Bounding Box (OBB), which is a rectangular box that can tightly surround the object, and its edges are in the same orientation as the surface of the object.

[0129] Optionally, the display range of the bounding box on the horizontal plane may be used as the plane coverage range, or the display range of the bounding box on the horizontal plane may be expanded outward in equal proportion according to a preset size to obtain the plane coverage range.

[0130] In the structured model to be mapped, the structured model surface to be mapped and the observation perspectives and observation viewpoints corresponding to each structured model surface are determined; in the real scene model, rendering images corresponding to each perspective are obtained, wherein each structured model surface of the structured model corresponds to multiple perspectives.

[0131] Optionally, when the structured model is presented in the form of a bounding box, conventional viewing angles may include a viewing angle from the top surface to the center, a viewing angle from the side surface to the center, and a viewing angle from the side edge to the center. The distance from the viewpoint corresponding to each viewing angle to the center of the structured model is twice the radius of the structured model bounding sphere, which is a spherical structure that can tightly surround the object.

[0132] For the rendered images corresponding to each structured model surface, on the one hand, the angle difference between the viewing angle corresponding to each rendered image and the reference line of the corresponding structured model surface is obtained; on the other hand, the contour difference between each rendered image and the projection image of the corresponding structured model surface is obtained; on the other hand, the line of sight occlusion result between the viewpoint corresponding to each rendered image and the detection point of the corresponding structured model surface is obtained.

[0133] Determine whether the rendered images all meet the threshold conditions corresponding to the angle difference, the threshold conditions corresponding to the contour difference, and the threshold conditions corresponding to the line of sight occlusion result; if so, use the rendered image as the target rendered image corresponding to the structured model surface, and obtain the texture of the structured model surface based on the target rendered image; if a structured model surface corresponds to multiple target rendered images, use the target rendered image with a viewing angle closest to the front view of the structured model surface as the target rendered image for mapping the structured model surface.

[0134] If there is no rendering image satisfying all three threshold conditions among the rendering images corresponding to a structured model surface, a new viewing angle of the corresponding structured model surface is obtained within a preset viewing angle range, and the rendering image is re-acquired and re-judged based on the new viewing angle.

[0135] Optionally, if the angle between the viewing angle of the rendered image and the normal of the corresponding structured model surface is less than 10 degrees, it means that the rendered image meets the threshold condition corresponding to the angle difference; the structured model surface is projected onto a plane perpendicular to the viewing angle of the corresponding rendered image. If the contour corresponding to the projected image of the structured model surface is within the contour corresponding to the rendered image, it means that the rendered image meets the threshold condition corresponding to the contour difference; 100 detection points are evenly set on the structured model surface, and rays are generated from the viewpoint of the rendered image to each detection point on the corresponding structured model surface. The ratio between the blocked rays and the total number of rays is calculated. If the ratio is less than 0.1, it means that the rendered image meets the threshold condition corresponding to the line of sight occlusion result.

[0136] Optionally, if there is no rendering image that satisfies all three of the above threshold conditions among the rendering images corresponding to a structured model surface, the rendering image of the corresponding structured model surface at the front view angle can be directly obtained to determine whether the rendering image at the front view angle satisfies the threshold conditions corresponding to the contour difference and the threshold conditions corresponding to the line of sight occlusion result.

[0137] Optionally, if the rendered images satisfy the threshold conditions corresponding to the angle difference, the threshold conditions corresponding to the contour difference, and the threshold conditions corresponding to the line of sight occlusion results, then the image content contained after the corresponding structured model surface is projected onto the rendered image is the texture of the structured model surface.

[0138] Until a rendering image suitable for each structured model surface is obtained, thereby obtaining the texture corresponding to each structured model surface, and mapping the structured model to be mapped based on the texture corresponding to each model surface to obtain a mapped structured model.

[0139] Optionally, it is possible to simultaneously determine whether the rendered image satisfies the threshold conditions corresponding to the angle difference, contour difference, and line of sight occlusion result; or it is possible to determine one by one, and if one of the threshold conditions is not met, the rendered image is directly discarded.

[0140] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0141] Based on the same inventive concept, the embodiment of the present application also provides a three-dimensional structured model texture rendering device for implementing the three-dimensional structured model texture rendering method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more three-dimensional structured model texture rendering device embodiments provided below can refer to the limitations of the three-dimensional structured model texture rendering method above, and will not be repeated here.

[0142] In an exemplary embodiment, Figure 3 As shown, a three-dimensional structured model texture rendering device is provided, including: a first acquisition module 302, a second acquisition module 304, a first screening module 306, a second screening module 308, a third screening module 310 and a texture module 312, wherein:

[0143] A first acquisition module 302 is used to acquire a structured model to be mapped and a real scene model corresponding to the structured model to be mapped;

[0144] The second acquisition module 304 is used to obtain the rendering images corresponding to each viewing angle in the real scene model; each structured model surface of the structured model corresponds to multiple viewing angles;

[0145] A first screening module 306 is used to screen out a first reference rendering image set corresponding to each structured model surface from each rendering image according to the angle relationship between the viewing angle corresponding to each rendering image and the corresponding structured model surface;

[0146] A second screening module 308 is used to screen and obtain a second reference rendering image set corresponding to each structured model surface from each rendering image according to the relationship between each rendering image and the projection area of ​​the corresponding structured model surface;

[0147] A third screening module 310 is used to screen and obtain a third reference rendering image set corresponding to each structured model surface from each rendering image according to the line of sight occlusion relationship between the viewpoints corresponding to each rendering image and the corresponding structured model surface;

[0148] The mapping module 312 is used to determine the target rendering image corresponding to each structured model surface based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set, and the third reference rendering image set for each structured model surface, obtain the texture of the corresponding structured model surface according to the target rendering image, and map the structured model to be mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, the target rendering image with a viewing angle closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0149] In an exemplary embodiment, the second acquisition module 304 is also used to: if the target structured model surface does not match the corresponding target rendered image, obtain a new perspective within a preset perspective range corresponding to the target structured model surface; based on the new perspective, obtain a new rendered image in the real scene model, and re-screen the new rendered image until the target rendered image corresponding to the target structured model surface is obtained.

[0150] In an exemplary embodiment, the first screening module 306 is also used to: obtain reference lines corresponding to each structured model surface; the reference lines are used to characterize the orientation of the structured model surface; according to the angle difference between the viewing angles corresponding to each rendered image and the reference lines of the corresponding structured model surface, the rendered image whose angle difference meets the corresponding threshold condition is used as the rendered image in the first reference rendered image set of the corresponding structured model surface.

[0151] In an exemplary embodiment, the second screening module 308 is also used to: obtain the projection image of each structured model surface on the corresponding reference surface; the reference surface is used to characterize the projection position and projection direction of the structured model surface; according to the contour difference between each rendered image and the projection image of the corresponding structured model surface, the rendered image whose contour difference meets the corresponding threshold condition is used as the rendered image in the second reference rendered image set of the corresponding structured model surface.

[0152] In an exemplary embodiment, the third screening module 310 is also used to: obtain detection points on each structured model surface, and viewpoints of each rendered image corresponding to a perspective; and according to the line of sight occlusion results between the corresponding viewpoints of each rendered image and the detection points of the corresponding structured model surface, use the rendered image whose line of sight occlusion results satisfy the corresponding threshold conditions as the rendered image in the third reference rendered image set of the corresponding structured model surface.

[0153] In an exemplary embodiment, the mapping module 312 is also used to: obtain the plane coverage range corresponding to the structured model to be mapped on the reference plane; obtain the global real scene model, and divide the real scene model corresponding to the structured model to be mapped in the global real scene model according to the plane coverage range corresponding to the structured model to be mapped.

[0154] Each module in the above-mentioned three-dimensional structured model texture rendering device can be implemented in whole or in part by software, hardware and their combination. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the corresponding operations of each of the above modules.

[0155] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 4As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data for mapping a structured model. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a three-dimensional structured model mapping rendering method is implemented.

[0156] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 5 As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, a three-dimensional structured model mapping rendering method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0157] Those skilled in the art will understand that Figure 4The structure shown in or 5 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0158] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0159] Obtaining a structured model to be mapped and a real scene model corresponding to the structured model to be mapped;

[0160] A rendering image corresponding to each viewing angle is obtained in the real scene model; each structured model surface of the structured model corresponds to multiple viewing angles;

[0161] According to the angle relationship between the viewing angles corresponding to the respective rendered images and the corresponding structured model surfaces, a first reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0162] According to the relationship between the projection area of ​​each rendering image and the corresponding structured model surface, a second reference rendering image set corresponding to each structured model surface is screened from each rendering image;

[0163] According to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0164] Based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set and the third reference rendering image set for each structured model surface, a target rendering image corresponding to each structured model surface is determined, and a texture of the corresponding structured model surface is obtained according to the target rendering image. The structured model to be mapped is mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, the target rendering image whose viewing angle is closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0165] In one embodiment, when the processor executes the computer program, the following steps are also implemented: if the target structured model surface does not match the corresponding target rendered image, a new viewing angle is obtained within a preset viewing angle range corresponding to the target structured model surface; based on the new viewing angle, a new rendered image is obtained in the real scene model, and the new rendered image is re-screened until the target rendered image corresponding to the target structured model surface is obtained.

[0166] In one embodiment, when the processor executes the computer program, the following steps are also implemented: obtaining reference lines corresponding to each structured model surface respectively; the reference lines are used to characterize the orientation of the structured model surface; according to the angle difference between the viewing angle corresponding to each rendered image and the reference line of the corresponding structured model surface, the rendered image whose angle difference satisfies the corresponding threshold condition is used as the rendered image in the first reference rendered image set of the corresponding structured model surface.

[0167] In one embodiment, when the processor executes the computer program, the following steps are also implemented: obtaining the projection image of each structured model surface on the corresponding reference surface; the reference surface is used to characterize the projection position and projection direction of the structured model surface; based on the contour difference between each rendered image and the projection image of the corresponding structured model surface, the rendered image whose contour difference meets the corresponding threshold condition is used as the rendered image in the second reference rendered image set of the corresponding structured model surface.

[0168] In one embodiment, when the processor executes the computer program, the following steps are also implemented: obtaining detection points on each structured model surface and viewpoints of each rendered image corresponding to a perspective; and according to the line of sight occlusion results between the viewpoints corresponding to each rendered image and the detection points on the corresponding structured model surface, taking the rendered image whose line of sight occlusion result satisfies the corresponding threshold condition as the rendered image in the third reference rendered image set of the corresponding structured model surface.

[0169] In one embodiment, when the processor executes the computer program, the following steps are also implemented: obtaining the plane coverage range corresponding to the structured model to be mapped on the reference plane; obtaining the global real scene model, and dividing the real scene model corresponding to the structured model to be mapped in the global real scene model according to the plane coverage range corresponding to the structured model to be mapped.

[0170] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0171] Obtaining a structured model to be mapped and a real scene model corresponding to the structured model to be mapped;

[0172] A rendering image corresponding to each viewing angle is obtained in the real scene model; each structured model surface of the structured model corresponds to multiple viewing angles;

[0173] According to the angle relationship between the viewing angles corresponding to the respective rendered images and the corresponding structured model surfaces, a first reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0174] According to the relationship between the projection area of ​​each rendering image and the corresponding structured model surface, a second reference rendering image set corresponding to each structured model surface is screened from each rendering image;

[0175] According to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0176] Based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set and the third reference rendering image set for each structured model surface, a target rendering image corresponding to each structured model surface is determined, and a texture of the corresponding structured model surface is obtained according to the target rendering image. The structured model to be mapped is mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, the target rendering image whose viewing angle is closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0177] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: if the target structured model surface does not match the corresponding target rendered image, a new viewing angle is obtained within a preset viewing angle range corresponding to the target structured model surface; based on the new viewing angle, a new rendered image is obtained in the real scene model, and the new rendered image is re-screened until the target rendered image corresponding to the target structured model surface is obtained.

[0178] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining reference lines corresponding to each structured model surface respectively; the reference lines are used to characterize the orientation of the structured model surface; based on the angle difference between the viewing angle corresponding to each rendered image and the reference line of the corresponding structured model surface, the rendered image whose angle difference satisfies the corresponding threshold condition is used as the rendered image in the first reference rendered image set of the corresponding structured model surface.

[0179] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining projection images of each structured model surface on the corresponding reference surface; the reference surface is used to characterize the projection position and projection direction of the structured model surface; based on the contour differences between each rendered image and the projection image of the corresponding structured model surface, the rendered image whose contour difference meets the corresponding threshold condition is used as the rendered image in the second reference rendered image set of the corresponding structured model surface.

[0180] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: detection points on each structured model surface and viewpoints of the corresponding perspectives of each rendered image are obtained; and according to the line of sight occlusion results between the corresponding viewpoints of each rendered image and the detection points of the corresponding structured model surface, the rendered image whose line of sight occlusion result satisfies the corresponding threshold condition is used as the rendered image in the third reference rendered image set of the corresponding structured model surface.

[0181] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining the plane coverage range corresponding to the structured model to be mapped on the reference plane; obtaining the global real scene model, and dividing the real scene model corresponding to the structured model to be mapped in the global real scene model according to the plane coverage range corresponding to the structured model to be mapped.

[0182] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0183] Obtaining a structured model to be mapped and a real scene model corresponding to the structured model to be mapped;

[0184] A rendering image corresponding to each viewing angle is obtained in the real scene model; each structured model surface of the structured model corresponds to multiple viewing angles;

[0185] According to the angle relationship between the viewing angles corresponding to the respective rendered images and the corresponding structured model surfaces, a first reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0186] According to the relationship between the projection area of ​​each rendering image and the corresponding structured model surface, a second reference rendering image set corresponding to each structured model surface is screened from each rendering image;

[0187] According to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images;

[0188] Based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set and the third reference rendering image set for each structured model surface, a target rendering image corresponding to each structured model surface is determined, and a texture of the corresponding structured model surface is obtained according to the target rendering image. The structured model to be mapped is mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, the target rendering image whose viewing angle is closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

[0189] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: if the target structured model surface does not match the corresponding target rendered image, a new viewing angle is obtained within a preset viewing angle range corresponding to the target structured model surface; based on the new viewing angle, a new rendered image is obtained in the real scene model, and the new rendered image is re-screened until the target rendered image corresponding to the target structured model surface is obtained.

[0190] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining reference lines corresponding to each structured model surface respectively; the reference lines are used to characterize the orientation of the structured model surface; based on the angle difference between the viewing angle corresponding to each rendered image and the reference line of the corresponding structured model surface, the rendered image whose angle difference satisfies the corresponding threshold condition is used as the rendered image in the first reference rendered image set of the corresponding structured model surface.

[0191] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining projection images of each structured model surface on the corresponding reference surface; the reference surface is used to characterize the projection position and projection direction of the structured model surface; based on the contour differences between each rendered image and the projection image of the corresponding structured model surface, the rendered image whose contour difference meets the corresponding threshold condition is used as the rendered image in the second reference rendered image set of the corresponding structured model surface.

[0192] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: detection points on each structured model surface and viewpoints of the corresponding perspectives of each rendered image are obtained; and according to the line of sight occlusion results between the corresponding viewpoints of each rendered image and the detection points of the corresponding structured model surface, the rendered image whose line of sight occlusion result satisfies the corresponding threshold condition is used as the rendered image in the third reference rendered image set of the corresponding structured model surface.

[0193] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining the plane coverage range corresponding to the structured model to be mapped on the reference plane; obtaining the global real scene model, and dividing the real scene model corresponding to the structured model to be mapped in the global real scene model according to the plane coverage range corresponding to the structured model to be mapped.

[0194] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0195] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0196] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A three-dimensional structured model texture rendering method, It is characterized in that The method comprises: Acquire a structured model to be mapped and a real scene model corresponding to the structured model to be mapped; A rendering image corresponding to each viewing angle is obtained in the real scene model; each structured model surface of the structured model corresponds to a plurality of viewing angles; According to the angle relationship between the viewing angles corresponding to the respective rendered images and the corresponding structured model surfaces, a first reference rendered image set corresponding to each structured model surface is screened from the respective rendered images; According to the relationship between the projection area of ​​each rendering image and the corresponding structured model surface, a second reference rendering image set corresponding to each structured model surface is screened from the rendering images; According to the line of sight occlusion relationship between the viewpoints corresponding to the respective rendered images and the corresponding structured model surfaces, a third reference rendered image set corresponding to each structured model surface is screened from the respective rendered images; Based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set and the third reference rendering image set for each structured model surface, a target rendering image corresponding to each structured model surface is determined, a texture of the corresponding structured model surface is obtained according to the target rendering image, and the structured model to be mapped is mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, the target rendering image whose viewing angle is closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

2. The method according to claim 1, It is characterized in that The method further comprises: If the target structured model surface does not match the corresponding target rendered image, a new viewing angle is obtained within a preset viewing angle range corresponding to the target structured model surface; Based on the new viewing angle, a new rendering image is obtained in the real scene model, and the new rendering image is re-screened until a target rendering image corresponding to the surface of the target structured model is obtained.

3. The method according to claim 1, It is characterized in that The method of selecting and obtaining a first reference rendering image set corresponding to each structured model surface from each rendering image according to the angle relationship between the viewing angle corresponding to each rendering image and the corresponding structured model surface includes: Obtaining reference lines corresponding to each structured model surface respectively; the reference lines are used to characterize the orientation of the structured model surface; According to the angle differences between the viewing angles corresponding to the respective rendered images and the reference lines of the corresponding structured model surface, the rendered images whose angle differences satisfy the corresponding threshold conditions are taken as the rendered images in the first reference rendered image set corresponding to the structured model surface.

4. The method according to claim 1, It is characterized in that The step of selecting and obtaining a second reference rendering image set corresponding to each structured model surface from each rendering image according to the relationship between each rendering image and the projection area of ​​the corresponding structured model surface includes: Acquire a projection image of each structured model surface on a corresponding reference surface; the reference surface is used to characterize the projection position and projection direction of the structured model surface; According to the contour differences between each rendered image and the projection image of the corresponding structured model surface, the rendered images whose contour differences satisfy the corresponding threshold conditions are used as the rendered images in the second reference rendered image set corresponding to the structured model surface.

5. The method according to claim 1, It is characterized in that The method further comprises: selecting a third reference rendering image set corresponding to each structured model surface from each rendered image according to the line of sight occlusion relationship between the viewpoints corresponding to each rendered image and the corresponding structured model surface, comprising: Obtaining detection points on the surface of each structured model and viewpoints corresponding to the viewing angles of each rendered image; According to the line of sight occlusion results between the viewpoints corresponding to each rendered image and the detection points of the corresponding structured model surface, the rendered images whose line of sight occlusion results meet the corresponding threshold conditions are used as the rendered images in the third reference rendered image set of the corresponding structured model surface.

6. The method according to claim 1, It is characterized in that The step of obtaining the structured model to be mapped and the real scene model corresponding to the structured model to be mapped includes: Obtaining a plane coverage of the structured model to be mapped corresponding to the reference plane; A global real scene model is obtained, and according to the plane coverage corresponding to the structured model to be mapped, a real scene model corresponding to the structured model to be mapped is obtained by dividing the global real scene model.

7. A three-dimensional structured model mapping rendering device, It is characterized in that The device comprises: A first acquisition module is used to acquire a structured model to be mapped and a real scene model corresponding to the structured model to be mapped; A second acquisition module is used to obtain rendering images corresponding to each viewing angle in the real scene model; each structured model surface of the structured model corresponds to multiple viewing angles; A first screening module is used to screen and obtain a first reference rendering image set corresponding to each structured model surface from each rendering image according to the angular relationship between the viewing angle corresponding to each rendering image and the corresponding structured model surface; A second screening module is used to screen and obtain a second reference rendering image set corresponding to each structured model surface from each rendering image according to the relationship between each rendering image and the projection area of ​​the corresponding structured model surface; A third screening module is used to screen and obtain a third reference rendering image set corresponding to each structured model surface from each rendered image according to the line of sight occlusion relationship between the viewpoint corresponding to each rendered image and the corresponding structured model surface; A mapping module is used to determine the target rendering image corresponding to each structured model surface based on the same rendering image existing in the first reference rendering image set, the second reference rendering image set, and the third reference rendering image set for each structured model surface, obtain the texture of the corresponding structured model surface according to the target rendering image, and map the structured model to be mapped based on the texture corresponding to each structured model surface to obtain a mapped structured model; if multiple target rendering images correspond to the same structured model surface, then the target rendering image with a viewing angle closest to the orthographic viewing angle of the corresponding structured model surface is used as the target rendering image for mapping the corresponding structured model surface.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program. It is characterized in that When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product comprising a computer program, It is characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Image rendering method and device

    CN108154548A

  • Three-dimensional model rendering method and device, computer equipment and storage medium

    CN116977522A

  • Topographic image rendering method and apparatus, device, computer readable storage medium and computer program product

    WO2023231537A1