AR technology-based building reconstruction aided design method and system

Abstract

The invention provides a building reconstruction aided design method and system based on an AR technology, and relates to the technical field of building reconstruction design assistant.The method comprises the steps that S1, real environment data are obtained through laser scanner equipment; s2, generating virtual content by using a computer graphics technology; s3, seamless alignment of the virtual elements and the real object in the spatial position is achieved through an algorithm, and a virtual model image is constructed through the environment features; s4, dividing the virtual content generated by the computer graphics technology into each region in a plane splitting form; s5, adding a construction graph in the plane area, and synchronously constructing the construction graph into the virtual model image; according to the method, after virtual content is generated through real environment data and a subsequent virtual model image is split into a plurality of planes, a designer can be supported to construct a graph in a plane view angle, the graph is projected in planes where other view angles are located in the construction process, and a three-dimensional graph is displayed in the virtual model image; and the editing angle does not need to be frequently switched in the three-dimensional space.

Description

Technical Field

[0001] The present invention relates to the field of building renovation design auxiliary technology, and in particular to an AR technology-based building renovation auxiliary design method and system. Background Art

[0002] Preserving, renovating, and reusing old buildings, ensuring they continue to maximize their value and shine brightly in new cities, is a key topic in the future development of the construction industry. Renovating old buildings can reduce the significant labor and material resources required for demolition, such as the transportation and disposal of construction waste. During the renovation process, poor-quality roofs and severely deteriorated trusses can be renovated, while retaining solid walls. This maximizes the value of the old building and achieves energy conservation. Renovating or updating the exterior of an old building will enhance its appeal and revitalize it. Appropriate renovation of old buildings not only fully utilizes society's material resources but also contributes to the continuation and inheritance of society's historical and cultural heritage.

[0003] Augmented reality (AR) technology uses optoelectronic display technology, interactive technology, multiple sensor technologies, and computer graphics and multimedia technology to integrate the computer-generated virtual environment with the user's surrounding real environment, so that the user can feel that the virtual environment is part of the real environment around them. Augmented reality has the new features of virtual and real combination, real-time interaction, and three-dimensional registration.

[0004] Patent document CN118886082A discloses an AR-based building renovation auxiliary design method and system. The system allows designers to intuitively perceive the effect of their preliminary designed renovation plan in the building through the virtual image output by the AR device, which is conducive to subsequent adjustments and improvements. At the same time, since the real-scene-based three-dimensional background data inside the building has been obtained, designers no longer need to go inside the building, but can view it in the design studio, thereby improving design efficiency and reducing overall design costs.

[0005] However, in the process of implementing the above technical solution, it was found that the above technical solution had the following technical problems:

[0006] This building renovation auxiliary design method and system based on AR technology can intuitively perceive the effect of the renovation plan it has initially designed in the building from the virtual image output by the AR device, which is convenient for subsequent adjustment and improvement. However, in actual application, by directly adjusting and improving the renovation plan in the virtual image, it is easily blocked by objects in different viewing directions, which affects the editing effect, greatly increases the design difficulty, and reduces the design effect. Summary of the Invention

[0007] In order to overcome the shortcomings of the existing building renovation auxiliary design method and system based on AR technology, which directly adjusts and improves the renovation plan in the virtual image, but is easily blocked by objects in different viewing directions, affecting the editing effect, greatly increasing the design difficulty, and reducing the design effect, the embodiment of the present application provides a building renovation auxiliary design method and system based on AR technology, which generates virtual content from the real environment data obtained by laser scanning by using computer graphics technology, and uses algorithms to seamlessly align the virtual elements and real objects in spatial positions by matching the perspective and proportion of the display scene, and constructs a virtual model image of the environmental features. At the same time, after generating virtual content from the real environment data and splitting the subsequent virtual model image into multiple planes, it can support the designer to construct graphics within the plane perspective, project graphics on the planes where other perspectives are located during the construction process, and display three-dimensional graphics in the virtual model image, without the need to frequently switch editing angles in the three-dimensional space.

[0008] The technical solution adopted by the embodiment of the present application to solve the technical problem is:

[0009] An AR-based building renovation auxiliary design method and system includes S1, acquiring real environment data through a laser scanner device;

[0010] S2. Use computer graphics technology to generate virtual content and accurately match the perspective and proportion of real scenes;

[0011] S3, using algorithms to seamlessly align virtual elements with real objects in space, and constructing a virtual model image based on environmental features;

[0012] S4, dividing the virtual content generated by computer graphics technology into various areas in the form of split planes;

[0013] S5. Add structural graphics in the plane area and simultaneously construct them into the virtual model image.

[0014] In one possible implementation, the laser scanner in S1 obtains three-dimensional point cloud data of the building facade and internal structure inside and outside the building. These data include three-dimensional coordinates of the internal and external structural features of the building and surface structural feature information.

[0015] In a possible implementation, in the process of generating virtual content using graphics technology in S2, three basic transformations of translation, rotation and scaling are implemented through matrix operations to obtain basic data;

[0016] Translation transformation includes two-dimensional translation: point (x, y) translation (t x , t y ) to get the coordinates

[0017]

[0018] and 3D translation: point (x, y, z) translation (t x , t y , t z ) to get the coordinates

[0019] The rotation transformation involves a two-dimensional rotation of theta angle around the origin: the coordinates of the point (x, y) are obtained after rotation

[0020] And three-dimensional rotations around the coordinate axes:

[0021] Rotate by angle θ around the x-axis:

[0022] Rotate angle θ around the y-axis:

[0023] Rotate angle θ around the z-axis:

[0024] Scaling transformations include two-dimensional scaling (scaling factor s x , s y ):

[0025] and 3D scaling (scaling factor s x , s y , s z ):

[0026] In a possible implementation, the ICP algorithm is used in S2 to align multi-site cloud data, the discrete point cloud is converted into a continuous mesh model through algorithms such as Delaunay triangulation, and the number of polygons is reduced using Quad Remesher.

[0027] In one possible implementation, S2 bakes high-poly details onto low-poly models, retaining texture details while reducing the number of model faces. Physically based rendering technology simulates material reflection, roughness and other properties under real lighting to reflect the surface structural feature information of the building.

[0028] In a possible implementation, the virtual model composed of the virtual content is split into planes by orthogonal projection in S4, as follows:

[0029] Project the 3D coordinates (x, y, z) of the building's interior and exterior structural features to the viewport [-1, 1] 3 Formula (normalized device coordinates, NDC): z'=z.

[0030] In a possible implementation, in S5 , the construction graphic coordinates are added to each plane area based on the three-dimensional coordinate reference of the virtual model, and are simultaneously restricted to the virtual model image.

[0031] An AR-based building renovation auxiliary design system includes: construction of virtual space model graphics and addition and editing of construction images. The construction of the virtual space model graphics is implemented by a feature acquisition module, a graphics generation module, and a model construction module. The addition and editing of construction images is implemented by a graphics separation module, a graphics construction module, and a feature superposition module.

[0032] The feature acquisition module is used to obtain three-dimensional point cloud data of the building facade and internal structure;

[0033] The graphics generation module is used to generate virtual content and accurately match the viewing angle and scale of the display scene;

[0034] The model building module is used to seamlessly align virtual elements with real objects in spatial positions and construct a virtual model image with environmental features;

[0035] The graphic separation module is used to split the virtual content generated by the graphic generation module into plane graphics and arrange them into various areas;

[0036] The graphic construction module is used to generate various structural graphics added during building renovation;

[0037] The feature superposition module is used to merge the added various structural graphics into the virtual model image.

[0038] In one possible implementation, the feature acquisition module obtains three-dimensional point cloud data of the building facade and internal structure, and finally uses the model construction module to seamlessly align the virtual elements with the real objects in space, and construct a virtual model image of the environmental features.

[0039] In one possible implementation, after the graphic separation module splits the virtual content generated by the graphic generation module into plane graphics and arranges them in various areas, the graphic construction module generates various structural graphics added during the building renovation. Finally, the feature overlay module merges the various added structural graphics into the virtual model image to obtain real-time design effects during the building renovation design.

[0040] The beneficial effects of this application are:

[0041] In this solution, computer graphics technology is used to generate virtual content from real-world environment data acquired through laser scanning. By matching the perspective and proportion of the display scene, an algorithm is used to seamlessly align virtual elements with real-world objects in spatial position, and a virtual model image is constructed from environmental features. At the same time, after generating virtual content from real-world environment data and splitting the subsequent virtual model image into multiple planes, it can support designers in constructing graphics within a plane perspective, projecting graphics on planes with other perspectives during the construction process, and displaying three-dimensional graphics in the virtual model image. This eliminates the need to frequently switch editing angles in three-dimensional space, greatly improving editing efficiency during design. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 This is a flow chart of a building renovation auxiliary design method based on AR technology according to the present invention;

[0043] Figure 2 This is a structural diagram of an AR-based building renovation auxiliary design system according to the present invention;

[0044] Figure 3 This is a schematic diagram of the workflow of an AR-based building renovation auxiliary design system of the present invention. DETAILED DESCRIPTION

[0045] The technical solution in the embodiments of the present application is to solve the problems of the above-mentioned background technology, and the overall idea is as follows:

[0046] Example 1:

[0047] This embodiment introduces a building renovation auxiliary design method based on AR technology. Figure 1 Shown, including:

[0048] S1. Acquire real environment data through laser scanner equipment;

[0049] Among them, the laser scanner obtains 3D point cloud data of the building facade and internal structure inside and outside the building. This data includes the 3D coordinates (x, y, z) of the internal and external structural features of the building and surface structural feature information (including texture, roughness, graphics, etc.);

[0050] S2. Use computer graphics technology to generate virtual content and accurately match the perspective and proportion of real scenes;

[0051] In the process of generating virtual content using graphics technology, three basic transformations, translation, rotation and scaling, are implemented through matrix operations to obtain basic data;

[0052] Translation transformation includes two-dimensional translation: point (x, y) translation (t x , t y) to get the coordinates

[0053]

[0054] and 3D translation: point (x, y, z) translation (t x , t y , t z ) to get the coordinates

[0055] The rotation transformation involves a two-dimensional rotation of theta angle around the origin: the coordinates of the point (x, y) are obtained after rotation

[0056] And three-dimensional rotations around the coordinate axes:

[0057] Rotate by angle θ around the x-axis:

[0058] Rotate angle θ around the y-axis:

[0059] Rotate angle θ around the z-axis:

[0060] Scaling transformations include two-dimensional scaling (scaling factor s x , s y ):

[0061] and 3D scaling (scaling factor s x , s y , s z ):

[0062] Secondly, the ICP algorithm is used to align the multi-site cloud data. The discrete point cloud is converted into a continuous mesh model through algorithms such as Delaunay triangulation, and the Quad Remesher is used to reduce the number of polygons to achieve the effect of optimizing the model.

[0063] Secondly, by "baking" high-poly details onto low-poly models, we can retain texture details while reducing the number of model faces. Based on physical rendering technology, we can simulate the material reflection, roughness and other properties under real lighting, and reflect the surface structural characteristics of the building.

[0064] S3, using algorithms to seamlessly align virtual elements with real objects in space, and constructing a virtual model image based on environmental features;

[0065] S4, dividing the virtual content generated by computer graphics technology into various areas in the form of split planes;

[0066] When renovating the interior and exterior of a building, the virtual model composed of virtual content is first split into planes using orthogonal projection, as follows:

[0067] Project the 3D coordinates (x, y, z) of the building's interior and exterior structural features to the viewport [-1, 1] 3 Formula (normalized device coordinates, NDC): z'=z, in order to provide a basic surface for constructing graphics and devices;

[0068] At the same time, in the editing construction graphics, select a base surface for graphics construction, obtain the coordinates of the object based on the actual size corresponding to the graphics, and complete the projection display in different view planes;

[0069] S5. Add structural graphics in the plane area and simultaneously construct them into the virtual model image.

[0070] Among them, based on the three-dimensional coordinate reference of the virtual model, when the construction graphic coordinates are added to each plane area and synchronously restricted to the virtual model image, the spatial state can be displayed in the virtual model image during the process of adding the construction graphic.

[0071] The above design uses computer graphics technology to generate virtual content from real-world environmental data acquired through laser scanning. By matching the viewing angle and scale of the displayed scene, algorithms are used to seamlessly align virtual elements with real-world objects in space. Environmental features are then constructed into a virtual model image, resulting in a prototype of the building's virtual model graphics, providing a framework for subsequent editing.

[0072] At the same time, after generating virtual content from real-world environment data and splitting the subsequent virtual model image into multiple planes, it can support designers to construct graphics within a two-dimensional perspective, project graphics on planes with other perspectives during the construction process, and display three-dimensional graphics in the virtual model image. There is no need to frequently switch editing angles in three-dimensional space, which greatly improves editing efficiency during design. Only a single plane needs to be selected for editing.

[0073] Example 2:

[0074] Based on Example 1, this example introduces an AR-based building renovation auxiliary design system, which includes the construction of virtual space model graphics and the addition and editing of construction images. The construction of the virtual space model graphics is implemented by a feature acquisition module, a graphic generation module, and a model construction module, and the addition and editing of construction images is implemented by a graphic separation module, a graphic construction module, and a feature overlay module.

[0075] The feature acquisition module is used to obtain 3D point cloud data of the building's facade and internal structure; the graphics generation module is used to generate virtual content and accurately match the perspective and scale of the display scene; the model construction module is used to seamlessly align virtual elements with real objects in space and construct a virtual model image based on environmental features; the graphics separation module is used to split the virtual content generated by the graphics generation module into plane graphics and arrange them in various areas; the graphics construction module is used to generate various structural graphics added during building renovation; and the feature overlay module is used to merge the added structural graphics into the virtual model image.

[0076] Among them, by using the feature acquisition module to obtain the three-dimensional point cloud data of the building facade and internal structure, and finally through the model construction module to seamlessly align the virtual elements with the real objects in space, and construct a virtual model image based on the environmental features, the prototype of the building virtual model graphic can be obtained, providing a framework for subsequent editing;

[0077] Secondly, by using the graphic separation module to split the virtual content generated by the graphic generation module into plane graphics and arrange them in various areas, the graphic construction module generates various structural graphics added during building renovation. Finally, the feature overlay module merges the added various structural graphics into the virtual model image to obtain real-time design effects during building renovation design. Design content can be continuously added to the virtual model graphics while retaining the intuitiveness of the virtual model.

[0078] Finally, it should be noted that the above embodiments are merely examples for the purpose of illustrating the present invention and are not intended to limit the embodiments. Those skilled in the art will readily appreciate that other variations or modifications based on the above description are possible. It is not necessary and impossible to provide an exhaustive list of all embodiments. However, obvious variations or modifications arising therefrom remain within the scope of protection of the present invention.

Claims

1. A building renovation auxiliary design method based on AR technology, characterized in that: include: S1. Acquire real environment data through laser scanner equipment; S2. Use computer graphics technology to generate virtual content and accurately match the perspective and proportion of real scenes; S3, using algorithms to seamlessly align virtual elements with real objects in space, and constructing a virtual model image based on environmental features; S4, dividing the virtual content generated by computer graphics technology into various areas in the form of split planes; S5. Add structural graphics in the plane area and simultaneously construct them into the virtual model image.

2. The AR-based building renovation design method according to claim 1, wherein: The laser scanner in S1 obtains three-dimensional point cloud data of the building facade and internal structure inside and outside the building. These data include three-dimensional coordinates of the internal and external structural features of the building and surface structural feature information.

3. The AR-based building renovation auxiliary design method according to claim 1, characterized in that: In the process of generating virtual content using graphics technology in S2, three basic transformations of translation, rotation and scaling are implemented through matrix operations to obtain basic data; Translation transformation includes two-dimensional translation: point (x, y) translation (t x , t y ) to get the coordinates and 3D translation: point (x, y, z) translation (t x , t y , t z ) to get the coordinates The rotation transformation involves a two-dimensional rotation of theta angle around the origin: the coordinates of the point (x, y) are obtained after rotation And three-dimensional rotations around the coordinate axes: Rotate by angle θ around the x-axis: Rotate angle θ around the y-axis: Rotate angle θ around the z-axis: Scaling transformations include two-dimensional scaling (scaling factor s x , s y ): and 3D scaling (scaling factor s x , s y , s z ):

4. The AR-based building renovation design method according to claim 1, wherein: In the S2, the ICP algorithm is used to align the multi-site cloud data, the discrete point cloud is converted into a continuous mesh model through algorithms such as Delaunay triangulation, and the Quad Remesher is used to reduce the number of polygons.

5. The AR-based building renovation auxiliary design method according to claim 1, characterized in that: In the S2, high-poly model details are "baked" onto the low-poly model, retaining the texture details while reducing the number of model faces. The physically based rendering technology simulates the material reflection, roughness and other properties under real lighting to reflect the surface structural characteristics of the building.

6. The AR-based building renovation design aided method according to claim 1, wherein: In S4, the virtual model composed of the virtual content is split into planes by orthogonal projection, as follows: Project the 3D coordinates (x, y, z) of the building's interior and exterior structural features to the viewport [-1, 1] 3 Formula (normalized device coordinates, NDC): z'=z.

7. The AR-based building renovation auxiliary design method according to claim 6, characterized in that: In the above-mentioned S5, the coordinates of the constructed graphics are added to each plane area based on the three-dimensional coordinate reference of the virtual model, and are simultaneously restricted to the virtual model image.

8. An AR-based building renovation auxiliary design system, which is used to implement the AR-based building renovation auxiliary design method according to any one of claims 1 to 7, characterized in that: include: The construction of virtual space model graphics and the addition and editing of construction images are realized by the feature acquisition module, the graphics generation module and the model construction module, and the addition and editing of construction images are realized by the graphics separation module, the graphics construction module and the feature superposition module; The feature acquisition module is used to obtain three-dimensional point cloud data of the building facade and internal structure; The graphics generation module is used to generate virtual content and accurately match the viewing angle and scale of the display scene; The model building module is used to seamlessly align virtual elements with real objects in spatial positions and construct a virtual model image with environmental features; The graphic separation module is used to split the virtual content generated by the graphic generation module into plane graphics and arrange them into various areas; The graphic construction module is used to generate various structural graphics added during building renovation; The feature superposition module is used to merge the added various structural graphics into the virtual model image.

9. The AR-based building renovation auxiliary design method and system according to claim 8, characterized in that: The feature acquisition module obtains the three-dimensional point cloud data of the building facade and internal structure, and finally uses the model construction module to seamlessly align the virtual elements and real objects in space, and construct a virtual model image with the environmental features.

10. The AR-based building renovation auxiliary design method and system according to claim 8, characterized in that: After the graphic separation module splits the virtual content generated by the graphic generation module into plane graphics and arranges them in various areas, the graphic construction module generates various structural graphics added during building renovation. Finally, the feature overlay module merges the added various structural graphics into the virtual model image to obtain real-time design effects during building renovation design.

Images