Building simulation display device and method based on unmanned aerial vehicle-mounted LiDAR technology

Through the drone platform equipped with LiDAR sensors and data processing units, combined with VR technology, the problems of low data processing efficiency and insufficient display in the existing technology are solved, and efficient and accurate three-dimensional architectural model generation and interactive display are achieved, suitable for In areas such as architectural design and education.

CN119048692AInactive Publication Date: 2024-11-29FUJIAN UNIV OF TECH ENG DESIGN CO LTD

Patent Information

Application Number
CN202411533370.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-31
Publication Date
2024-11-29
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing building simulation display device based on drone LiDAR has problems such as low data processing efficiency, difficulty in retaining model details, and insufficient visual display.

Method used

Design a system including a drone platform, data processing unit and display module, capture three-dimensional spatial data using LiDAR sensors, generate high-quality three-dimensional models through point cloud data processing, texture mapping and three-dimensional reconstruction algorithms, and provide interaction in combination with VR technology. style display.

Benefits of technology

It improves data acquisition efficiency and accuracy, enhances the visual authenticity and visual display effect of the model, is suitable for scenarios such as architectural design and education, lowers the technical threshold and improves the system safety and environmental protection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119048692A_ABST
    Figure CN119048692A_ABST
Patent Text Reader

Abstract

The invention discloses a building simulation display device and method based on an unmanned aerial vehicle LiDAR technology, and the architecture of the device comprises an unmanned aerial vehicle platform which is provided with a LiDAR sensor and is used for capturing the three-dimensional space data of a building; the data processing unit is in communication connection with the unmanned aerial vehicle platform and is used for receiving and processing data captured by the LiDAR sensor to generate a three-dimensional model of the building; and the display module is connected with the data processing unit and is used for performing building simulation display according to the three-dimensional model. According to the method, the LiDAR data can be efficiently and accurately processed, a high-quality three-dimensional building model can be generated, meanwhile, a visual and interactive display mode is provided, and the method has important significance in promoting technical progress in the building field.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of demonstration tools, and more specifically, it particularly relates to a building simulation display device based on drone-borne LiDAR technology. At the same time, the present invention also relates to a building simulation display method based on drone-borne LiDAR technology. Background Art

[0002] 3D modeling and simulation display are an indispensable part of the design and presentation process. Traditional 3D modeling technology mainly relies on manual measurement or ground-based laser scanning, which is not only time-consuming and labor-intensive, but also difficult to capture the full picture of the building, especially in complex terrain or tall buildings.

[0003] Using photogrammetry equipment such as cameras carried by drones, three-dimensional models of buildings can be reconstructed from two-dimensional photos. However, this method is still limited by the resolution and shooting conditions of the image, and there are limitations in capturing texture and geometric details. At the same time, the application of light detection and ranging (LiDAR) technology has become popular. It measures the distance by emitting laser pulses and receiving the signals reflected back, thereby obtaining high-precision spatial data.

[0004] The LiDAR system can penetrate vegetation and reduce the impact of weather and light changes on data acquisition, making it very suitable for fast and high-precision measurement of terrain and building exterior structures. Especially when combined with a drone platform, it can cover a larger area in a shorter time and capture data from multiple angles and heights, greatly improving the efficiency of data collection and the accuracy of the model.

[0005] Nevertheless, the existing UAV-based LiDAR architectural simulation display devices still have some shortcomings. For example, the processing of point cloud data and 3D reconstruction algorithms often require a lot of computing resources and time, and it is still a challenge to maintain details while reducing noise when converting a large amount of point cloud data into a continuous surface model. In addition, the generated model also needs to be further improved in terms of visualization to better serve application scenarios such as architectural design and education. Therefore, we propose an architectural simulation display device and method based on UAV-based LiDAR technology. Summary of the invention

[0006] The purpose of the present invention is to solve the shortcomings existing in the prior art, and to propose a building simulation display device and method based on drone-mounted LiDAR technology, which can efficiently and accurately process LiDAR data and generate high-quality three-dimensional building models, while providing an intuitive and interactive display method, which is of great significance for promoting technological progress in the field of architecture.

[0007] To achieve the above object, the present invention provides the following technical solutions:

[0008] A building simulation display device based on drone-borne LiDAR technology, comprising:

[0009] A drone platform equipped with a LiDAR sensor to capture three-dimensional spatial data of the building;

[0010] a data processing unit, in communication with the drone platform, for receiving and processing data captured by the LiDAR sensor to generate a three-dimensional model of the building;

[0011] A display module, connected to the data processing unit, for performing a building simulation display according to the three-dimensional model;

[0012] Wherein, the data processing unit further comprises:

[0013] A point cloud data processing subunit receives raw data from the LiDAR sensor, performs preprocessing, and extracts key features from the preprocessed point cloud data;

[0014] A 3D reconstruction subunit, which aligns point cloud data obtained by scanning at different angles and positions into a unified coordinate system, and reconstructs the surface of the object from the point cloud data;

[0015] The texture mapping subunit collects actual images of the building, extracts texture information through image processing technology, and maps the extracted texture to the surface of the three-dimensional model to enhance the visual authenticity of the model.

[0016] Preferably, the drone platform includes a drone hardware module and a drone software module;

[0017] The drone hardware module includes:

[0018] The aircraft frame constitutes the main structure of the drone and is responsible for supporting the various components of the drone. It is made of lightweight materials to reduce the overall weight, while considering the structural strength and stability, as well as the center of gravity distribution of the drone;

[0019] Sensors, used to sense the attitude, position, and speed parameters of the drone;

[0020] A controller for processing sensor signals and control instructions;

[0021] The propulsion system is used to provide thrust for flight, including motors and propellers, which directly affects flight efficiency and stability;

[0022] The remote controller is used to realize the human-computer interaction interface, send control commands to the drone, and realize remote control.

[0023] Preferably, the drone software module includes:

[0024] The flight control unit is used for flight control and mission execution, generating control instructions based on the drone state parameters and control algorithms;

[0025] Sensor data processing unit, used to process and fuse sensor data to obtain accurate drone status information;

[0026] The communication unit is used to realize information transmission and control signal transmission between the UAV and the ground station, and integrates anti-interference capability and data encryption subunits.

[0027] Preferably, the 3D reconstruction subunit aligns the point cloud data obtained by scanning at different angles and positions into a unified coordinate system, specifically:

[0028] Perform point cloud preprocessing, including filtering and cleaning data; use the obtained transformation matrix to find the nearest point as the corresponding point; adjust the weights of the corresponding points and remove unreasonable corresponding point pairs; finally calculate the loss function and continuously optimize iteratively to minimize the loss until convergence;

[0029] The point cloud data scanned at different angles and positions are aligned into a unified coordinate system. The goal is to find the best rotation matrix and translation vector so that the distance between the corresponding points of the source point cloud and the target point cloud is minimized. The calculation formula is:

[0030] In the formula, R ∗ and t ∗ are the optimal rotation matrix and translation vector respectively; is the source point cloud, ∣ ∣ is the number of points in the source point cloud; is the target point cloud, is the i-th point in the target point cloud, is the i-th point in the source point cloud;

[0031] This calculation formula is for each point in the source point cloud , find its nearest point in the target point cloud , then calculate the square of the distance between these two points, sum all such squared distances, and divide by the number of points in the source point cloud | ∣, and finally find the rotation matrix R and translation vector t that can minimize this average value.

[0032] Preferably, the object surface is reconstructed from the point cloud data, specifically:

[0033] Using the normal information of the point cloud, a vector field is constructed, which approximately represents the gradient of the indicator function. The basis functions are selected to represent the vector field and the indicator function, and a sparse linear system is constructed.

[0034] Discretize the sparse linear system, solve the sparse linear system, and obtain the approximate value of the indicator function;

[0035] Extract zero isosurfaces from the solved indicator function, optimize the extracted mesh, simplify the complex mesh model, reduce the number of vertices while maintaining surface details to adapt to different application scenarios;

[0036] The discretized sparse linear system is calculated as follows:

[0037] Δ = + ;

[0038] In the formula, Δ The discretized approximation of the Laplace operator at the grid node (i, j), through which the approximate curvature or rate of change of the point in the solution domain can be obtained; as well as are the function values ​​of the nodes on the right and left of node (i, j) respectively; as well as Respectively represent the function values ​​of the nodes above and below the node (i, j); as well as Represent the step size in the x and y directions respectively. The step size parameter is the scale factor of spatial discretization and determines the fineness of the discrete grid.

[0039] Preferably, the display module includes:

[0040] A model export module, used to convert the three-dimensional building model generated by the data processing unit into a format suitable for various display platforms;

[0041] VR model making module, used to re-encode the imported 3D model files to generate model files suitable for VR environment;

[0042] VR scene production module, used to assign material balls and textures to VR models and perform lighting processing to enhance the realism of the scene;

[0043] The VR display module is used to convert VR scene graphs into VR images in formats such as JPG, and can be easily copied to a PC or mobile terminal for display.

[0044] A method for architectural simulation display based on drone-borne LiDAR technology comprises the following steps:

[0045] S1. Use the UAV platform equipped with LiDAR sensors to capture the three-dimensional spatial data of the building;

[0046] S2. receiving and processing data captured by the LiDAR sensor through a data processing unit to generate a three-dimensional model of the building;

[0047] S3. Use a display module to perform architectural simulation display according to the three-dimensional model.

[0048] Preferably, the specific process of step S2 is:

[0049] S21, the point cloud data processing subunit receives the raw data from the LiDAR sensor, performs preprocessing, and extracts key features from the preprocessed point cloud data;

[0050] S22, the 3D reconstruction subunit aligns the point cloud data obtained by scanning at different angles and positions into a unified coordinate system, and reconstructs the surface of the object from the point cloud data;

[0051] S23, the texture mapping subunit collects actual images of the building, extracts texture information through image processing technology, and maps the extracted texture to the surface of the three-dimensional model to enhance the visual authenticity of the model.

[0052] Preferably, in step S3, using the display module to perform architectural simulation display according to the three-dimensional model includes:

[0053] S31, the model export module converts the three-dimensional building model generated by the data processing unit into a format suitable for various display platforms;

[0054] S32, the VR model making module re-encodes the imported three-dimensional model file to generate a model file suitable for the VR environment;

[0055] S33, VR scene production module assigns material balls and textures to VR models and performs lighting processing to enhance the realism of the scene;

[0056] S34, VR display module converts the VR scene graph into a VR image in a format such as JPG, and can be easily copied to a PC or mobile terminal for display.

[0057] The present invention provides a building simulation display device and method based on drone-mounted LiDAR technology. Compared with the prior art, the present invention has the following advantages:

[0058] Improve data collection efficiency and accuracy: The present invention can capture three-dimensional spatial data of buildings from multiple angles and positions in a relatively short period of time by using a drone platform equipped with a LiDAR sensor. Compared with traditional manual measurement or ground-based laser scanning methods, the present invention can greatly improve the efficiency and accuracy of data collection, and is particularly suitable for buildings in complex terrain or inaccessible areas.

[0059] Realize real-time data processing and 3D reconstruction: The data processing unit of the present invention uses an efficient algorithm to process the data captured by the LiDAR sensor in real time, including preprocessing of point cloud data, feature extraction and 3D reconstruction; this allows users to quickly obtain an accurate 3D model of the building, significantly shortening the time from data acquisition to model generation;

[0060] Enhanced visual realism of the model: Through the application of the texture mapping subunit, the image texture of the actual building is applied to the 3D model, which greatly enhances the visual details and realism of the model; this improvement makes the model not only accurate in geometry, but also highly consistent with the actual building in visual effects, providing strong support for design review and educational demonstration;

[0061] Providing interactive virtual experience: Combined with VR technology, the present invention can use the generated three-dimensional building model to create an immersive virtual experience; users can freely view and interact in the virtual environment through VR devices, providing a new way of architectural display, especially suitable for remote teaching, design evaluation and real estate display fields;

[0062] Optimize the stability and safety of the drone: The present invention adopts lightweight materials and reasonable structural layout in the design of the drone to ensure the stability and flight safety of the drone; at the same time, by integrating advanced sensors and control algorithms, the drone can achieve precise position control and stable data collection, improving the safety of operation and the reliability of data;

[0063] Ensure the security of data transmission: The communication unit of the present invention integrates data encryption and anti-interference technology to ensure the security and integrity of the data transmission process between the UAV and the ground station; this feature is crucial to protect the collected sensitive data from unauthorized access or tampering, and improves the overall security of the system;

[0064] User-friendly operation interface: The present invention provides an intuitive and easy-to-use operation interface, so that even non-professionals can easily control the drone and process data; through simplified operation procedures and clear user guidance, the technical threshold is greatly reduced and the scope of application of the present invention is broadened;

[0065] Reduced environmental impact: Since the present invention adopts a non-contact measurement method, the impact on the building and its surrounding environment is reduced; especially in data collection of historical buildings or sensitive areas, the present invention can avoid damage to the site, which is more environmentally friendly and sustainable. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] Figure 1 This is a schematic diagram of the architectural simulation display device based on drone-mounted LiDAR technology of the present invention;

[0067] Figure 2 This is a flow chart of the building simulation display method based on drone-mounted LiDAR technology of the present invention;

[0068] Figure 3 A flowchart of generating a three-dimensional model of a building in an embodiment of the present invention;

[0069] Figure 4 The present invention is a flowchart of a three-dimensional model for architectural simulation display. DETAILED DESCRIPTION

[0070] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention is further described in detail below in conjunction with specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0071] The present invention provides a building simulation display device and method based on drone-borne LiDAR technology, which shows significant advantages in improving data acquisition efficiency, processing speed, model quality, user experience and system security, and provides an innovative and efficient solution for the field of building simulation display.

[0072] Among them, Figure 1 As shown in the figure, the architectural simulation display device based on drone-mounted LiDAR technology has the following structure:

[0073] include:

[0074] A drone platform is configured with a LiDAR sensor for capturing three-dimensional spatial data of a building; further, the drone platform includes a drone hardware module and a drone software module;

[0075] The drone hardware module includes:

[0076] The aircraft frame constitutes the main structure of the drone and is responsible for supporting the various components of the drone. It is made of lightweight materials to reduce the overall weight, while considering the structural strength and stability, as well as the center of gravity distribution of the drone;

[0077] Sensors, used to sense the attitude, position, and speed parameters of the drone;

[0078] A controller for processing sensor signals and control instructions;

[0079] The propulsion system is used to provide thrust for flight, including motors and propellers, which directly affects flight efficiency and stability;

[0080] The remote controller is used to realize the human-computer interaction interface, send control commands to the drone, and realize remote control.

[0081] A data processing unit is communicatively connected to the UAV platform, and is used to receive and process data captured by the LiDAR sensor to generate a three-dimensional model of the building; wherein the data processing unit further includes:

[0082] A point cloud data processing subunit receives raw data from the LiDAR sensor, performs preprocessing, and extracts key features from the preprocessed point cloud data;

[0083] The 3D reconstruction subunit aligns the point cloud data obtained by scanning at different angles and positions into a unified coordinate system, and reconstructs the surface of the object from the point cloud data; the 3D reconstruction subunit aligns the point cloud data obtained by scanning at different angles and positions into a unified coordinate system, specifically:

[0084] Perform point cloud preprocessing, including filtering and cleaning data; use the obtained transformation matrix to find the nearest point as the corresponding point; adjust the weights of the corresponding points and remove unreasonable corresponding point pairs; finally calculate the loss function and continuously optimize iteratively to minimize the loss until convergence;

[0085] The point cloud data scanned at different angles and positions are aligned into a unified coordinate system. The goal is to find the best rotation matrix and translation vector so that the distance between the corresponding points of the source point cloud and the target point cloud is minimized. The calculation formula is:

[0086]

[0087] In the formula, R ∗ and t ∗ are the optimal rotation matrix and translation vector respectively; is the source point cloud, ∣ ∣ is the number of points in the source point cloud; is the target point cloud, is the i-th point in the target point cloud, is the i-th point in the source point cloud;

[0088] This calculation formula is for each point in the source point cloud , find its nearest point in the target point cloud , then calculate the square of the distance between these two points, sum all such squared distances, and divide by the number of points in the source point cloud | ∣, finally find the rotation matrix R and translation vector t that can minimize this average value;

[0089] Exemplarily, based on the above, the nearest point is found and the transformation matrix is ​​calculated, specifically:

[0090] Suppose there are two point cloud datasets P s and P t , respectively represent two parts of the same building scanned from different perspectives. The calculation process is as follows:

[0091] Obtain the initial rotation matrix R and translation vector t estimate by manual or automatic methods;

[0092] For P s For each point in P, use the search algorithm t Find the nearest point in

[0093] Build P s and P t The corresponding point pairs between ;

[0094] Assign weights according to the distance between corresponding point pairs, and remove corresponding point pairs that do not meet the requirements;

[0095] Iteratively optimize R and t to minimize the loss function, calculated as:

[0096] E= ;

[0097] Where N is the source point cloud P s The number of points in, p si and p ti are the i-th point in the source point cloud and the target point cloud respectively;

[0098] R and t are continuously updated through an iterative process until the change in the loss function E is less than a preset threshold or the maximum number of iterations is reached.

[0099] in,

[0100] It should be noted that the object surface will be reconstructed from the point cloud data, specifically:

[0101] Using the normal information of the point cloud, a vector field is constructed, which approximately represents the gradient of the indicator function. The basis functions are selected to represent the vector field and the indicator function, and a sparse linear system is constructed.

[0102] Discretize the sparse linear system, solve the sparse linear system, and obtain the approximate value of the indicator function;

[0103] Extract zero isosurfaces from the solved indicator function, optimize the extracted mesh, simplify the complex mesh model, reduce the number of vertices while maintaining surface details to adapt to different application scenarios;

[0104] The discretized sparse linear system is calculated as follows:

[0105] Δ = + ;

[0106] In the formula, Δ The discretized approximation of the Laplace operator at the grid node (i, j), through which the approximate curvature or rate of change of the point in the solution domain can be obtained;

[0107] as well as are the function values ​​of the nodes on the right and left of node (i, j) respectively;

[0108] as well as Respectively represent the function values ​​of the nodes above and below the node (i, j);

[0109] as well as Represent the step size in the x and y directions respectively. The step size parameter is the scale factor of spatial discretization and determines the fineness of the discrete grid.

[0110] The texture mapping subunit collects actual images of the building, extracts texture information through image processing technology, and maps the extracted texture to the surface of the three-dimensional model to enhance the visual authenticity of the model.

[0111] A display module is connected to the data processing unit and is used to perform a building simulation display according to the three-dimensional model; the display module includes:

[0112] A model export module, used to convert the three-dimensional building model generated by the data processing unit into a format suitable for various display platforms;

[0113] VR model making module, used to re-encode the imported 3D model files to generate model files suitable for VR environment;

[0114] VR scene production module, used to assign material balls and textures to VR models and perform lighting processing to enhance the realism of the scene;

[0115] The VR display module is used to convert VR scene graphs into VR images in formats such as JPG, and can be easily copied to a PC or mobile terminal for display.

[0116] This embodiment also proposes a building simulation display method based on drone-borne LiDAR technology, such as Figure 2 As shown, the following steps are included:

[0117] S1. Use the UAV platform equipped with LiDAR sensors to capture the three-dimensional spatial data of the building;

[0118] S2. receiving and processing the data captured by the LiDAR sensor through a data processing unit to generate a three-dimensional model of the building; Figure 3 As shown, the specific process of step S2 is:

[0119] S21, the point cloud data processing subunit receives the raw data from the LiDAR sensor, performs preprocessing, and extracts key features from the preprocessed point cloud data;

[0120] S22, the 3D reconstruction subunit aligns the point cloud data obtained by scanning at different angles and positions into a unified coordinate system, and reconstructs the surface of the object from the point cloud data;

[0121] S23, the texture mapping subunit collects the actual image of the building, extracts the texture information through the image processing technology, and maps the extracted texture to the surface of the three-dimensional model to enhance the visual authenticity of the model;

[0122] S3, using the display module to perform architectural simulation display according to the three-dimensional model; Figure 4 As shown, in step S3, using the display module to perform building simulation display according to the three-dimensional model includes:

[0123] S31, the model export module converts the three-dimensional building model generated by the data processing unit into a format suitable for various display platforms;

[0124] S32, the VR model making module re-encodes the imported three-dimensional model file to generate a model file suitable for the VR environment;

[0125] S33, VR scene production module assigns material balls and textures to VR models and performs lighting processing to enhance the realism of the scene;

[0126] S34, VR display module converts the VR scene graph into a VR image in a format such as JPG, and can be easily copied to a PC or mobile terminal for display.

[0127] Based on the above, specific examples are used in practice:

[0128] Use drone platforms equipped with LiDAR sensors to capture 3D spatial data of buildings: Use a DJI Matrice300 RTK drone equipped with a Velodyne Puck LiDAR sensor for flight missions; before flying, plan the flight path in the DJI GS Pro application to ensure that all sides of the building are covered, and set the flight altitude to 50 meters and the speed to 3 meters per second;

[0129] The data captured by the LiDAR sensor is received and processed by the data processing unit to generate a three-dimensional model of the building:

[0130] Point cloud data processing: The received raw data is first pre-processed by the open source software CloudCompare, including denoising and data filtering; then, feature extraction is performed using the Open3D library to identify the basic outline and structural features of the building;

[0131] 3D reconstruction: Import the processed point cloud data into Autodesk ReCap software and use its built-in alignment algorithm to align all scanned point clouds to a unified coordinate system; then, use the Poisson surface reconstruction algorithm to reconstruct the object surface from the aligned point clouds to generate a complete 3D model;

[0132] Texture mapping: To enhance the visual realism of the model, high-resolution photos were taken around the building using a Nikon D850 camera. These photos were then processed through AgiSoft Metashape software to extract texture information and map the extracted texture onto the 3D model.

[0133] Use the display module to perform architectural simulation display based on the three-dimensional model:

[0134] Model export: export the processed 3D model to .obj format, which is widely supported and applicable to various display platforms;

[0135] VR model production: Use the Unity3D game engine to re-encode the imported 3D model files to generate model files suitable for VR environments, while optimizing the number of polygons and texture resolution of the model to meet VR display requirements;

[0136] VR scene production: In Unity3D, assign material balls and textures to VR models, adjust reflectivity and glossiness parameters to make them more realistic; use the Enlighten system for global illumination processing, and set up multiple lights to simulate lighting effects at different times to enhance the realism of the scene;

[0137] VR display: Finally, use Unity3D to render the VR scene into VR images in JPG format and ensure that these images can be displayed on different devices, including Oculus Rift and HTC ViveVR headsets, as well as PC and mobile terminals, to provide an immersive viewing experience.

[0138] In summary, the present invention has the following advantages:

[0139] High-precision data acquisition: The use of LiDAR sensors can quickly and accurately capture the three-dimensional spatial data of a building, including its external structure and surrounding environment; the advantage of the LiDAR system is that it can provide high-density, high-precision point cloud data;

[0140] High-efficiency data processing: The data processing unit optimizes the processing flow of point cloud data through efficient algorithms, including data preprocessing, feature extraction, point cloud registration and 3D reconstruction steps, ensuring the rapid generation of accurate 3D building models;

[0141] Powerful 3D modeling capabilities: The device can not only process and reconstruct the geometric shape of objects, but also apply the texture of the actual building to the 3D model through the texture mapping subunit, improving the visual realism of the model;

[0142] Multi-angle panoramic display: Using VR technology, users can observe buildings from any angle and distance in a virtual environment, providing an immersive visual experience; the interactive display method is extremely useful for design review and educational demonstration scenarios;

[0143] Wide applicability: The system is applicable to a variety of building types and application scenarios, including but not limited to historical building records, building design verification, real estate display, and urban planning, and has broad market application prospects;

[0144] User-friendly operation interface: The remote control and user interface design make the drone operation and data processing intuitive and easy, lowering the technical threshold so that non-professionals can easily master and use it;

[0145] Safety and stability: The design of the UAV platform takes into account the safety and stability of flight. The reliability of the data collection process is ensured through reasonable center of gravity distribution, lightweight design and optimization of the propulsion system;

[0146] Anti-jamming communication capability: Integrated data encryption and anti-jamming capabilities ensure the security of communications between the drone and the ground station, preventing data from unauthorized access or tampering.

[0147] Finally, it should be noted that the above is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A building simulation display device based on drone-borne LiDAR technology, characterized in that: include: A drone platform equipped with a LiDAR sensor to capture three-dimensional spatial data of the building; a data processing unit, in communication with the drone platform, for receiving and processing data captured by the LiDAR sensor to generate a three-dimensional model of the building; A display module, connected to the data processing unit, for performing a building simulation display according to the three-dimensional model; Wherein, the data processing unit further comprises: A point cloud data processing subunit receives raw data from the LiDAR sensor, performs preprocessing, and extracts key features from the preprocessed point cloud data; The 3D reconstruction subunit aligns the point cloud data obtained by scanning at different angles and positions into a unified coordinate system, and reconstructs the surface of the object from the point cloud data; the 3D reconstruction subunit aligns the point cloud data obtained by scanning at different angles and positions into a unified coordinate system, specifically: Perform point cloud preprocessing, including filtering and cleaning data; use the obtained transformation matrix to find the nearest point as the corresponding point; adjust the weights of the corresponding points and remove unreasonable corresponding point pairs; finally calculate the loss function and continuously optimize iteratively to minimize the loss until convergence; The point cloud data scanned at different angles and positions are aligned into a unified coordinate system. The goal is to find the best rotation matrix and translation vector so that the distance between the corresponding points of the source point cloud and the target point cloud is minimized. The calculation formula is: ; In the formula, R ∗ and t ∗ are the optimal rotation matrix and translation vector respectively; is the source point cloud, ∣ ∣ is the number of points in the source point cloud; is the target point cloud, is the i-th point in the target point cloud, is the i-th point in the source point cloud; This calculation formula is for each point in the source point cloud , find its nearest point in the target point cloud , then calculate the square of the distance between these two points, sum all such squared distances, and divide by the number of points in the source point cloud | ∣, finally find the rotation matrix R and translation vector t that can minimize this average value; The texture mapping subunit collects actual images of the building, extracts texture information through image processing technology, and maps the extracted texture to the surface of the three-dimensional model to enhance the visual authenticity of the model.

2. The building simulation display device based on drone-mounted LiDAR technology according to claim 1, characterized in that: The drone platform includes a drone hardware module and a drone software module; The drone hardware module includes: The aircraft frame constitutes the main structure of the drone and is responsible for supporting the various components of the drone. It is made of lightweight materials to reduce the overall weight, while considering the structural strength and stability, as well as the center of gravity distribution of the drone; Sensors, used to sense the attitude, position, and speed parameters of the drone; A controller for processing sensor signals and control instructions; The propulsion system is used to provide thrust for flight, including motors and propellers, which directly affects flight efficiency and stability; The remote controller is used to realize the human-computer interaction interface, send control commands to the drone, and realize remote control.

3. The building simulation display device based on drone-mounted LiDAR technology according to claim 2, characterized in that: The drone software module includes: The flight control unit is used for flight control and mission execution, generating control instructions based on the drone state parameters and control algorithms; Sensor data processing unit, used to process and fuse sensor data to obtain accurate drone status information; The communication unit is used to realize information transmission and control signal transmission between the UAV and the ground station, and integrates anti-interference capability and data encryption subunits.

4. The building simulation display device based on drone-mounted LiDAR technology according to claim 1, characterized in that: The object surface will be reconstructed from the point cloud data, specifically: Using the normal information of the point cloud, a vector field is constructed, which approximately represents the gradient of the indicator function. The basis functions are selected to represent the vector field and the indicator function, and a sparse linear system is constructed. Discretize the sparse linear system, solve the sparse linear system, and obtain the approximate value of the indicator function; Extract zero isosurfaces from the solved indicator function, optimize the extracted mesh, simplify the complex mesh model, reduce the number of vertices while maintaining surface details to adapt to different application scenarios; The discretized sparse linear system is calculated as follows: D = + ; In the formula, Δ The discretized approximation of the Laplace operator at the grid node (i, j), through which the approximate curvature or rate of change of the point in the solution domain can be obtained; as well as are the function values ​​of the nodes on the right and left of node (i, j) respectively; as well as Respectively represent the function values ​​of the nodes above and below the node (i, j); as well as Represent the step size in the x and y directions respectively. The step size parameter is the scale factor of spatial discretization and determines the fineness of the discrete grid.

5. The building simulation display device based on drone-mounted LiDAR technology according to claim 1, characterized in that: The display module comprises: A model export module, used to convert the three-dimensional building model generated by the data processing unit into a format suitable for various display platforms; VR model making module, used to re-encode the imported 3D model files to generate model files suitable for VR environment; VR scene production module, used to assign material balls and textures to VR models and perform lighting processing to enhance the realism of the scene; The VR display module is used to convert VR scene graphs into VR images in formats such as JPG, and can be easily copied to a PC or mobile terminal for display.

6. A method for architectural simulation display based on drone-borne LiDAR technology, the method using the device described in any one of claims 1 to 5, characterized in that: The steps include: S1. Use the UAV platform equipped with LiDAR sensors to capture the three-dimensional spatial data of the building; S2. receiving and processing data captured by the LiDAR sensor through a data processing unit to generate a three-dimensional model of the building; S3. Use a display module to perform architectural simulation display according to the three-dimensional model.

7. The architectural simulation display method based on drone-borne LiDAR technology according to claim 6 is characterized in that: The specific process of step S2 is: S21, the point cloud data processing subunit receives the raw data from the LiDAR sensor, performs preprocessing, and extracts key features from the preprocessed point cloud data; S22, the 3D reconstruction subunit aligns the point cloud data obtained by scanning at different angles and positions into a unified coordinate system, and reconstructs the surface of the object from the point cloud data; S23, the texture mapping subunit collects actual images of the building, extracts texture information through image processing technology, and maps the extracted texture to the surface of the three-dimensional model to enhance the visual authenticity of the model.

8. The method for architectural simulation display based on drone-borne LiDAR technology according to claim 6, characterized in that: In step S3, the using of the display module to perform architectural simulation display according to the three-dimensional model includes: S31, the model export module converts the three-dimensional building model generated by the data processing unit into a format suitable for various display platforms; S32, the VR model making module re-encodes the imported three-dimensional model file to generate a model file suitable for the VR environment; S33, VR scene production module assigns material balls and textures to VR models and performs lighting processing to enhance the realism of the scene; S34, VR display module converts the VR scene graph into a VR image in a format such as JPG, and can be easily copied to a PC or mobile terminal for display.

Citation Information

Patent Citations

  • Three-dimensional building model comprehensive display system and display method thereof

    CN108510588A

  • Real scene three-dimensional modeling method based on power grid GIS platform

    CN116977586A

  • Intelligent under-construction line data acquisition system based on autonomous flight of unmanned aerial vehicle

    CN118034372A

  • Device and method for automated, three-dimensional building data modelling

    WO2024160612A1

Cited By

  • Intelligent design and VR virtual display platform

    CN121366251A