Three-dimensional model real-time reconstruction method, device and system
By real-time judgment and three-dimensional model reconstruction during image data acquisition, the problem of lack of timeliness in the three-dimensional reconstruction process in the existing technology is solved, and fast and accurate three-dimensional model reconstruction is achieved, meeting the analysis needs of emergency scenarios.
Patent Information
- Application Number
- CN202310547183.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2023-03-17
- Filing Date
- 2023-05-15
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2043-05-15
AI Technical Summary
When facing the needs of emergency surveying and mapping of major geological disasters and accident site restoration, existing three-dimensional reconstruction technologies lack timeliness and cannot respond to the needs of three-dimensional scene recovery in a short time.
By acquiring multiple image data and determining the projection overlap between them and the target tile, the three-dimensional model reconstruction is carried out in real time when the projection is completely covered and the overlap is not less than the preset threshold, and the image data is used by the aircraft and the operation node. Real-time collection and processing.
It realizes the acquisition and reconstruction while collecting and rebuilding, and quickly completes the real-time reconstruction of the three-dimensional model, provides accurate three-dimensional models for analysis, and meets the timeliness and accuracy requirements of urgent needs.
Smart Images

Figure CN116843824B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of model reconstruction, and in particular to a method, device and system for real-time reconstruction of a three-dimensional model. Background Art
[0002] In recent years, the emergence of technologies such as oblique aerial photography and drone photography has provided solutions for the reconstruction of real-life 3D models of large scenes based on images. The current 3D reconstruction workflow includes: early route planning and design, mid-term image data acquisition, and late 3D reconstruction. Among them, after completing the acquisition and sorting of all image data, the image data will be transmitted from the flight site back to the rear internal production unit for post-processing. The basic process is to perform overall aerial triangulation of all image data, solve the precise internal and external orientation elements of each image, and then reconstruct the 3D model in blocks, and finally produce a real-life 3D model of the entire flight operation area. The entire 3D reconstruction process takes a long time.
[0003] However, when faced with application requirements such as emergency mapping of major geological disasters and restoration of accident sites, which require the restoration of on-site 3D scenes in a short period of time, the 3D reconstruction process of existing 3D reconstruction technologies lacks timeliness and cannot respond to application requirements in a timely manner. Therefore, in response to many current emergency needs, it is necessary to provide an effective solution that can complete 3D reconstruction in real time in a short period of time and provide accurate 3D models for analysis. Summary of the invention
[0004] In view of this, the purpose of the present invention is to provide a method, device and system for real-time reconstruction of a three-dimensional model, which can complete the three-dimensional reconstruction in a timely manner during the image data acquisition process and provide an accurate three-dimensional model for analysis.
[0005] In order to achieve the above purpose, the technical solution adopted by the embodiment of the present invention is as follows:
[0006] In a first aspect, the present invention provides a method for real-time reconstruction of a three-dimensional model, the method comprising: acquiring multiple image data; determining a projection overlap between the multiple image data and a target tile; wherein the projection overlap represents a degree of overlap between the projections of the multiple image data and the target tile, and the target tile is a tile in an area to be reconstructed; when the projections of the multiple image data completely cover the target tile and the projection overlap is not less than a preset threshold, performing three-dimensional model reconstruction on the target tile according to the multiple image data to reconstruct a three-dimensional model corresponding to the target tile.
[0007] In a second aspect, the present invention provides a three-dimensional model real-time reconstruction device, comprising an acquisition module and a processing module; wherein the acquisition module is used to acquire multiple image data; the processing module is used to determine the projection overlap between the multiple image data and a target tile; wherein the projection overlap represents the degree of overlap between the projections of the multiple image data and the target tile, and the target tile is a tile in the area to be reconstructed; the processing module is also used to perform three-dimensional model reconstruction on the target tile according to the multiple image data when the projections of the multiple image data completely cover the target tile and the projection overlap is not less than a preset threshold, so as to reconstruct the three-dimensional model corresponding to the target tile.
[0008] In an optional embodiment, the processing module is used to determine the projection overlap between the multiple image data and the target tile, specifically including: the processing module is used to obtain multiple associated image data associated with the target tile from the multiple image data, and the projection of each of the associated image data overlaps with the target tile; the processing module is also used to calculate the projection overlap based on the multiple associated image data and the target tile.
[0009] In an optional embodiment, the acquisition module is used to acquire multiple image data, specifically including: the acquisition module is used to use an aircraft to photograph the area to be reconstructed to acquire the multiple image data in real time in a time sequence.
[0010] In an optional embodiment, the flight trajectory of the aircraft includes a plurality of connected circumferential paths, wherein the plurality of circumferential paths includes a circumferential path circling the target tile.
[0011] In an optional embodiment, the step of planning the flight trajectory of the aircraft includes: planning the flight trajectory of the aircraft according to the geographic data of the area to be reconstructed and a preset flight mode, and the flight mode includes any one of the following: single-drone single-lens circling flight, single-drone single-lens area flight, single-drone single-lens swing-sweep flight, single-drone multi-lens swing-sweep flight, single-drone multi-lens area flight and multi-drone cluster joint area flight.
[0012] In an optional embodiment, the processing module is used to reconstruct the three-dimensional model of the target tile according to the multiple image data, including: the processing module is used to use one or more running nodes to reconstruct the three-dimensional model of the target tile according to the multiple image data; wherein, when the three-dimensional model of the target tile is reconstructed according to the multiple image data using multiple running nodes, each of the running nodes is used to reconstruct the three-dimensional model of a part of the target tile according to the multiple image data.
[0013] In an optional embodiment, each of the image data includes an image and camera parameters and pose parameters of the image.
[0014] In an optional embodiment, the resolution of the image includes the original resolution or a resolution reduced after arbitrary thinning.
[0015] In a third aspect, the present invention provides a three-dimensional model real-time reconstruction system, comprising an aircraft and at least one operating node, wherein the aircraft is connected to the at least one operating node; wherein the aircraft is connected to the at least one operating node in the following manners: wireless direct connection or connection through an intermediate transmission device; wherein the aircraft is used to obtain multiple image data; wherein the at least one operating node is used to determine the projection overlap between the multiple image data and a target tile; wherein the projection overlap represents the degree of overlap between the projections of the multiple image data and the target tile, and the target tile is a tile in the area to be reconstructed; wherein the at least one operating node is also used to perform three-dimensional model reconstruction on the target tile according to the multiple image data when the projections of the multiple image data completely cover the target tile and the projection overlap is not less than a preset threshold, so as to reconstruct a three-dimensional model corresponding to the target tile.
[0016] In the real-time reconstruction method, device and system of the three-dimensional model provided by the embodiment of the present invention, since the projections of multiple image data completely cover the target tile and the projection overlap is not less than the preset threshold, the three-dimensional model of the target tile is reconstructed using multiple image data. Therefore, it can be ensured that the accuracy of the three-dimensional model corresponding to the reconstructed target tile is higher than the preset degree, and the accuracy requirement of the model is met. In addition, since the target tile is a tile in the area to be reconstructed, the amount of data of the multiple image data used for reconstruction is small, so that the three-dimensional model reconstruction can be realized while the image data is collected. Based on this, the embodiment of the present invention can realize fast real-time reconstruction of the three-dimensional model, and can accurately reconstruct the three-dimensional model of the tile in the area to be reconstructed. In other words, in the process of image data acquisition, three-dimensional reconstruction is performed while image data is collected, so as to complete the three-dimensional reconstruction in time and provide an accurate three-dimensional model for analysis.
[0017] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the embodiments of the present invention are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments of the present invention are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.
[0019] Figure 1 A schematic diagram of a real-time reconstruction system for a three-dimensional model provided by an embodiment of the present invention;
[0020] Figure 2 A schematic diagram of a flow chart of a method for real-time reconstruction of a three-dimensional model provided by an embodiment of the present invention;
[0021] Figure 3 A functional module diagram of a three-dimensional model real-time reconstruction device provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0022] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.
[0023] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0024] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.
[0025] In addition, the terms “first”, “second”, etc., if used, are merely used to distinguish between the descriptions and should not be understood as indicating or implying relative importance.
[0026] It should be noted that, in the absence of conflict, the features in the embodiments of the present invention may be combined with each other.
[0027] The embodiment of the present invention provides a technical solution, which includes a method, device and system for real-time reconstruction of a three-dimensional model. The technical solution provided by the present invention will be described below in conjunction with the accompanying drawings.
[0028] First, a three-dimensional model real-time reconstruction system provided by an embodiment of the present invention is introduced. Figure 1 , Figure 1 A schematic diagram of a three-dimensional model real-time reconstruction system provided by an embodiment of the present invention. The three-dimensional model real-time reconstruction system 100 includes an aircraft 110 and at least one operation node 120, and the aircraft 110 is connected to the at least one operation node 120 (for example, via a wireless network). The aircraft 110 and the at least one operation node 120 can be used to perform the three-dimensional model real-time reconstruction method provided by an embodiment of the present invention. The at least one operation node 120 can be included in a ground workstation.
[0029] The connection between the aircraft 110 and at least one operation node 120 includes: wireless direct connection or connection through an intermediate transmission device. Wireless direct connection means that the connection between the aircraft 110 and the operation node 120 does not forward signals through other devices. Connection through an intermediate transmission device means that the connection between the aircraft 110 and the operation node 120 forwards signals through other devices. Specifically, the intermediate transmission device may include a remote controller or other file transmission media device, etc., which is not limited to this.
[0030] In an optional embodiment, the aircraft 110 includes a drone, an airship, an airplane, a balloon, etc. The operation node 120 may include a processor connected to a memory, and the processor is used to execute a computer program in the memory so that the real-time reconstruction method of a three-dimensional model provided in an embodiment of the present invention (see below for details) is executed. In an optional embodiment, the operation node 120 includes but is not limited to: a personal computer, a server, a laptop, a desktop, a tablet computer, etc.
[0031] exist Figure 1 Based on the 3D model real-time reconstruction system 100 shown, the embodiment of the present invention also provides a 3D model real-time reconstruction method, which can be applied to the 3D model real-time reconstruction system 100 and can be executed by the 3D model real-time reconstruction system 100. Figure 2 , Figure 2 A schematic flow chart of a method for real-time reconstruction of a three-dimensional model provided in an embodiment of the present invention.
[0032] The real-time reconstruction method of the three-dimensional model may include the following steps S110 to S130, which are described below respectively.
[0033] S110, acquiring a plurality of image data.
[0034] In one embodiment, the aircraft 110 may take photos or videos, and the video may be generated into photos by extracting key frames to obtain the image data required in s110.
[0035] Optionally, each of the image data includes an image and camera parameters and position and posture parameters of the image, wherein the camera parameters and position and posture parameters of the image can be obtained by performing aerial triangulation on the image.
[0036] Optionally, the resolution of the image includes the original resolution or a resolution reduced after arbitrary thinning, which can improve the accuracy of the reconstructed model.
[0037] S120, determining the projection overlap between the plurality of image data and the target tile.
[0038] In 3D reconstruction, the entire area to be reconstructed can be divided into several small areas, each of which is called a tile. The target tile can be any of these small areas. The tile division can be adjusted according to the characteristics and requirements of the area to be reconstructed, for example, it can be divided in a grid or raster manner.
[0039] The projection overlap indicates the degree of overlap between the projections of the plurality of image data and the target tile, and the target tile is any tile in the area to be reconstructed. For example, the overlapping area between the projection of each image data in the plurality of image data and the target tile can be calculated (to obtain a plurality of overlapping areas), and thus, the projection overlap between the plurality of image data and the target tile = the area corresponding to all overlapping parts of the plurality of overlapping areas / the area corresponding to the target tile.
[0040] In an optional embodiment, S110, acquiring multiple image data, includes: photographing the area to be reconstructed using the aircraft 110 to acquire multiple image data in real time in a time sequence. Specifically, the aircraft 110 photographs the area to be reconstructed to acquire image data of the area to be reconstructed, and sends the real-time acquired image data to the operation node 120 via a wireless network. In this way, the operation node 120 can receive multiple image data in real time in a time sequence.
[0041] In an optional embodiment, the flight trajectory of the aircraft 110 includes a plurality of connected circling paths, and the plurality of circling paths include a circling path circling the target tile. In other words, the flight trajectory can be planned according to the tiles of the area to be reconstructed, for example, a circling path (for example, a circular trajectory, an elliptical trajectory, an irregular circling trajectory, etc.) circling each tile (or a plurality of tiles gathered together) as the center is planned, and these circling paths are connected in sequence, and all connected circling paths can be used as the flight trajectory. In this way, the aircraft 110 is controlled to shoot the tiles by circling flight, and each circling collects image data of a tile (or a plurality of tiles gathered together). Therefore, when a circling is completed, the image data of the tile corresponding to the circling can be collected, and the projection overlap between the plurality of image data and the tile can be not less than a preset threshold, that is, the projection overlap can be greater than, greater than or equal to the preset threshold, so that S130 can be executed, that is, the three-dimensional model of the tile is reconstructed. In this way, the efficiency of image data acquisition and tile reconstruction can be improved, and the purpose of performing three-dimensional reconstruction while acquiring image data on the fly and completing the three-dimensional reconstruction in a timely manner can be achieved.
[0042] The step of planning the flight trajectory of the aircraft 110 includes: planning the flight trajectory of the aircraft 110 according to the geographic data of the area to be reconstructed and the preset flight mode. The flight mode includes any one of the following: single-drone single-lens circling flight, single-drone single-lens regional flight, single-drone single-lens swing-sweep flight, single-drone multi-lens swing-sweep flight, single-drone multi-lens regional flight, and multi-drone cluster joint regional flight.
[0043] S130, when the projections of the multiple image data completely cover the target tile and the projection overlap is not less than a preset threshold, that is, when the projection overlap is greater than, greater than or equal to the preset threshold, a three-dimensional model of the target tile is reconstructed according to the multiple image data to reconstruct a three-dimensional model corresponding to the target tile.
[0044] For example, a 3D reconstruction task is established according to the image, camera parameters and posture parameters of each image data in the multiple image data, so as to reconstruct the 3D model corresponding to the target tile. Optionally, the value range of the preset threshold may include [10%, 100%]. For example, assuming that the second preset threshold is 60%, then when the projections of the multiple image data completely cover the target tile and the projection overlap is greater than 60%, the 3D model of the target tile can be reconstructed according to the multiple image data to reconstruct the 3D model corresponding to the target tile.
[0045] Among them, the process of judging whether the projections of multiple image data completely cover the target tile and whether the projection overlap is not less than a preset threshold (that is, the projection overlap can be greater than, greater than or equal to the preset threshold) can be considered as judging whether the multiple image data meet the data completeness condition.
[0046] In an optional embodiment, S130, reconstructing a three-dimensional model of the target tile according to the multiple image data, includes: utilizing one or more operating nodes 120 to reconstruct a three-dimensional model of the target tile according to the multiple image data.
[0047] When multiple operating nodes 120 are used to reconstruct the three-dimensional model of the target tile according to multiple image data, each operating node 120 is used to reconstruct the three-dimensional model of a part of the target tile according to the multiple image data. In this way, multiple operating nodes 120 can perform three-dimensional model reconstruction on the target tile in parallel, thereby improving reconstruction efficiency and shortening reconstruction time.
[0048] In an optional embodiment, S120, determining the projection overlap between multiple image data and a target tile includes: obtaining multiple associated image data associated with the target tile from the multiple image data, wherein the projection of each associated image data overlaps with the target tile; and calculating the projection overlap based on the multiple associated image data and the target tile. In this embodiment, S130, when the projections of the multiple image data completely cover the target tile and the projection overlap is not less than a preset threshold, that is, when the projection overlap can be greater than, can be greater than or equal to the preset threshold, reconstructing a three-dimensional model of the target tile based on the multiple image data includes: when the projections of the multiple associated image data completely cover the target tile and the projection overlap is not less than the preset threshold, that is, when the projection overlap can be greater than, can be greater than or equal to the preset threshold, reconstructing a three-dimensional model of the target tile based on the multiple associated image data.
[0049] When calculating the associated image data, whether an image data is associated with a target tile can be calculated based on the camera parameters and posture parameters in the image data. For example, calculate whether there is an overlap between the projection of an image data and a tile. When there is an overlap between the projection of an image data and a tile, the image data is recorded as the associated image data associated with the tile. Alternatively, when there is an overlapping portion between the projection of an image data and a tile and the overlapping portion is greater than an overlapping threshold, the image data is recorded as the associated image data associated with the tile. Optionally, the value range of the overlap threshold may include [10%, 60%].
[0050] Among them, the target tile can be reconstructed into a three-dimensional model according to the multiple associated image data to reconstruct the three-dimensional model corresponding to the target tile. For example, a three-dimensional reconstruction task is established according to the image, camera parameters and posture parameters of each associated image data in the multiple associated image data, so as to reconstruct the three-dimensional model corresponding to the target tile. In this way, the image data used in the reconstruction process can be data associated with the target tile (that is, valid data), and invalid image data can be avoided from being added to the reconstruction of the three-dimensional model, which can not only improve the accuracy of the model, but also reduce the amount of calculation and improve the calculation efficiency.
[0051] It can be understood that the technical solutions provided by the above method embodiment are summarized as follows: 1. The three-dimensional model real-time reconstruction system 100 can support and be compatible with multiple flight modes of the aircraft 110. During the actual flight operation, the aircraft 110 can adopt corresponding flight modes according to factors such as the geometric shape, topography and flight efficiency of the geographical scope of the operation, such as single-drone single-lens circling flight, single-drone single-lens regional flight, single-drone single-lens swing-sweep flight, single-drone multi-lens swing-sweep flight, single-drone multi-lens regional flight and multi-drone cluster joint regional flight. 2. The ground workstation (including the at least one operating node 120) in the three-dimensional model real-time reconstruction system 100 can receive the image data sent back by the aircraft 110 in real time, monitor the flight status of the aircraft 110 in real time, judge the data correlation of the flight area in real time (that is, calculate the associated image data), and detect the data completeness conditions of the tiles to be reconstructed in real time. When it is detected that a tile to be reconstructed meets the data completeness conditions, the relevant image data will be collected immediately and a reconstruction task will be created. Thereby, the automation of the entire process of three-dimensional reconstruction is realized without manual intervention. 3. During the process of collecting image data by the drone, the 3D model real-time reconstruction system 100 transmits the image data with original resolution to the ground workstation in real time, and uses the high-performance multi-operation nodes 120 of the workstation to perform aerial triangulation and block modeling in real time, which can achieve "minute-level" operation response and provide a computing basis for the real-time production of refined 3D models. 4. The entire operation process of the 3D model real-time reconstruction system 100 uses image data with original resolution, without data compression loss, which can ensure the calculation accuracy of each stage of reconstruction and provide a data basis for the real-time production of refined 3D models.
[0052] It can be understood that in the above-mentioned three-dimensional model real-time reconstruction system 100, since the projections of the multiple image data completely cover the target tile and the projection overlap is not less than the preset threshold, that is, the projection overlap can be greater than, greater than or equal to the preset threshold, the multiple image data are used to reconstruct the three-dimensional model of the target tile, so that the accuracy of the reconstructed three-dimensional model corresponding to the target tile can be guaranteed to be higher than the preset degree, and the accuracy requirement of the model is met. In addition, since the target tile is a tile in the area to be reconstructed, the amount of data of the multiple image data used for reconstruction is small, so that the three-dimensional model reconstruction can be realized while the image data is collected. Based on this, the embodiment of the present invention can realize fast real-time reconstruction of the three-dimensional model, and can accurately reconstruct the three-dimensional model of the tile in the area to be reconstructed. In other words, in the process of image data acquisition, the three-dimensional reconstruction is performed while the image data is collected, so as to complete the three-dimensional reconstruction in time and provide an accurate three-dimensional model for analysis.
[0053] In order to execute the corresponding steps in the above embodiments and various possible methods, a method for implementing a real-time reconstruction device for a three-dimensional model is given below. Figure 3 , Figure 3 The functional module diagram of a 3D model real-time reconstruction device provided by an embodiment of the present invention is shown. The 3D model real-time reconstruction device 300 can be used to implement the above Figure 2 It should be noted that the basic principle and technical effect of the real-time reconstruction device 300 of a three-dimensional model provided in this embodiment are the same as those of the above-mentioned embodiments. For the sake of brief description, for the parts not mentioned in this embodiment, reference can be made to the corresponding contents in the above-mentioned embodiments. The real-time reconstruction device 300 of a three-dimensional model may include: an acquisition module 310 and a processing module 320.
[0054] Optionally, the above modules can be stored in the memory in the form of software or firmware or fixed in the memory provided by the present invention. Figure 1 The operating system (OS) of the running node 120 shown in FIG. Figure 1 The processor in the operation node 120 shown is executed. Meanwhile, the data, program codes, etc. required to execute the above modules can be stored in the memory.
[0055] It is understandable that the acquisition module 310 and the processing module 320 can be used to support Figure 1 The running node shown executes the relevant steps in the above method embodiment, and / or other processes used for the technology described in this article, such as the above Figure 2 The method embodiments shown and the various method embodiments described above are not limited to this.
[0056] Based on the above method embodiment, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above three-dimensional model real-time reconstruction method are executed.
[0057] Specifically, the storage medium can be a general storage medium, such as a mobile disk, a hard disk, etc. When the computer program on the storage medium is run, it can execute the method in the above embodiment, thereby solving the problem that "the three-dimensional reconstruction process of the existing three-dimensional reconstruction technology lacks timeliness and cannot respond to application requirements in a timely manner". It can complete the three-dimensional reconstruction in a timely manner during the image data acquisition process and provide an accurate three-dimensional model for analysis.
[0058] The above description is only an embodiment of the present invention and is not intended to limit the protection scope of the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A method for real-time reconstruction of a three-dimensional model, characterized in that: The method comprises: S110, acquiring a plurality of image data; The aircraft takes photos or videos, and the video generates photos by extracting key frames to obtain the image data required by s110; Each of the image data includes an image and camera parameters and posture parameters of the image; wherein the camera parameters and posture parameters of the image are obtained by performing aerial triangulation on the image; The resolution of the image includes the original resolution or the resolution reduced after arbitrary thinning; In the S110, it specifically includes: using the aircraft to photograph the area to be reconstructed to obtain multiple image data in real time according to the time sequence; the aircraft photographs the area to be reconstructed to collect image data of the area to be reconstructed, and sends the real-time collected image data to the operation node through a wireless network; the operation node receives the multiple image data in real time according to the time sequence; The flight trajectory of the aircraft includes a plurality of connected circling paths, wherein the plurality of circling paths include a circling path circling a target tile; the flight trajectory is planned according to the tiles of the area to be reconstructed, and a circling path circling the center is planned with each tile or a plurality of tiles gathered together as the center, and the circling paths are connected in sequence, and all connected circling paths are used as the flight trajectory; the aircraft is controlled to shoot the tiles in a circling flight manner, and each circling flight collects image data of one tile or a plurality of tiles gathered together; The step of planning the flight trajectory of the aircraft includes: planning the flight trajectory of the aircraft according to the geographic data of the area to be reconstructed and the preset flight mode; wherein the flight mode includes any one of the following: single-drone single-lens circling flight, single-drone single-lens regional flight, single-drone single-lens swing-sweep flight, single-drone multi-lens swing-sweep flight, single-drone multi-lens regional flight and multi-drone cluster joint regional flight; S120, determining the projection overlap between the plurality of image data and the target tile; In 3D reconstruction, the entire area to be reconstructed is divided into several small areas, each of which is called a tile. The target tile is any one of these small areas. The tile division is adjusted according to the characteristics and requirements of the area to be reconstructed, and is divided in a grid or raster manner. The projection overlap degree indicates the overlap degree between the projections of the multiple image data and the target tile, and the target tile is any tile in the area to be reconstructed; the overlap area between the projection of each image data in the multiple image data and the target tile is calculated to obtain multiple overlap areas, so that the projection overlap degree between the multiple image data and the target tile is equal to the area corresponding to all the overlapping parts of the multiple overlap areas / the area corresponding to the target tile; In the S120, it also includes: acquiring a plurality of associated image data associated with the target tile from the plurality of image data, wherein the projection of each associated image data overlaps with the target tile; and calculating the projection overlap degree according to the plurality of associated image data and the target tile; S130, when the projections of the plurality of image data completely cover the target tile and the projection overlap is not less than a preset threshold, that is, when the projection overlap is greater than or equal to the preset threshold, reconstructing a three-dimensional model of the target tile according to the plurality of image data to reconstruct a three-dimensional model corresponding to the target tile; A three-dimensional reconstruction task is established according to the image, camera parameters and posture parameters of each image data in the multiple image data, so as to reconstruct a three-dimensional model corresponding to the target tile; the value range of the preset threshold includes [10%, 100%]; Among them, the process of judging whether the projections of multiple image data completely cover the target tile and whether the projection overlap is not less than a preset threshold is considered to be judging whether the multiple image data meet the data completeness condition; In the S130, specifically including: using one or more operating nodes to perform a three-dimensional model reconstruction on the target tile according to the multiple image data; When a plurality of operating nodes are used to reconstruct a three-dimensional model of a target tile according to a plurality of image data, each operating node is used to reconstruct a three-dimensional model of a portion of the target tile according to the plurality of image data; and the plurality of operating nodes are used to reconstruct a three-dimensional model of the target tile in parallel; The S130 further includes: when the projections of the plurality of associated image data completely cover the target tile and the projection overlap is not less than a preset threshold, reconstructing a three-dimensional model of the target tile according to the plurality of associated image data; Wherein, when calculating the associated image data, whether an image data is associated with a target tile is calculated according to the camera parameters and posture parameters in the image data; whether there is overlap between the projection of an image data and a tile is calculated, and when there is overlap between the projection of an image data and a tile, the image data is recorded as the associated image data associated with the tile; or, when there is an overlap between the projection of an image data and a tile and the overlap is greater than an overlap threshold, the image data is recorded as the associated image data associated with the tile; the value range of the overlap threshold includes [10%, 60%]; Among them, a three-dimensional model of a target tile is reconstructed according to a plurality of associated image data to reconstruct a three-dimensional model corresponding to the target tile; a three-dimensional reconstruction task is established according to the image, camera parameters and posture parameters of each associated image data in the plurality of associated image data, so as to reconstruct the three-dimensional model corresponding to the target tile; the image data used in the reconstruction process is the data associated with the target tile, that is, the valid data, so as to avoid invalid image data being added to the reconstruction of the three-dimensional model.
2. A 3D model real-time reconstruction device, based on the 3D model real-time reconstruction method according to claim 1, characterized in that: It includes an acquisition module and a processing module; wherein, The acquisition module is used to acquire a plurality of image data; The processing module is used to determine the projection overlap between the multiple image data and the target tile; wherein the projection overlap represents the overlap degree between the projections of the multiple image data and the target tile, and the target tile is a tile in the area to be reconstructed; The processing module is further configured to reconstruct a three-dimensional model of the target tile according to the multiple image data when the projections of the multiple image data completely cover the target tile and the projection overlap is not less than a preset threshold, so as to reconstruct a three-dimensional model corresponding to the target tile.
3. A three-dimensional model real-time reconstruction system, based on the three-dimensional model real-time reconstruction method according to claim 1, characterized in that: The invention comprises an aircraft and at least one operation node, wherein the aircraft is connected to the at least one operation node; wherein the aircraft is connected to the at least one operation node in a manner including: wireless direct connection or connection through an intermediate transmission device; The aircraft is used to acquire a plurality of image data; The at least one operating node is used to determine a projection overlap between the plurality of image data and a target tile; wherein the projection overlap represents an overlap degree between the projections of the plurality of image data and the target tile, and the target tile is a tile in the area to be reconstructed; The at least one operating node is further configured to reconstruct a three-dimensional model of the target tile according to the multiple image data when the projections of the multiple image data completely cover the target tile and the projection overlap is not less than a preset threshold, so as to reconstruct a three-dimensional model corresponding to the target tile.
