The invention discloses a three-dimensional 
building model library system construction method based on an unmanned aerial vehicle 
aerial image sequence, and the method comprises the steps: employing an unmanned aerial vehicle to carry out the high-overlapping-rate shooting of the right upper part, front, rear, left and right directions of a building, and collecting the building image data; obtaining a sparse three-dimensional 
point cloud through an aerial 
triangulation method based on the building image data; carrying out dense matching on the sparse three-dimensional point clouds to obtain dense point clouds; taking the dense 
point cloud as input, obtaining a three-dimensional 
mesh model of the building based on a 
Delaunay triangulation algorithm, and performing 
texture mapping to obtain a three-dimensional model of the building with color textures; artificially repairing and manually migrating the building three-dimensional model, and constructing a 
building model database; and matching a corresponding three-dimensional 
building model by applying a 
keyword extraction technology based on a 
graph model. Compared with a classical SFM 
algorithm, the method is more suitable for construction of a three-dimensional building model 
database, a brand new means is provided for three-dimensional reconstruction of large objects, the building 
model matching success rate is increased, and the matching range is expanded.