The invention relates to an image mosaic method based on neighborhood Zernike pseudo-matrix of characteristic points, which leads image statistical information (Zernike pseudo-matrix) to be interrelated with the characteristic points of an image by using the following steps: firstly, extracting interest points of an inference image and an input image by utilizing a Harris angle detector, and taking rectangular neighborhoods using the interest points as a center as a local characteristic region with characteristic matching; secondly, calculating the Zernike pseudo-matrix to the rectangular characteristic regions to be used as descriptors of the characteristic region, and realizing the matching of the characteristic points through comparing the Euclidean distance of the characteristic vector of the descriptor of each characteristic region. The matching can have less wrong matching points which are eliminated through a RANSAC (RANdom Sample Consensus) algorithm, and the right matching relation can be calculated to realize the image mosaic. The invention can effectively realize the image registration and mosaic with geometric transformation relations of translation, rotation, small scale zooming, and the like, and can be used for image treatment and image synthesis of fields such as communication, multimedia technology, and the like.