Disclosed is an interactive modeling method. The method comprises: a consistent segmentation step, i.e., consistently segmenting a multi-visual-angle picture into a plurality of areas; a confidence step, i.e., performing confidence evaluation on each area, obtaining confidence degrees, and comparing the confidence degrees with a threshold; an interaction step, i.e., for a area whose confidence degree is lower than the threshold, returning to the confidence step through manual sketching; a repeating step, i.e., repeating the confidence step and the interaction step until the confidence degree of each area in the plurality of areas accords with the requirement of the threshold; and a modeling step, i.e., generating a building according to a plurality of areas whose confidence degrees accord with the threshold. By using the interactive modeling method, in-depth mining of picture information is realized, and the prior knowledge of a building structure is also combined, so that user interaction is greatly reduced, and the modeling automation degree is effectively improved. Besides, the picture-based interactive building modeling method not only can be used for performing three-dimensional reconstruction, but also can greatly assist with building designing, virtual planning and designing, and the like.