The invention relates to the technical field of picture generation, in particular to a picture generation method based on multi-scale features. The method comprises the following steps: firstly, collecting medical images,
patient data and
lesion stage information under different equipment and acquisition parameters, after screening preprocessing, constructing and training a multi-scale VQ-VAE model, introducing an attention mechanism, and adopting adaptive
codebook updating and multi-
codebook fusion quantification; then, a hierarchical autoregression model based on a Transform decoder is constructed and trained, and
lesion stage information is fused into the hierarchical autoregression model; and finally, inputting specific
lesion stage information, generating a multi-scale discrete index sequence through a hierarchical autoregression model, converting the multi-scale discrete index sequence into a codeword vector through a multi-scale VQ-VAE model, and finally generating a simulated medical image. According to the scheme, the multi-scale VQ-VAE model is utilized to
encode the input image into the multi-scale discrete feature representation, and meanwhile, the autoregression model is applied to the discrete hidden space of the VQ-VAE, so that the distribution of the discrete representation sequence can be effectively modeled, and the medical image with higher quality and more realistic sense can be generated.