The invention discloses an AI
model parameter initialization method based on
model parameter and structure multi-
modal fusion, and belongs to the technical field of
artificial intelligence. The method comprises the following steps: firstly, collecting historical pre-training model data of a cross-
model architecture and a cross-
data set,
processing model parameters into a token sequence, training a Transform codec, converting a model structure into a graph, and training GAT to extract structural features; a multi-
modal feature data set is constructed after a related network is frozen, structural features serve as core conditions, a conditional
diffusion model DDPM is trained through AdaLN modulation and residual module
coupling, and multi-
modal feature fusion of'parameter feature-structural feature 'is established. In the reasoning stage, the structural features of the unknown model are extracted, the
random parameters of the unknown model are combined with the submerged space shape determined by the
encoder, sampling is conducted through the conditional
diffusion model, anti-token
processing is conducted through the decoder, and adaptive initialized
model parameters are generated for the unknown model. According to the method, cross-model structure high-quality parameter initialization is realized, the model
training time is shortened, and the
large model training requirement is met.