The application discloses a kind of industrial grade 4D video generation
system and method based on space-time anchoring and mixed expert parallel, belong to
artificial intelligence video generation technical field.
System includes eight big modules of
global configuration, rigid space-time anchoring, 4D space-time coding and decoding, timing synchronization mixed expert,
mass data flow loading, multistage distributed training, real-time
inference scheduling, post-
processing enhancement;Method is through building multidimensional rigid space-time
anchor point tensor to eradicate iterative cumulative error, uses non-recursive 4D
convolution to realize video global coding and decoding, uses multi-path mixed expert network to improve model capacity, combined with multistage distributed parallel to break through memory
bottleneck, and realizes model hardware resident and multi-path real-time generation at
inference end.The application completely solves the problem of timing drift and structure tearing of traditional autoregressive architecture, has the characteristics of high stability, high efficiency and
low delay, and is suitable for film-level industrial video intelligent production scene.