The invention relates to the technical field of
computer graphics, in particular to a virtual-real fusion method and
system based on
Gaussian splash live-action reconstruction, and the method comprises the following steps: S1, carrying out the
motion recovery structure
processing of an obtained target scene
image sequence, and generating a sparse
point cloud of a target scene; s2, training the sparse
point cloud through a
Gaussian splashing technology, generating a live-action three-dimensional
Gaussian model, carrying out lightweight
processing on the live-action three-dimensional Gaussian model, and outputting a lightweight live-
action model; and S3, acquiring an internal parameter matrix, an external parameter matrix and a real-time video
stream of the physical camera. According to the method, the
spatial mapping relation between the live-action reconstruction model and the artificial fine model is established, the user interaction instruction is responded, and the explicit and implicit states of different detail level models in a unified scene are dynamically controlled, so that smooth switching without context loss from macroscopic to microscopic is realized; the problems of
visual angle jump and
spatial cognition interruption caused by
system switching in a traditional scheme are solved.