The invention discloses a multi-
modal-based
wind power plant digital twinborn
interaction method and device and a storage medium, and the method comprises the steps: collecting a real-time image of a wind
turbine generator, completing the calibration of an image
pose, forming a three-dimensional scene with a NeRF
voxel grid, importing CFD flow
field simulation data, mapping a flow field
scalar value to the NeRF
voxel grid, obtaining an enhanced neural scene, and carrying out the
simulation of the flow field. The global continuity of
simulation data is considered at low
wind speed, wake flow distribution of the whole
wind power plant can be clearly seen, local turbulence of a single unit can be accurately positioned, a multi-
modal model is deployed, professional terms in the field of
wind power operation and maintenance are preset, after an instruction is sent, the model combines state information of an enhanced neural scene, the instruction is analyzed into a recognizable sequence, and the recognition efficiency of the wind power operation and maintenance is improved. The geometric structure and
physical field distribution of a neural scene are enhanced through sequence combination, an optimal observation path is generated, the track smoothness is adjusted according to the
eye movement angular velocity of a user, the correction amplitude is amplified during high
eye movement, and
view angle switching lagging is avoided through focusing point anchoring.