The invention discloses an
orthopedic surgery navigation drilling and
implant placement intention real-time optimization method based on multi-
modal perception, and relates to the technical field of computer-aided
surgery, man-
machine interaction and intelligent
medical equipment. Multi-
modal signals such as electroencephalogram,
eye movement and myoelectricity of a doctor are collected in real time through XR glasses and an intelligent
surgical drill; and inputting the pre-trained micro-world model to generate a current intention vector and predict a future
bone structure trajectory. The intention level is judged by calculating the energy distance between the intention and the master template and an emotional value function: when the intention meets the master level condition, the
system automatically generates an XR green optimal path and assists in operation; and when the intention is identified as the risk intention, triggering the skykeeper
system to lock the equipment and send out an alarm. The
system supports a data federation learning evolutionary model, and immediately destroys an original multi-mode
signal after encoding to guarantee
data security. According to the invention, the real-time monitoring, evaluation and guidance of the operation intention are realized, and the accuracy and safety of the operation are improved.