The application provides an intelligent
visual training collaborative diagnosis and treatment method and platform based on multi-
modal perception and 5G communication, which comprises the following steps: collecting the
eye movement trajectory, spatial action path and user
response time of a user in real time, calculating the
fixation stability index based on the
eye movement trajectory data, and generating a training data
package; dividing the training task type and extracting the corresponding behavior
performance index of each stage to calculate the
perception stage performance
score and the cognitive stage performance
score; sending the
user state snapshot to the remote doctor terminal through the 5G communication network, combining the doctor's regulation intention, and generating a
task control vector; according to the training
state vector and the
task control vector, dynamically matching and combining the task parameters suitable for the current ability of the user and the regulation intention of the doctor from a preset task component
library, and analyzing the task parameters into operation instruction streams by a
robot guide module. The application can be applied to a multi-
modal intelligent collaborative training
system suitable for hospital,
rehabilitation center and family scenes.