The invention relates to the related technical field of
rehabilitation information communication interaction, in particular to a real-time
interaction method and
system suitable for multi-
modal rehabilitation medical information, and the method comprises the steps: determining a multi-
modal data flow, generating an initial
interaction network architecture, using a heterogeneous data feature
encoder, adding an upper sampling feature pointer and a lower sampling feature pointer, and carrying out the real-time interaction of the multi-
modal rehabilitation medical information. According to the method, dynamic allocation optimization is carried out by using dynamic adaptive elements, short-time communication adjustment is carried out by using different interactive requests according to the dynamic adaptive elements,
configuration optimization is carried out according to real-time scheduling of multi-
modal data streams, and a self-adaptive interactive
network architecture is set, so that the problem that under different interactive requests and data streams, the real-time scheduling of the multi-
modal data streams is not influenced is solved. According to the technical scheme, the technical problems that the multi-
modal data feature extraction and fusion capability is insufficient, and interaction requirements cannot be met are solved, path selection optimization in a multi-path transmission topological structure is achieved, short-time communication adjustment is carried out according to different interaction requests and data flow conditions, and it is ensured that the interaction requests can be quickly responded and processed.