The invention provides a medical decision-oriented multi-
modal data dynamic fusion and labeling method and
system, and relates to the technical field of medical decision-making, and the method comprises the steps: collecting medical images, electronic medical records and
physiological monitoring data of a patient, extracting multi-
modal features such as a focus form, a
disease type, a symptom, a treatment
record and a physiological index, and carrying out the fusion and labeling of the multi-
modal features; and constructing a dynamic fusion labeling model. According to the model, multi-modal features are coded, similarity is calculated, a feature association graph is constructed,
feature aggregation is carried out, labeling is carried out in combination with a
medical knowledge base, and a dynamic labeling vector is generated. And inputting the dynamic labeling vector into a medical decision support model, and based on similar
case analysis and deep
reinforcement learning, generating a diagnosis and treatment suggestion containing a treatment scheme and early warning information. By dynamically fusing multi-
modal data and an online updating mechanism, the accuracy and efficiency of
medical decision making can be improved, and personalized diagnosis and treatment are realized.