The invention relates to the technical field of medical
informatization, and discloses a method for generating a
medical record report based on a doctor-patient dialogue, and the method comprises the following steps: multi-
modal data collection: collecting the multi-
modal data of the doctor-patient dialogue, including
voice data, video data and environment data; multi-
modal data preprocessing: preprocessing the collected data, including
noise reduction and
feature extraction of voice signals, key point extraction of video data and
time synchronization of the multi-
modal data; and semantic analysis: converting the voice
signal into a text by using a voice recognition technology, carrying out semantic analysis on the text, and extracting key information. Through multi-
modal data acquisition, semantic analysis, emotion modeling and
knowledge graph reasoning technologies, the comprehensiveness, logicality and dynamic correction ability of
medical record generation are improved, meanwhile, the defects of patient psychological state analysis in the prior art are overcome, information orderliness and doctor decision-making efficiency are remarkably improved through generation of the visual
medical record report, and the medical
record report generation method is suitable for popularization and application. And powerful support is provided for precise
medical treatment.