The invention discloses a clinical auxiliary judgment method based on
large model fine tuning, and the method comprises the following steps: S1, collecting multi-
modal clinical data, and carrying out the preprocessing of the multi-
modal clinical data; s2, fusing the preprocessed multi-
modal data, and constructing a training sample set conforming to an instruction
fine tuning format; s3, performing multi-round instruction
fine tuning on the LLaMA model, and updating parameters by adopting a hierarchical freezing strategy; s4, executing a clinical task by applying the fine tuning model, generating a diagnosis text, and analyzing and extracting a diagnosis result; s5, comparing the diagnosis result with a standard
knowledge base to generate structured diagnosis information; s6, calculating a
confidence score and screening credible diagnosis information in combination with historical medical records and similar medical records; and S7, outputting clinical auxiliary judgment results sorted according to confidence. According to the method, efficient fusion and intelligent analysis of multi-modal clinical data can be realized, and professional accuracy and result credibility of a
large model in clinical auxiliary judgment are improved.