The application provides a gastrointestinal
stromal tumor patient diagnosis and treatment method and device based on multiple agents, the method comprising: acquiring multi-
modal patient data, and acquiring a multi-
modal base model based on the multi-
modal patient data; performing supervised fine-tuning on the multi-modal base model, and performing reinforcement alignment using a preset group relative strategy optimization
algorithm to obtain a multi-modal base model after two-stage reasoning capability training; and generating a standardized reasoning result based on the trained multi-modal base model. According to the application, the perceived multi-modal base model is trained for two-stage reasoning capability, and the multi-modal base model is used to generate a reasoning result, so that the
perception task is no longer isolated, and
perception, reasoning and tracking diagnosis and treatment are integrated into a
unified process. In addition, longitudinal decision training is realized, the comprehensiveness of decision training is improved, and the accuracy of reasoning is improved.