The invention discloses a
medical report generating model based on a relation model, and a generating method thereof. The model comprises the components of a deep convolutional network which is used for classifying abnormal terminologies and extracting a visual characteristic, inputs the visual characteristic into a two-stage bidirectional long-and-short-period memory
network layer for performingattention operation, and is connected with a full connecting layer after each stage of bidirectional long-and-short-period memory
network layer for selecting a template and a word; a hierarchical recursive neural network which comprises two bidirectional long-and-short-period memory network
layers, wherein the top bidirectional long-and-short-period memory
network layer is operated through attention and is connected with the full connecting layer for selecting an accurate template, and the lower bidirectional long-and-short-period memory network layer receives the information of the top layerand is connected with the full connecting layer for selecting an accurate word; and a report generating module which comprises a template decoder for predicting an abnormal
sentence and a word decoderfor generating a normal
sentence, thereby selecting generating using template searching or
sentence generation on the current sentence according to decision of the hierarchical recursive neural network, and finally connects all sentences which are obtained through searching or automatic generation for forming the
medical report.