The invention belongs to the technical field of
artificial intelligence and educational
informatization, and relates to a multi-mode
knowledge graph enhanced intelligent teaching-assistant question-answering
system. According to the method, the
knowledge graph construction technology, the multi-
modal content analysis technology and the large
language model reasoning enhancement technology are comprehensively applied, and the semantic understanding,
knowledge integration and reasoning generation capabilities of the intelligent teaching assisting
system in an education and teaching scene are improved. The related technology comprises
layout analysis of textbook documents, semantic description generation of
image content, entity and relation extraction of text content, multi-
modal knowledge graph construction and question and answer reasoning and
natural language generation combined with the knowledge graph. Through cooperative application of the technologies, semantic
interconnection can be carried out on various
modal information such as texts, images and tables in the textbook, and a searchable and traceable textbook-level knowledge network is formed.