The invention belongs to the technical field of
electronic design automation, and discloses a
system block diagram automatic analysis and task question and answer method and
system based on multi-source fusion, and the method comprises the steps: carrying out the preprocessing of a
system block diagram, carrying out the component recognition of a preprocessed image through a target detection model, carrying out the
line segment extraction through a multi-
algorithm fusion strategy, and carrying out the task question and answer. Constructing a physical topology, and judging the
signal flow direction by adopting a four-stage strategy comprising
loop closing and
local consistency; a circuit
knowledge question and answer
data set is created, Qwen2.5-VL-3B is finely tuned by adopting a secondary
fine tuning method from overall reasoning to local enhancement, a question and answer text generated by a
large model is analyzed, and structured
verification and path correction are performed on a question and answer result based on
connectivity of physical topology. According to the method, the problems of character interference,
line segment breakage and illusion connection generated by a
large model in the
block diagram are effectively solved, and the accuracy of complex
circuit diagram analysis and the
interpretability of content are remarkably improved through closed-loop fusion of visual hard constraint and semantic soft reasoning.