The invention discloses an automatic labeling method and
system based on a neural symbol combination framework, and belongs to the field of
information processing. The method comprises the following steps: S1, inputting multi-
modal data, and preprocessing the multi-
modal data; s2, respectively extracting features of each mode, and generating a joint embedded vector by adopting a multi-head attention mechanism; s3,
logical reasoning is executed based on the
domain knowledge base, and interpretable labeling rules are generated; s4, mapping the joint embedded vector to a predicate space of symbol logic for
rule matching; s5, detecting whether a matching conflict exists or not based on a logic constraint solving
algorithm; if the conflicts exist, manual auditing is triggered, the rule weight is updated based on the
Bayesian network, and the steps S3-S5 are executed again; and if no conflict exists, outputting a labeling result. According to the method, collaborative optimization of data driving and knowledge driving is realized by fusing the
perception ability of the neural network and the
logical reasoning ability of the symbol
system.