The invention relates to the technical field of
large model training, in particular to a
large model customized training method and
system for industry application, by constructing a hierarchical
knowledge graph, a model can systematically master an internal organizational structure and complex association of industry knowledge, an association prediction auxiliary task based on the graph is introduced in the training process, and the training efficiency is improved. The method comprises the following steps of: firstly, selecting a lesson and integrating the lesson into main semantic understanding, and meanwhile, ensuring progressive and stable convergence of
model learning by adopting a dynamic course learning strategy; finally, optimization is carried out by fusing a
loss function of knowledge association constraints, so that the model not only deeply understands a hierarchical
system of industry knowledge, but also can reliably generate answers which conform to industry specifications, are strict in logic and are high in
specialty; in this way, the technical problems that in the prior art, it is difficult to deeply understand and follow the internal hierarchical structure and complex incidence relation of
domain knowledge, and consequently the output of the
domain knowledge is insufficient in professionality, consistency and logicality are solved.