The invention discloses a characteristic industry credit-oriented
large model lightweight training and scene
adaptation method, which comprises the following steps of: firstly, acquiring multi-source heterogeneous data from a public credit
information center, performing standardized preprocessing, and constructing a
knowledge graph containing entity nodes and relation edges based on industrial characteristic knowledge; the
knowledge graph is utilized to perform intelligent data enhancement on credit cases, and then formatting
processing is performed based on a task instruction template. A Chinese pre-training large
language model is selected as a basis, a
Transformer layer is divided into a bottom layer, a middle layer and a top layer, parameters are frozen for the bottom layer, a low-rank
adaptation LoRA matrix is inserted into the middle layer, a lightweight Adapter module is inserted into the top layer, a task classification head and a knowledge fusion layer are added, and a
hybrid parameter efficient
fine tuning framework is constructed. After training, a calibration
data set is adopted to carry out mixing precision quantification, structure sparsification
processing is executed based on weight importance, a scene
perception inference engine is constructed, and finally the data is deployed to a local
server, so that efficient and lightweight credit
evaluation data processing is realized.