The invention discloses a big
language model alignment method and device based on neural
signal driving, and the method comprises the steps: S1, constructing positive and
negative reaction samples for a specific control task at a big
language model training stage, and taking the positive and
negative reaction samples as a comparison sample set; s2, guiding the generation direction of the large
language model from two directions by comparing the sample set, and positioning and obtaining
neural control signals which cause the large language model to generate different output behaviors, including a
positive control signal and a
negative control signal; s3, in a big language model reasoning stage, on the basis of linear subspace
hypothesis, feature irrelevant signals are decoupled by fusing feature signals of the
positive control signals and the
negative control signals, and concept control signals are extracted; s4, using the concept
control signal to control the large language model to realize nerve regulation of the
large model; according to the method, the model alignment performance is effectively improved while the original generation capability of the model is maintained, and a new
view angle and a new tool are provided for sustainable alignment and control of the
large model.