Method and device for optimizing cue words of large language model

Abstract

The invention discloses a cue word optimization method and device for a large language model, and the method comprises the steps: inputting a jailbreak attack instruction set into a to-be-tested large language model for loop attack, and obtaining a response result of the large language model; calculating an evaluation index according to a response result of the large language model, and when the evaluation index exceeds a preset threshold value, updating cue words in the large language model; the method comprises the following steps: constructing a multi-strategy defense template, analyzing the type of each jail break attack instruction by using the multi-strategy defense template, determining the type of each jail break attack instruction, matching a defense strategy of a corresponding type in the multi-strategy defense template according to the type of the jail break attack instruction, converting the defense strategy into a corresponding defense cue word, and sending the defense cue word to the jail break attack instruction. And inputting the defense prompt words into the large language model to optimize and update the defense prompt words of the large language model. The prompt word updating timeliness and accuracy can be improved, and the resistance and safety of a large language model are improved.