The invention discloses a collaborative
response method and device for large and small models, equipment, a medium and a program. The method comprises the steps of calling a low-rank
adaptation small model to generate an initial response through an
edge node when an input instruction of a user is received; calculating the whole
sentence confidence coefficient in the initial response; if the whole
sentence confidence coefficient is smaller than a
sentence-level confidence coefficient threshold value, a collaborative response instruction is sent to the
cloud server cluster; selecting a specified number of target large models from the plurality of large models, and correcting at least one lexical element based on a lexical element level confidence coefficient threshold to obtain a plurality of collaborative responses; and selecting the target collaborative response with the highest confidence as a real response, and returning the real response to the user. According to the embodiment of the invention, the
large model and the small model are utilized to cooperatively work to quickly give a preliminary reply to a
simple question, the
large model intervenes in optimization when a complex question is encountered, a satisfactory answer is provided for a user, the user experience is improved, and the instruction
processing capability is enhanced by performing
fine tuning optimization on the low-rank adaptive small model.