Language model system, operation method thereof and real-time optimization method thereof

Abstract

A language model system, an operation method thereof and a real-time optimization method thereof are provided. A language model and a retrieval-augmented generation (RAG) unit receive a prompt. The RAG unit searches an external data set according to the prompt to obtain an embedded message. The language model generates an answer message according to the prompt and the embedded message, and displays the answer message on a display unit. The display unit displays a questionnaire. A feedback analysis unit obtains a feedback and a score from the questionnaire. The feedback analysis unit determines whether the feedback or the score is referenceable. If the feedback or the score is referenceable, the feedback analysis unit updates the external data set according to the feedback or the score.

Images