A tool-integrated reasoning reinforcement learning system and method based on multi-dimensional rewards
By employing multi-dimensional reward calculation and inter-group relative policy optimization algorithms, the problem of traditional reward functions being unable to provide refined evaluation in tool invocation tasks is solved, enabling efficient learning and accurate invocation of large language models in tool integration reasoning tasks.
Patent Information
- Application Number
- CN202610040344.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2026-01-13
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2046-01-13
AI Technical Summary
Existing reinforcement learning reward function designs cannot perform fine-grained evaluation of key details such as tool name, parameter format, and parameter value in tool invocation tasks, resulting in low model learning efficiency and high evaluation costs for large models, making it difficult to simultaneously ensure the accuracy and efficiency of multi-dimensional evaluation.
A multi-dimensional reward calculation module is adopted, including format reward and multi-dimensional correctness reward. A comprehensive reward tensor is generated through linear combination. Combined with the inter-group relative policy optimization algorithm, token-level advantage value calculation and gradient update are realized, driving the integration of inference capabilities of large language model optimization tools.
It significantly improves the convergence speed and accuracy of the model in tool invocation tasks, enhances the signal strength and comprehensiveness of key tokens, and improves the accuracy and training efficiency of the model in tool integration inference tasks.
Smart Images

Figure CN121503575B_ABST
Abstract
Citation Information
Patent Citations
Method and device for optimizing large-scale language model calling tool, electronic equipment and computer readable medium
CN120872444A
