低时延智能问答方法、装置、电子设备和存储介质
By performing legality verification and historical mapping set matching on the client query requests of the intelligent question answering system, and combining small sample example fragments to assist large model reasoning, the timeliness problem of low latency response and high frequency repeated queries in the intelligent question answering system is solved, and a low latency and efficient intelligent question answering experience is achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SHANGHAI JIUFANGYUN INTELLIGENT TECH CO LTD
- Filing Date
- 2025-11-28
- Publication Date
- 2026-07-17
AI Technical Summary
Existing intelligent question-answering systems are inadequate in terms of low-latency response, especially in real-time sensitive interactive scenarios such as financial consultation and real-time customer service. Users are prone to experiencing system lag due to prolonged lack of response, and the system is inefficient when performing frequent and repetitive queries.
After validating the client's query request, the system immediately returns the first frame of data. It then uses a pre-built historical mapping set to match the intent category and tool call trajectory summary to directly generate the final result. For queries that do not match, it uses a few sample fragments as supplementary hints to assist the large model in the first stage in intent and tool planning. Combined with streaming push technology, it reduces time-consuming steps such as large model inference and tool scheduling.
It significantly improves the perceived timeliness for users, adapts to high-frequency and repetitive query scenarios, reduces the perceived system lag, and achieves low-latency response. It is especially suitable for scenarios such as financial consultation and real-time customer service, and allows users to obtain processing progress in real time through streaming push technology.
Smart Images
Figure CN121597799B_ABST