Method and system for stream collaboration of ai large model output and speech generation
By combining the WebSocket protocol and intelligent sharding algorithm on the OpenResty platform, streaming collaboration between large language model output and speech generation was achieved, solving the problems of high latency and low resource utilization in long text scenarios and providing a low-latency, high-efficiency streaming speech output experience.
CN122290564APending Publication Date: 2026-06-26BEISEN CLOUD COMPUTING CO LTD
View PDF 0 Cites 0 Cited by
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- BEISEN CLOUD COMPUTING CO LTD
- Filing Date
- 2026-05-14
- Publication Date
- 2026-06-26
Smart Images
Figure CN122290564A_ABST
Abstract
This invention provides a streaming collaborative method and system that combines AI large model output with speech generation, relating to the field of artificial intelligence technology. This invention organically combines OpenResty gateway technology, WebSocket streaming communication, text segmentation, and parallel text-to-speech processing. By performing real-time parsing and splitting of the WebSocket data frame stream returned by the large language model at the gateway layer and by making parallel calls to the text-to-speech service, a pipelined parallel processing mode for text generation and speech synthesis is achieved, alleviating the problems of high latency, low resource utilization, and poor user experience in long text scenarios.
Need to check novelty before this filing date? Find Prior Art