一种基于Kafka实现全自动负载均衡消费消息的方法及系统
By adding dynamic listening and automatic load balancing modules to Kafka and dynamically adjusting consumer processes, the load balancing problem of Kafka message middleware in the era of big data is solved, achieving efficient and automated resource utilization and message processing.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HAINA ZHIYUAN DIGITAL TECH (SHANGHAI) CO LTD
- Filing Date
- 2022-12-08
- Publication Date
- 2026-07-17
AI Technical Summary
Existing Kafka message middleware struggles to achieve efficient and automated load balancing for message consumption in the era of big data, resulting in underutilization of resources, low development efficiency, and poor system stability.
By adding a dynamic listening module and an automatic load balancing consumer module to the application server, and using a visual configuration module to manage Kafka topic information and dynamically adjust consumer processes, fully automatic load balancing can be achieved.
The load balancing method has been optimized, improving message processing capabilities and resource utilization, enhancing development efficiency and system stability, and making it suitable for diverse big data processing and cleaning scenarios.
Smart Images
Figure CN115934252B_ABST