A log receiving gateway method and system supporting high concurrency and data integrity verification

By designing a log receiving gateway that supports high concurrency and data integrity verification, the system addresses the insufficient processing capacity and data integrity issues of log management solutions in high-concurrency scenarios. It also enables flexible rule configuration and adaptive flow control, thereby improving the system's stability and scalability.

CN122419954APending Publication Date: 2026-07-17GUANGDONG CHENGZHI TECH CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
GUANGDONG CHENGZHI TECH CO LTD
Filing Date
2026-05-28
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing log management solutions are insufficient in high-concurrency scenarios, cannot guarantee data integrity, have inflexible rule configurations, and lack adaptive flow control mechanisms, leading to system crashes or data loss.

Method used

The design supports a log receiving gateway that supports high concurrency and data integrity verification. It uses an HTTP/HTTPS API to receive log requests, and encapsulates them into task objects through parsing, decoding, decompression, and CRC verification. These objects are then asynchronously placed into a bounded blocking queue for background processing and execution of intelligent data processing. Combined with dynamic configuration hot reloading and backpressure control, it achieves adaptive flow control.

Benefits of technology

It achieves high concurrency processing capabilities, ensures data integrity, supports dynamic rule changes, provides zero-latency response, has strong system stability and scalability, and is adaptable to multi-tenant environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122419954A_ABST
    Figure CN122419954A_ABST
Patent Text Reader

Abstract

本发明公开了一种支持高并发与数据完整性验证的日志接收网关方法及系统,方法包括:S10:通过HTTP / HTTPS API端点接收客户端发送的日志上报请求;S20:验证项目有效性;S30:若请求中包含校验码,验证数据传输的完整性;S40:将所述原始日志数据、客户端IP、User‑Agent及项目标识封装为标准化的任务对象;S50:将任务对象异步放入一个线程安全的阻塞队列;S60:后台处理线程从阻塞队列中消费所述任务对象,生成标准化的日志实体对象;S70:将处理后的日志实体对象批量写入分析型数据库和 / 或发送至消息中间件;S80:实时更新至本地内存缓存,实现动态配置热加载。有益效果:实现了高并发与低延迟的效果,确保日志从客户端到网关的传输过程无损、无误。
Need to check novelty before this filing date? Find Prior Art