一种用于大数据平台扩容升级的性能监控系统及方法

By collecting and calibrating key information of the Web server during the expansion and upgrade of the big data platform, and combining historical and real-time load data to perform dynamic load balancing weight configuration, the problem of lack of accuracy in load balancing configuration in existing technologies has been solved, and the stable operation of the platform and efficient utilization of resources have been achieved after the expansion.

CN121967423BActive Publication Date: 2026-07-17GUIZHOU WUJIANG HYDROPOWER DEV

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
GUIZHOU WUJIANG HYDROPOWER DEV
Filing Date
2026-04-02
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

During the expansion and upgrade of existing big data platforms, the performance monitoring mechanism does not fully combine historical operating load data before expansion with real-time operating load data after expansion, resulting in a lack of accuracy in load balancing weight configuration. This can easily lead to problems such as unstable service response, unbalanced resource utilization, and low cache access efficiency after expansion.

Method used

By collecting key information from newly added web servers to form a standardized configuration dataset, establishing a two-way communication link and calibrating cluster collaboration parameters, and combining historical and real-time load data to dynamically configure load balancing weights, and making secondary adjustments based on cache type, the system ensures accurate load balancing adaptation.

Benefits of technology

It improved the standardization of node deployment and cluster compatibility during the expansion phase, enhanced the targeting of performance monitoring, achieved accurate adaptation of load balancing weights, ensured the stability of platform operation and efficient utilization of cache resources after expansion, and reduced the query load and data processing pressure of the backend database.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121967423B_ABST
    Figure CN121967423B_ABST
Patent Text Reader

Abstract

本发明公开了一种用于大数据平台扩容升级的性能监控系统及方法,涉及大数据分析技术领域,本发明通过采集新增Web服务器关键信息形成标准化配置数据集,提升扩容阶段节点部署规范性与集群兼容性;通过定向拉取扩容前的运行负载日志并筛选,结构化解析构建历史集群服务器运行负载集合;通过结合两类负载集合完成第一次权重动态配置,再依据缓存配置标识区分Web服务器缓存类型,对共享分布式缓存Web服务器基于命中率进行二次权重调整,解决现有权重配置缺陷,实现权重精准适配,提升缓存命中率,减少请求穿透数据库频次,降低数据库负载,缩短响应延迟,避免资源失衡与服务不稳定,保障平台扩容升级运行的性能。
Need to check novelty before this filing date? Find Prior Art