A data processing method and device
By performing preliminary data processing in the main thread and persisting the result data, combined with the background listener to independently process resource operations, the problem of overall Ops improvement in the cluster and unbalanced resource access speed is solved, and efficient hardware resource utilization and data security are achieved.
Patent Information
- Application Number
- CN202010898367.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-08-31
- Publication Date
- 2025-03-18
- Estimated Expiration
- 2040-08-31
AI Technical Summary
The existing technology cannot fundamentally improve the overall Ops of the cluster, and the optimization effect of unbalanced resource access speed is poor, requiring excessive hardware resource investment.
The main thread receives the requested data and performs preliminary data processing, and the result data is persisted to the local storage device through the memory file queue component. The background listener listens and processes the persisted result data independently of the main thread, and performs corresponding resource operations.
It has achieved fundamentally improving the overall Ops of the cluster, improving the optimization effect of unbalanced resource access speed, without excessive hardware resource investment, and ensuring data security.