Data processing system, method, apparatus and electronic device

By introducing mapping units and message queue systems into the distributed architecture and dynamically adjusting data channels, the problem of resource waste in high-frequency processing units of branch offices was solved, and full utilization of resources and high efficiency of data transmission were achieved.

CN115495220BActive Publication Date: 2025-11-25CHINA CONSTRUCTION BANK +1
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202211200945.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-29
Publication Date
2025-11-25
Estimated Expiration
2042-09-29

AI Technical Summary

Technical Problem

In a distributed architecture, the high-frequency processing units of various branches have uneven data processing volumes, leading to waste of cluster resources and idle servers.

Method used

By introducing mapping units and message queue systems, the mapping relationship between the main task processing unit and distributed nodes is dynamically adjusted, dedicated and public data channels are established to ensure that the amount of data to be processed in each main task processing unit is balanced, and server resources are allocated through a polling mechanism.

Benefits of technology

It achieves full utilization of cluster resources in each main task processing unit, avoids resource waste and server idleness, ensures the independence and capability of data transmission, and prevents task blocking.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115495220B_ABST
    Figure CN115495220B_ABST
Patent Text Reader

Abstract

The application relates to the technical field of data processing, in particular to a data processing system, method and device and electronic equipment, which are used for solving the problem of cluster resource waste of high-frequency processing units of various branch organizations. The data processing method comprises the following steps: obtaining to-be-processed data corresponding to each distributed node respectively; determining a mapping relationship between each distributed node and each main task processing unit, so that the difference between the to-be-processed data corresponding to each main task processing unit is within a preset range; distributing each to-be-processed data to each main task processing unit according to the mapping relationship; and processing all to-be-processed data corresponding to each main task processing unit according to each main task processing unit and the sub-task processing units corresponding to each main task processing unit respectively. Through the above method, the data processing amount corresponding to each main task processing unit can be balanced, so that the cluster resource waste of the main task processing units can be avoided.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Interconnection channel adjusting method, device, system, equipment and medium

    CN111858458A

  • Metadata cluster deployment method, device and equipment and readable storage medium

    CN113934377A

  • Task processing method, device, equipment and storage medium

    CN114090205A