Distributed RPC system, data processing method and data processing device
A distributed and resource management platform technology, applied in the field of distributed RPC systems and data processing methods and devices, can solve problems such as low efficiency and tediousness
Inactive Publication Date: 2018-04-27
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] However, systems using the current distributed RPC architecture need to deploy (processor and memory, etc.) resources and plan online and offline management specifically for the distributed RPC architecture system, which is cumbersome and inefficient
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment
[0045] see figure 2 , figure 2A structural diagram of a distributed remote procedure call protocol RPC system provided by an embodiment of the present invention. like figure 2 As shown, the system includes:
[0046] Client 11, a server 2 connected to the client 11, a resource management platform 3 connected to the server 2;
[0047] It can be understood that the server 2 can be connected to multiple clients 11 .
[0048] Optionally, the resource management platform 3 may be a current mainstream resource management platform, such as Apache Hadoop YARN or Apache Mesos, which is not limited in the present invention.
[0049] Wherein, the server end 2 includes at least two servers 21, and the resource management platform 3 is deployed with a real-time computing framework;
[0050] Optionally, the server end 2 includes multiple servers 21 .
[0051] Optionally, the real-time computing framework may be a current mainstream real-time computing framework, such as Apache Flink...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a distributed RPC system, a data processing method and a data processing device. The system comprises a client side, a server side and a resource management platform; the server side comprises at least two servers; the resource management platform is deployed with a real-time computing framework; the client side is used for randomly sending client side identification information and request information to a target server; the target server is used for setting the request ID for the request information, and sending server identification information, the request information and the request ID to the resource management platform; the request ID, the client side identification information and the request information respectively correspond to each other; the resource management platform is used for responding to the request information through the real-time computing framework, so that a response result is obtained; and the response result and the request ID are sent to the target server corresponding to the server identification information, so that the target server sends the response result to the client side corresponding to the request ID. By means of the technical scheme provided in the invention, the treatment process can be simplified; and the efficiency can be increased.
Description
technical field [0001] The invention relates to the field of computer technology, in particular to a distributed RPC system and a data processing method and device. Background technique [0002] RPC (Remote Procedure Call Protocol, remote procedure call protocol) service is a common C / S (Client / Server, client / server) service architecture, which is widely used in production environments. As the number of client visits increases, the server can adopt a distributed architecture to process client requests in parallel to improve processing efficiency. This is called a distributed RPC architecture. see figure 1 , figure 1 It is a structural diagram of a system using a distributed RPC architecture in the prior art, such as figure 1 As shown, the RPC client randomly selects an RPC Server to process the request. [0003] However, systems using the current distributed RPC architecture need to deploy (processor and memory, etc.) resources and plan online and offline management spec...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): H04L29/06H04L29/08
CPCH04L67/10H04L67/60H04L67/133
Inventor 马元文
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD