Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Processing method of big data RPC (Remote Procedure Call Protocol)

A processing method and technology of big data, applied in electrical digital data processing, inter-program communication, instruments, etc., can solve problems such as high cost, difficulty in meeting user compatibility requirements, slow response speed, etc., to improve user experience and call process. Simple, clear and clearly defined effect

Active Publication Date: 2017-02-22
ZHANGYUE TECH CO LTD
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current demand for big data processing is increasing, and the existing distributed software systems based on the RPC protocol have exposed many problems such as slow response speed and poor user experience when processing big data.
On the other hand, it is very expensive to develop a new distributed software system specifically for the processing of big data, and it is difficult to meet the compatibility requirements of users.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Processing method of big data RPC (Remote Procedure Call Protocol)

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] After research, it is found that the bottleneck of traditional RPC in big data scenarios lies in packaging and unpacking. To solve this problem, the inventor divides the request / response into two parts, and the data reading (processing) is divided into two stages. In the first stage, the RPC library reads / parses simple data types from the header according to the established byte order, and then calls the specific implementation / returns to the caller. In the second stage, the work of reading (processing) large data is handed over to the specific implementation / caller to complete. The data required in the first stage is usually very small, so the request can be processed immediately.

[0069] According to an embodiment of the present invention, a method for real-time processing of big data RPC is provided, and entities involved in the method include a caller, a specific implementation, a stub, and an RPC library. Wherein, the caller is a program or application that the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a processing method of big data RPC (Remote Procedure Call Protocol). The processing method comprises the following steps of: 1) a client constructs a request header on the basis of simple data, and adds big data identification into the end of the request header; 2) the client sends the request header and immediately directly sends remaining data which is not subjected to packaging processing in a data flow form; 3) when a server side identifies the big data identification, simple data carried in the request header is immediately processed, and meanwhile, the data flow is continuously received; 4) after the server side obtains the returning value of the simple data, a response header is immediately constructed, and the big data identification is added into the end of the response header; and 5) the server side returns the response header to the client. The processing method is suitable for remote process calling under a big data scene, an effect of instant processing can be achieved under a situation that big data is transmitted, user experience can be improved, and the processing method is compatible with the traditional RPC.

Description

technical field [0001] The present invention relates to the technical field of big data software, in particular, the present invention relates to a processing method of big data RPC (the full name of RPC is Remote Procedure Call Protocol, that is, remote procedure call). Background technique [0002] At present, big data applications and technologies are in a period of rapid development. In order to meet the processing needs of big data, it is inevitable to build distributed software systems. A distributed software system is a software system that supports distributed processing, and it is usually a system that executes tasks on a multi-processor architecture interconnected by a communication network. For example, in a distributed computer operating system, a distributed program consists of several program modules that can be executed independently, and they are distributed on multiple computers in a distributed processing system to be executed simultaneously. The distribut...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/06G06F9/54
CPCG06F9/547H04L67/133
Inventor 朱辉徐文朝刘伟平王海
Owner ZHANGYUE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products