Cross-wide area network (WAN) data return method and device, computer equipment and storage medium

Abstract

The application discloses a cross-wide area network (WAN) data return method and device, computer equipment and a storage medium. The method includes the following steps: adding a pipeline class to ajava package class called by a Hadoop server, and constructing a function for inputting a Redis cluster object and a password in the pipeline class; enabling the pipeline class to synchronously read data to be returned in the Hadoop server to obtain Redis cluster information; obtaining current Redis cluster information through a pool object; and if the current Redis cluster information is different from the Redis cluster information at the previous moment, submitting the data to be returned stored in the pipeline class to a Redis database server according to the current Redis cluster information. According to the method, only when the Redis cluster information is updated, the pipeline class submits batch data to the Redis database server, and thus the number and time of handshakes of a remote TCP protocol can be reduced, and the data return efficiency can be improved.

Description

technical field [0001] The present application relates to the technical field of cross-wide area network data transmission, in particular to a cross-wide area network data return method, device, computer equipment and storage medium. Background technique [0002] At present, when the Hadoop server and the Redis database server are in different cities or provinces (that is, the two are geographically far apart), the commonly used method is to write back a large amount of data in the Hadoop server to the Redis database through a java program. The server needs to perform a TCP protocol handshake every time data is written back, which leads to low efficiency of writing data back through the java program. Contents of the invention [0003] This application provides a method, device, computer equipment and storage medium for cross-wide area network data return, aiming to solve the problem of writing back a large amount of data in the Hadoop server to the Redis database server th...

AI Technical Summary

Problems solved by technology

[0003] This application provides a method, device, computer equipment and storage medium for cross-wide area network data return, aiming to solve the problem of writing back a large amount of data in the Hadoop server to the Redis database server through a java program in the prior art, and write data every time A handshake of the TCP protocol is required, which leads to the problem of low efficiency of writing data back through the java program

Images