Cross-wide area network data return method, device, computer equipment and storage medium

A wide area network and data technology, applied in the field of cross-wide area network data transmission, can solve the problem of low efficiency of writing back data

CN108418874BActive Publication Date: 2021-01-26PING AN TECH (SHENZHEN) CO LTD
5 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Publication Date
2021-01-26

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The application discloses a cross-wide area network data return method, device, computer equipment and storage medium. The method includes: adding a pipeline class in the java encapsulation class called by the Hadoop server, and constructing a function for passing in the Redis cluster object and password in the pipeline class; the pipeline class synchronously reads the data to be returned in the Hadoop server, Obtain Redis cluster information; obtain the current Redis cluster information through the pool object; if the current Redis cluster information is different from the previous Redis cluster information, submit the data to be imported back stored in the pipeline class to the Redis database according to the current Redis cluster information server. In this method, the pipeline class submits batch data to the Redis database server only when the Redis cluster information is updated, which reduces the number and time of remote TCP handshakes and improves the efficiency of data return.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present application relates to the technical field of cross-wide area network data transmission, in particular to a cross-wide area network data return method, device, computer equipment and storage medium. Background technique

[0002] At present, when the Hadoop server and the Redis database server are in different cities or provinces (that is, the two are geographically far apart), the commonly used method is to write back a large amount of data in the Hadoop server to the Redis database through a java program. The server needs to perform a TCP protocol handshake every time data is written back, which leads to low efficiency of writing data back through the java program. Contents of the invention

[0003] This application provides a method, device, computer equipment and storage medium for cross-wide area network data return, aiming to solve the problem of writing back a large amount of data in the Hadoop server to the Redis database server th...

Examples

Embodiment Construction

[0029] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0030] It should be understood that when used in this specification and the appended claims, the terms "comprising" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude one or Presence or addition of multiple other features, integers, steps, operations, elements, components and / or collections thereof.

[0031] It should also be understood that the terminology used in the specificati...