Data transmission method, data storage server and data storage system

A data transmission method and data storage technology, applied in the input/output process of data processing, electrical digital data processing, structured data retrieval, etc., can solve the problem of long links, increased query delay of data storage nodes, and affecting service stability sexual issues

Pending Publication Date: 2020-10-30
BEIJING DIDI INFINITY TECH & DEV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] It can be seen that the data is sent to the Redis cluster through read and write requests one by one, and each request has gone through several layers of forwarding before finally reaching the storage node. The link is long, and there are a large number of write requests flooding online The data storage nodes in the data storage system will increase the query delay of the data storage nodes and affect the service stability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method, data storage server and data storage system
  • Data transmission method, data storage server and data storage system
  • Data transmission method, data storage server and data storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0101] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the appended The figures are only for the purpose of illustration and description, and are not used to limit the protection scope of the present application. Additionally, it should be understood that the schematic drawings are not drawn to scale. The flowcharts used in this application illustrate operations implemented in accordance with some embodiments of the application. It should be understood that the operations of the flowcharts may be performed out of order, and steps that have no logical context may be performed in reverse order or concurrently. In addition, those skilled in the art may add one or more other operations t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data transmission method, an online data storage server, an offline data storage server and a data storage system. A data downloading channel is established between the offline data storage server and the online data storage server, so as to convert the data to be imported into a database file, and the data is downloaded from the offline data storage server to the online data storage server in the form of the database file, so that the data import time can be effectively shortened, and the data import efficiency is improved, and the stability of providing query servicefor the outside by the data storage system is maintained.

Description

technical field [0001] The present application relates to the technical field of big data processing, and in particular, relates to a data transmission method, a data storage server including an online data storage server and an offline data storage server, and a data storage system. Background technique [0002] With the continuous development of science and technology, the amount of network data is increasing rapidly and exponentially. At present, in order to store a large amount of data reasonably, the distributed storage system Hadoop is generally used to store big data. Hadoop is mainly used in offline data. In the storage scenario, the offline data in Hadoop has poor timeliness and cannot meet the low-latency reading data requirements of online businesses. Therefore, offline data needs to be written to the online storage system first, and then the online storage system provides online services with Low-latency queries. [0003] Writing the offline data in the offline ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F16/27
CPCG06F3/067G06F16/27
Inventor 王志勇余汶龙
Owner BEIJING DIDI INFINITY TECH & DEV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products