Data storage access method and system based on dynamic routing

A data storage and access method technology, applied in the field of data processing, can solve the problems of unbalanced data volume, long query request processing time, access congestion, etc., and achieve the effect of basic balance of data volume, good user experience, and improved concurrency speed

Active Publication Date: 2018-07-13
吉浦斯信息咨询(深圳)有限公司
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, if the same user has a large amount of user data, if routing is performed by node, then all user data under the user will be stored on the same node, which will cause an imbalance in the amount

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage access method and system based on dynamic routing
  • Data storage access method and system based on dynamic routing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] see figure 1 , Embodiment 1 provides a data storage access method based on dynamic routing, including:

[0047] S1: Detect the status of the cache node;

[0048] Specifically, for example: data is stored in cache node 1 (node1), cache node 2 (node2), and cache node 3 (node3). SI detects the states of node1, node2, and node3.

[0049]S2: When the status of the cache node changes from available to unavailable, the routing path of the cache node is established as the path to the landing database, and the data request corresponding to the cache node is directly transparently transmitted to the landing database;

[0050] Specifically, the status of the cache node changes from available to unavailable, indicating that the data of the current cache node is untrustworthy. At this time, requests to access the cache node are directly transparently transmitted to the landing database, and the data of the landing database corresponding to the cache node is accessed. Read or write...

Embodiment 2

[0072] see figure 2 , Embodiment 2 provides a data storage and access system based on dynamic routing, including: a cluster management module, a data recovery module, a node management module, a landing database, a data processing module, and a cache database cluster;

[0073] The cluster management module is used to detect the state of each cache node in the cache database cluster; when the state of the cache node changes from available to unavailable, the routing path of the cache node is established as the path to the landing database, and the data corresponding to the cache node The request is directly transparently transmitted to the landing database; when the status of the cache node changes from unavailable to available, a restart command for the cache node is generated and sent to the data recovery and migration module;

[0074] Specifically, the state of the cache node can also be a newly added cache node. At this time, the fragmented data managed by this node is mig...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storage access method and system based on dynamic routing. The method comprises the following steps of directly transmitting a data request corresponding to a cache nodeto a landing database when a state of the cache node is changed from an available state to an unavailable state; when the state of the cache node is changed from the unavailable state to the availablestate, carrying out data recovery on fragment units managed by the cache nodes; when the data size of the cache node is detected to be overloaded, carrying out data migration on the cache node; whena capacity expansion request of the cache node is received, carrying out data expansion on the cache node; and when a user request is received, acquiring the cache node accessed by the user request, carrying out dynamic routing according to the node type of the cache node, and reading or writing the data into the fragment units according to a routing result. According to the method and the system,the state of the cache node is monitored in real time, and data recovery, data read-write, data migration and data expansion are carried out according to the state of the cache node, the dynamic routing can be carried out, and the quick response of an access end and an inquiry end is realized.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a data storage access method and system based on dynamic routing. Background technique [0002] At present, in the process of Internet big data processing, due to the large amount of data, clusters are usually used to store data. In order to speed up data storage and access, a hierarchical structure of cache database + landing database is usually used. Within the cluster, the consistent hash (consistent hash) algorithm or other routing algorithms are used to ensure the load balance of each node. However, if the same user has a large amount of user data, if routing is performed by node, then all user data under the user will be stored on the same node, which will cause an imbalance in the amount of data between nodes. If the query end needs to query the user data of the user, it needs to query all the data of the node, resulting in a long query request proces...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
CPCH04L67/1097H04L67/1008H04L67/563H04L67/5682H04L67/63
Inventor 王崇文王丰叶天虹王伟罗伟东
Owner 吉浦斯信息咨询(深圳)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap