Rapid horizontal extending method for databases

A horizontal expansion, database technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of front-end controllers that cannot be expanded, large-scale servers are expensive, and downtime is long, so as to avoid uneven distribution of hot spots , the algorithm is easy to use and simple, and the effect of improving production efficiency

Active Publication Date: 2013-02-13
NANJING FUJITSU NANDA SOFTWARE TECH
View PDF2 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The vertical expansion architecture needs to add high-performance hardware. Usually, the cost of large-scale servers is more expensive than that of ordinary minicomputers; secondly, the front-end processing capability and the number of back-end disks of the entire storage system can be continuously expanded, but the upgrade and expansion to a certain extent will cause front-end control. Performance bottlenecks ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rapid horizontal extending method for databases
  • Rapid horizontal extending method for databases
  • Rapid horizontal extending method for databases

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] Step 1: Deploy the monitoring module, such as Figure 4 As shown in the initial system architecture diagram of the database, the monitoring module and the routing module are respectively deployed on the hardware machine. The hardware monitoring software used here is the open source Open Hardware Monitor, which collects the database cluster information in real time through the network. When the hardware capacity reaches the set storage capacity threshold, the monitoring software module prompts the administrator to prepare to increase the hardware environment to prepare for the next step of data segmentation.

[0055] Step 2: The hardware environment has been prepared from the previous step, and when the counter of the routing module reaches the preset storage number threshold, it is ready to split. Implementation According to the principle of database horizontal expansion, the segmentation factor α=2 is now taken.

[0056] There are two tables in database instance 0. Th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a rapid horizontal extending method for databases, which belongs to the field of data migration and storage. The method comprises the following steps: a monitoring and control system carries out monitoring on the disk storage space of the existing database, and when the disk size reaches a preset storage capacity threshold, the monitoring and control system triggers a hardware storage increasing action so as to make a hardware environment preparation for data migration; and a routing protocol carries out a modular computation on the instance number N of the current database according to a major key ID to be inserted currently, and routes the line number of data to be inserted into a specified database, and when the number of inserted lines exceeds a preset storage number threshold, the routing protocol triggers a database segmentation action so as to migrate specified data into a new database, thereby completing the rapid horizontal extending of the database. The method disclosed by the invention can be applied to disk databases or memory databases, and the method is easy to use and simple, and avoids the problem that hotspots are distributed nonuniformly caused by traditional horizontal extending of databases; in addition, as the scale of migration of data segmented each time is small, the extending speed is improved. In conclusion, the overall architecture meets the requirements on high availability, high reliability, high speed, high efficiency and the like.

Description

technical field [0001] The invention relates to a method for expanding the storage capacity of a database, in particular to a method for quickly and horizontally expanding the database in response to the ever-increasing demand for the data storage capacity of an enterprise-level database. Background technique [0002] With the rapid development of the Internet, the amount of application data and the number of visits are increasing rapidly. For the traditional enterprise IT architecture system, the storage data of the disk database is facing the huge pressure of large concurrency and high data volume transmission. In order to cope with the trend of big data and improve the scalability of database capacity, the choice of expansion scheme is particularly critical. [0003] In the prior art, the problem of data growth storage is realized by increasing the disk of a single database, and the scalability of the system is solved. There are usually two solutions: vertical scalabilit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 王宏亮邱国金朱泾文
Owner NANJING FUJITSU NANDA SOFTWARE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products