A Method of Rapid Horizontal Expansion of Database

A horizontal expansion, database technology, used in electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of long downtime, high cost of large servers, and inability to expand front-end controllers, so as to improve production efficiency and avoid The effect of uneven distribution of hot spots and simple and easy-to-use algorithms

Active Publication Date: 2016-04-13
NANJING FUJITSU NANDA SOFTWARE TECH
View PDF2 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The vertical expansion architecture needs to add high-performance hardware. Usually, the cost of large-scale servers is more expensive than that of ordinary minicomputers; secondly, the front-end processing capability and the number of back-end disks of the entire storage system can be continuously expanded, but the upgrade and expansion to a certain extent will cause front-end control. Performance bottlenecks where servers cannot scale
[0006] Horizontally expanding the storage system architecture requires re-planning the storage network architecture. Therefore, it is necessary to cooperate with the manufacturer's system integration services to integrate existing storage resources. There will be large-scale data migration, long downtime and other problems, and the requirements for online services are higher. scenario does not apply

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method of Rapid Horizontal Expansion of Database
  • A Method of Rapid Horizontal Expansion of Database
  • A Method of Rapid Horizontal Expansion of Database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] Step 1: Deploy the monitoring module, such as Figure 4 As shown in the initial system architecture diagram of the database, the monitoring module and the routing module are respectively deployed on the hardware machine. The hardware monitoring software used here is the open source OpenHardwareMonitor, which collects database cluster information in real time through the network. When the hardware capacity reaches the set storage capacity threshold, the monitoring software module prompts the administrator to prepare to increase the hardware environment to prepare for the next step of data segmentation.

[0055] Step 2: The hardware environment has been prepared from the previous step, and when the counter of the routing module reaches the preset storage number threshold, it is ready to split. Implementation According to the principle of database horizontal expansion, the segmentation factor α=2 is now taken.

[0056] There are two tables in database instance 0. The rule...

example 0

[0059] At this time, there is only one database instance, so the sub-database rule DRule: "database instance 0"

[0060] Table sub-rule TRule: "tableName"+"ID%2", that is, the data storage of this database instance will take the remainder according to the value of the primary key ID, and the data with a remainder of 0 will be stored in table 0, and the data with a remainder of 1 will be stored in table 1 in. Such as Figure 5 shown.

[0061] Step 3: Assume here that the storage number threshold of database instance 0 is Y pieces of data, then the maximum data volumes of table 0 and table 1 in database instance 0 are respectively Y / 2 pieces of data, when database instance 0 reaches the capacity limit That is, when the data volume of database instance 0 reaches Y, according to the expansion rules, the first expansion is n=1, that is, the total number of database instances is N=2 1 =2, that is, add a database database instance 1, move table 1 into database instance 1, and the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a rapid horizontal extending method for databases, which belongs to the field of data migration and storage. The method comprises the following steps: a monitoring and control system carries out monitoring on the disk storage space of the existing database, and when the disk size reaches a preset storage capacity threshold, the monitoring and control system triggers a hardware storage increasing action so as to make a hardware environment preparation for data migration; and a routing protocol carries out a modular computation on the instance number N of the current database according to a major key ID to be inserted currently, and routes the line number of data to be inserted into a specified database, and when the number of inserted lines exceeds a preset storage number threshold, the routing protocol triggers a database segmentation action so as to migrate specified data into a new database, thereby completing the rapid horizontal extending of the database. The method disclosed by the invention can be applied to disk databases or memory databases, and the method is easy to use and simple, and avoids the problem that hotspots are distributed nonuniformly caused by traditional horizontal extending of databases; in addition, as the scale of migration of data segmented each time is small, the extending speed is improved. In conclusion, the overall architecture meets the requirements on high availability, high reliability, high speed, high efficiency and the like.

Description

technical field [0001] The invention relates to a method for expanding the storage capacity of a database, in particular to a method for quickly and horizontally expanding the database in response to the ever-increasing demand for the data storage capacity of an enterprise-level database. Background technique [0002] With the rapid development of the Internet, the amount of application data and the number of visits are increasing rapidly. For the traditional enterprise IT architecture system, the storage data of the disk database is facing the huge pressure of large concurrency and high data volume transmission. In order to cope with the trend of big data and improve the scalability of database capacity, the choice of expansion scheme is particularly critical. [0003] In the prior art, the problem of data growth storage is realized by increasing the disk of a single database, and the scalability of the system is solved. There are usually two solutions: vertical scalabilit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 王宏亮邱国金朱泾文
Owner NANJING FUJITSU NANDA SOFTWARE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap