Database-dividing and table-dividing method and device for mass data
A technology of sub-database, sub-table and massive data, applied in the field of information processing, can solve the problems of complex business data processing and low efficiency, and achieve the effect of reducing processing difficulty, improving utilization rate, and reducing maintenance costs
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0048] In order to solve the problem that traditional solutions cannot effectively store massive data, the embodiment of the present invention provides a method for storing massive data in separate databases and tables based on the self-developed sub-database algorithm and table sub-algorithm, which can convert traditional relational databases into Perform efficient vertical splitting and horizontal splitting.
[0049]Among them, in the field of database technology, the storage and processing capabilities of a single table have an upper limit. Once the upper limit is exceeded, the storage and processing performance will decline, and different relational databases have different single-table storage and processing capabilities. Therefore, Special processing is required according to different databases, but the storage methods of sub-databases and sub-tables are the same. Therefore, in order to illustrate the technical solution of the present invention more clearly, the MySQL da...
Embodiment 2
[0095] In the traditional solution, when performing batch query of data through query statements, that is, when executing a query with the IN keyword, all value lists corresponding to the IN keyword will be sent to different databases for execution. But the fact is that some of these value lists are only stored in the A`table of the A database, and should be queried in the A`table of the A database, while some values are only stored in the B`table of the B database. You should go to the B` table of the B database to query. However, because the traditional solution does not perform additional clustering processing when performing such batch data query, but simply and rudely distributes the original SQL query statement directly to each database for execution, it not only wastes resources, but also reduces execution efficiency.
[0096] In order to solve the above problems, on the basis of storing data in separate databases and tables in the above-mentioned embodiment 1, the e...
Embodiment 3
[0112] On the basis of the sub-database and sub-table storage methods for massive data provided in the above-mentioned embodiment 1 and embodiment 2, the present invention also provides a sub-database and sub-table storage device that can be used to implement the above method, such as Figure 12 Shown is a schematic diagram of the device architecture of the embodiment of the present invention. The sub-database and sub-table storage device for massive data in this embodiment includes one or more processors 21 and memory 22 . in, Figure 12 A processor 21 is taken as an example.
[0113] The processor 21 and the memory 22 may be connected via a bus or in other ways, Figure 12 Take connection via bus as an example.
[0114] The memory 22 is a non-volatile computer-readable storage medium for storing massive data in sub-databases and sub-tables, and can be used to store non-volatile software programs, non-volatile computer-executable programs and modules, as in the embodiment ...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More