Intelligent storage table implementation method and system for NEWSQL database management system

A management system and implementation method technology, applied in the field of intelligent storage table implementation, can solve the problems of increasing disk IO burden, increasing system congestion, frequent updates, etc., and achieve the goal of reducing system IO contention, improving concurrent performance, and efficient concurrent operations Effect

Pending Publication Date: 2020-10-09
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This scenario will destroy the cache mechanism of the storage engine, and new data will be added and modified continuously, resulting in frequent cache updates, which will increase the burden of disk IO, increase system congestion, and greatly affect the efficiency of business execution. There is a small table high concurrent read and write access performance bottleneck problem in the distributed NewSQL database, so an intelligent storage table implementation method and system for the NEWSQL database management system have been invented to solve the above problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent storage table implementation method and system for NEWSQL database management system
  • Intelligent storage table implementation method and system for NEWSQL database management system
  • Intelligent storage table implementation method and system for NEWSQL database management system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] A method for realizing an intelligent storage table for a NEWSQL database management system, the method comprising:

[0052] S1NEWSQL database management system uses ROCKSDB as the basic data kv storage engine;

[0053] S2 collects the data information of the user table;

[0054] S3 schedules the user table according to the statistical information of the memory table;

[0055] When the NEWSQL database management system starts, according to S1, a memory mode ROCKSDB is automatically added and mounted as the storage engine of the memory table. This memory engine can provide the same behavior as ordinary ROCKSDB, and can simulate ordinary file objects to implement memory file objects, and the object Use memory as the final medium for reading and writing to ensure the integrity of sql functions, and then collect the data information of user tables according to S2. When the distributed NEWSQL database management system mounts the memory storage engine, the available memory ...

Embodiment 2

[0077] A kind of intelligent storage table realization system for NEWSQL database management system, described system comprises engine construction module, information statistics module and data collection module:

[0078] Engine construction module: NEWSQL database management system uses ROCKSDB as the basic data kv storage engine;

[0079] Information statistics module: collect the data information of the user table;

[0080] Data scheduling module: schedule the user table according to the statistical information of the memory table;

[0081] When the NEWSQL database management system is started, a memory mode ROCKSDB is automatically added and mounted as the storage engine of the memory table through the engine construction module. This memory engine can provide the same behavior as ordinary ROCKSDB, and can simulate ordinary file objects to realize memory file objects, and The object uses memory as the final medium for its reading and writing to ensure the integrity of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent storage table implementation method and system for an NEWSQL database management system, and belongs to the technical field of database storage computers. The method comprises the following steps: S1, adopting ROCKSDB as a basic data kv storage engine by an NEWSQL database management system ; S2, collecting data information of a user table; S3, scheduling theuser table according to the statistical information of a memory table; aiming at a write-read operation scene capable of performing concurrent processing in a database, the method solves the data IOperformance problems such as conflicts between write-read data and the like by memorizing a user data table, realizes efficient concurrent operation of the data, and does not support a memorizing processing mechanism for a table with overlarge data volume. And on the premise of ensuring that the ACID characteristics of the database are not damaged, the concurrent performance of writing and readingdata is improved.

Description

technical field [0001] The invention discloses a method and system for realizing an intelligent storage table used in a NEWSQL database management system, and relates to the technical field of database storage computers. Background technique [0002] The name of the memory table means that the user table stores user data in the memory. Compared with the ordinary user data table, its main memory is the main memory. Reads table rows from memory and writes these rows to memory. But like ordinary user tables, it supports all system sql functions, supports multiple copies of data, supports ACID functions of transactions, and supports data persistence and fault recovery. [0003] The usage scenario of the memory table is mainly for OLTP applications. The number is not large, such as a few million, but it will be added, deleted, modified and checked frequently. This scenario will destroy the cache mechanism of the storage engine, and new data will be added and modified continuous...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/22G06F16/2453
CPCG06F16/211G06F16/2282G06F16/2453
Inventor 史大义高子奇江磊
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap