Method and device for converting data storage format

A data storage format and storage format technology, applied in the field of database systems

Active Publication Date: 2019-03-26
罗三杰
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the row, column, or mixed row-column storage formats of existing databases are completely dependent on the initial settings when the database is initialized, that is, the underlying storage format of the database specified by the user when creating the database.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for converting data storage format
  • Method and device for converting data storage format
  • Method and device for converting data storage format

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0079] An embodiment of the present invention provides a controller, such as figure 1 shown, including:

[0080] A decision-making unit 10, configured to determine a second storage format required for storing data in the database if the system performance index of the database storing data in the first storage format satisfies the conversion condition set by the user;

[0081] a storage format conversion unit 11, configured to convert the storage format of the data in the database from the first storage format to the second storage format determined by the decision-making unit 10;

[0082] The feedback unit 12 is used to judge whether the compression ratio of the database after the storage format conversion meets the first preset condition, sort the data in the database after the storage format conversion, and test whether the sorting time meets the second preset condition ; If the compression ratio satisfies the first preset condition, and the sorting time satisfies the seco...

Embodiment 2

[0096] Embodiments of the present invention The embodiment provides a controller, such as image 3 shown, including:

[0097] The processor 20 is used to determine the second storage format required for storing data in the database if the system performance index of the database storing data in the first storage format meets the conversion condition set by the user; After the storage format of the data in the database is converted from the first storage format to the second storage format, it is judged whether the compression ratio of the database after the storage format conversion satisfies the first preset condition, and the storage format sorting the converted data in the database, and testing whether the sorting time satisfies the second preset condition; if the compression ratio satisfies the first preset condition, and the sorting time satisfies the second preset condition, external services are performed, Or, if the compression ratio does not meet the first preset con...

Embodiment 3

[0111] Embodiments of the present invention provide a method for converting data storage formats, such as Figure 5 As shown, the method includes:

[0112] S101. If the system performance index of the database storing data in the first storage format satisfies the conversion condition set by the user, the controller determines the second storage format required for storing data in the database.

[0113] The row, column, or row-column hybrid storage format of existing databases is completely dependent on the initial setting when the database is initialized, that is, the underlying storage format of the database specified by the user when creating the database. When the user needs to change the database storage format, the DBA needs to manually modify it offline, which lacks the automatic adjustment and optimization function of the system.

[0114] In order to solve the problem that the system cannot automatically adjust and optimize the storage format of data in the database, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Provided in the embodiment are a method and apparatus for the conversion of data storage formats, which relate to the technical field of database systems and can enable a dynamic determination of the low-level storage format by a database system so as to realize the automatic regulation and optimization functions of the system. The method comprises: if the system performance indexes of a database in which data is stored in a first storage format meet a conversion condition set by a user, then determining a second storage form required for data storage in the database; converting the storage format of the data from the first storage format to the second storage format; judging whether the compression ratio of the database undergoing storage format conversion meets a first preset condition, sorting the data in the database, and testing whether the time for sorting meets a second preset condition; if the compression ratio meets the first preset condition and the time for sorting meets the second preset condition, then providing external services; or if the compression ratio fails to meet the first preset condition and / or the time for sorting fails to meet the second preset condition, then re-determining the second storage format.

Description

technical field [0001] The invention relates to the technical field of database systems, in particular to a data storage format conversion method and device. Background technique [0002] With the continuous deepening of social informatization, the use of database systems is becoming more and more extensive, and the ever-accumulating mass data and growing data expansion put forward new requirements for database systems. [0003] The data stored in the database has a certain storage format, and different storage formats can affect the performance of the database system. The row storage structure can quickly complete data loading and is highly adaptable to dynamic loads, but the row storage structure cannot support fast query processing, and at the same time, the space utilization rate is not easy to be greatly improved. Although a good compression ratio can be achieved by entropy coding and exploiting column dependencies, complex data storage implementations lead to increase...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/25
CPCG06F16/217G06F16/215
Inventor 李怀洲姜旭栋
Owner 罗三杰
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products