Data insertion method, device, server and storage medium based on column storage

A technology of data insertion and column storage, applied in the database field, can solve the problems of cumbersome small data operations, and achieve the effect of improving the efficiency of insertion

Active Publication Date: 2021-03-02
SHANGHAI DAMENG DATABASE
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, an embodiment of the present invention provides a column storage-based data insertion method, device, server, and storage medium to solve the problem of cumbersome operations when frequently inserting small data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data insertion method, device, server and storage medium based on column storage
  • Data insertion method, device, server and storage medium based on column storage
  • Data insertion method, device, server and storage medium based on column storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] figure 1 It is a flow chart of the column storage-based data insertion method provided by Embodiment 1 of the present invention. This embodiment can be applied to a data insertion system, and the method can be executed by a data insertion device, such as figure 1 As shown, the technical solution provided in this embodiment specifically includes the following steps:

[0031] Step 110, acquire the data to be inserted into the column storage table.

[0032] Column storage is to store data in units of columns, and its specific storage rules and management implementation methods will directly determine the operation efficiency of column storage tables. The data that the user needs to insert is the data to be inserted, and the column storage table to be inserted is specified.

[0033] The data to be inserted in this embodiment of the application can be any data object that needs to be inserted, for example, it can be a student data object, where the student data object usua...

Embodiment 2

[0073] figure 2 A flowchart of a data insertion method based on column storage provided by Embodiment 2 of the present invention is given. This embodiment provides a preferred embodiment based on the foregoing embodiments, and for details not described in detail in this embodiment, refer to the foregoing Embodiment 1. Such as figure 2 As shown, a column-based data insertion method provided in this embodiment includes the following steps:

[0074] Step 210, acquiring data to be inserted into the column storage table.

[0075] Step 220, according to the data to be inserted, obtain data in an insertion auxiliary table corresponding to the column storage table, and the insertion auxiliary table is used to record insertion data less than a preset number of rows.

[0076] Step 230, judging whether the total number of rows of the data to be inserted and the data inserted into the auxiliary table is less than the preset number of rows, if yes, execute step 240, if not, execute st...

Embodiment 3

[0086] image 3 A flowchart of a data insertion method based on column storage provided by Embodiment 3 of the present invention is given. This embodiment provides a preferred embodiment based on the above-mentioned second embodiment. For details not described in detail in this embodiment, refer to the above-mentioned second embodiment. Such as image 3 As shown, a column-based data insertion method provided in this embodiment includes the following steps:

[0087] Step 301, acquire the data to be inserted into the column storage table.

[0088] Step 302, according to the data to be inserted, obtain data in an insertion auxiliary table corresponding to the column storage table, and the insertion auxiliary table is used to record insertion data less than a preset number of rows.

[0089] Step 303, judging that the total number of rows of the data to be inserted and the data inserted into the auxiliary table is less than the preset number of rows, if yes, execute step 304, ot...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data insertion method, device, server and storage medium based on column storage, and relates to the field of databases. The method includes: acquiring data to be inserted into a column storage table; acquiring data corresponding to the column storage table and inserting into an auxiliary table; if If the total number of rows of the data to be inserted and the data inserted into the auxiliary table is less than the preset number of rows, the data to be inserted will be inserted into the auxiliary table; if the total number of rows of the data to be inserted and the data inserted into the auxiliary table is greater than or equal to the preset row number, then store the data inserted into the auxiliary table and the data to be inserted into one or more data areas according to the preset number of rows, clear the inserted auxiliary table, and store the remaining data in the inserted auxiliary table; One or more data areas are saved as data files of the column storage table, and the obtained control information and statistical information of each data area are inserted into the column storage auxiliary table corresponding to the column storage table. The present invention adopts the above-mentioned technical scheme, and improves the data insertion efficiency of the column storage table.

Description

technical field [0001] Embodiments of the present invention relate to database technologies, and in particular, to a data insertion method, device, server and storage medium based on column storage. Background technique [0002] In order to improve the performance of data query, the method of storing data in the form of column storage came into being. The query performance of the column storage table is better than that of the row storage table, but conversely, the insertion performance of the column storage table is lower than that of the row storage table. [0003] The basic idea of ​​the column storage table is to store the data in the table in units of columns. The physical location of the data storage of a row is not continuous. Therefore, when a single row (or a few rows) is frequently inserted, the performance of the column storage table will be very poor. Difference. Contents of the invention [0004] In view of this, embodiments of the present invention provide ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22
Inventor 郭琰王攀周智伟
Owner SHANGHAI DAMENG DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products