Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for quickly loading data into database

A database and data technology, applied in the database field, can solve problems such as not being able to make good use of the superior hardware performance of multi-core systems, and achieve the effect of improving writing efficiency and utilization

Inactive Publication Date: 2013-04-17
北京人大金仓信息技术股份有限公司
View PDF5 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In addition, Ma Li et al. pointed out in the paper "A Fast Reading Method for Massive Data Based on Multi-core Environment" (published in the Proceedings of the 16th National Information Storage Technology Conference (IS T2010) in 2010) that: With the multi-core With the development of computers, multi-core PCs have been able to complete many large-scale computing tasks. However, in the face of massive data processing, data reading in memory and auxiliary memory often becomes the bottleneck of improving the running speed of applications, so that multi-core cannot be used well. Superior hardware performance brought by the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for quickly loading data into database
  • Method for quickly loading data into database
  • Method for quickly loading data into database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] The technical idea adopted in the present invention is to improve the loading efficiency of data files through technical means such as parallel threads and direct data writing. In the specific implementation process, on the one hand, the method of parallel loading of data is specified through the configuration file, and the number of parallel threads is specified; on the other hand, the method of direct writing (Direct) is specified, eliminating the layer-by-layer data file writing process examine. Through the above-mentioned technical means, the loading speed of the data file is effectively improved. A detailed description will be launched below in conjunction with the accompanying drawings.

[0018] Such as figure 1 As shown, after the database is started, if data files need to be quickly written into the database, firstly make a configuration file for the data file writing process according to the data file itself, database tables and hardware conditions. Through ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for quickly loading data into a database. The method includes loading data files in a parallel mode when the data files are written into the database; and directly writing the data files in a loading procedure, generating tuples and then directly writing the tuples into the data files in the database. The method has the advantages that the CPU (central processing unit) utilization rate is increased owing to a parallel thread mode, inspection for various affairs when the data files are written into the database are omitted owing to the fact that the configured data are directly written into the database, and accordingly the writing efficiency of the data files can be effectively improved.

Description

technical field [0001] The invention relates to a method for quickly loading data files into a database, belonging to the technical field of databases. Background technique [0002] With the widespread popularization of Internet applications, the access and storage of massive data has become a bottleneck in the design of database systems. Most of the data writing interfaces of traditional databases use a single-threaded working mode, which is inefficient when writing massive data. However, existing database servers generally use multi-core CPUs, and the single-threaded data writing method will cause huge waste of CPU resources. In addition, during the process of external data being written into the database through the data writing interface, the database system usually performs multiple transaction checks. These transaction checks also reduce the write efficiency of data files. [0003] In the Chinese patent application with application number 200910080927.X, a method an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 张树杰王颖泽冯玉李祥凯任永杰王珊
Owner 北京人大金仓信息技术股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com