Dynamic data storage method and device

A data storage and data technology, applied in the computer field, can solve the problems of inability to realize the mixing of sparse data and dense data, efficient storage, poor business data quality, and single storage scheme, so as to meet the storage access requirements of massive data, and the processing logic is concise. , the effect of low business coupling

Active Publication Date: 2015-04-15
CHINA MOBILE GRP HEILONGJIANG CO LTD +1
View PDF4 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The storage scheme is single and there are technical shortcomings; the waste of storage space is serious; the storage scheme of some business data is not reasonable and has poor flexibility; it is impossible to realize the mixed and efficient storage of sparse data and dense data; "missing value" is not handled accurately enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic data storage method and device
  • Dynamic data storage method and device
  • Dynamic data storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] Combined with the analysis of existing technologies, there is a huge reality in building a "hybrid storage structure" that not only supports column storage, has good read performance, but also supports row storage, has good write performance, and thus supports both oltp and olap applications. As required, the present invention provides a mixed and matched physical storage format through a mixed row and column storage layout, which can not only realize the row storage or column storage of the entity, but also can target the sparse and dense data characteristics of different fields within an entity. Choose a suitable row storage or column storage format to realize dynamic data storage and provide a dynamic data storage method for big data processing. This method can not only adapt to the characteristics of traditional dense data, but also take into account the storage requirements of massive sparse data , Solve the problem of wasting massive sparse data storage space in the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a dynamic data storage method. The dynamic data storage method comprises performing integral metadata definition on data to be stored to define the storage strategy of every attribute list of the data to be stored; organizing the attribute lists into different data subsets according to a key-value pair model; according to the storage strategies of the attribute lists, defining physical storage formats for the data subsets, and storing the data subsets according to the physical storage formats. The embodiment of the invention also provides a corresponding dynamic data storage device. According to the dynamic data storage method and device, the dynamic data storage method is achieved through a layered and configurable storage structure and can meet the storage requirements of sparse data sets and dens data sets in mass data treatment simultaneously.

Description

Technical field [0001] The present invention relates to the field of computer technology, in particular to a dynamic data storage method and device. Background technique [0002] With the rapid development of the Internet, the Internet of Things, and the ICT industry, related business data has shown an explosive growth trend. According to the IDC report, the global data volume will grow at a rate of 40+% in the next 10 years. For China Mobile’s business analysis system (hereinafter referred to as the economic and sub-system), with the introduction of new business data such as the Internet, the difficulty of data storage and the pressure of system support have increased sharply. As the core system of business analysis, the "economic and sub-system" The quality of support will directly affect leadership decisions and is related to the company's operations and development. [0003] With the explosive growth of the data volume of the economic and sub-system, how to reasonably divide a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/22
Inventor 苏燕赵洪松关德军李振嘉段云峰李红燕张美鸥王依兴孙德志迟建德李宏昌王雅文
Owner CHINA MOBILE GRP HEILONGJIANG CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap