A dynamic data storage method and device

A data storage and data technology, applied in the computer field, can solve problems such as the inability to realize the mixture of sparse data and dense data, efficient storage, poor quality of business data, and single storage scheme, so as to meet the access requirements of massive data storage and concise processing logic , The effect of low business coupling

Active Publication Date: 2018-06-26
CHINA MOBILE GRP HEILONGJIANG CO LTD +1
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The storage scheme is single and there are technical shortcomings; the waste of storage space is serious; the storage scheme of some business data is not reasonable and has poor flexibility; it is impossible to realize the mixed and efficient storage of sparse data and dense data; "missing value" is not handled accurately enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A dynamic data storage method and device
  • A dynamic data storage method and device
  • A dynamic data storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] Combined with the analysis of existing technologies, there is a huge reality in building a "hybrid storage structure" that supports column storage with good read performance and row storage with good write performance, thereby supporting both oltp and olap applications Requirements, the present invention provides a mixed and matched physical storage format through the row-column hybrid storage layout, which can not only realize row-based storage or column-based storage of entities, but also can target data characteristics such as sparseness and density of different fields within an entity. Select the appropriate row storage or column storage format to realize dynamic data storage and provide a dynamic data storage method for big data processing. This method can not only adapt to the characteristics of traditional dense data, but also take into account the storage requirements of massive sparse data. , which solves the problem of wasting storage space for massive and spar...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a dynamic data storage method. The dynamic data storage method comprises performing integral metadata definition on data to be stored to define the storage strategy of every attribute list of the data to be stored; organizing the attribute lists into different data subsets according to a key-value pair model; according to the storage strategies of the attribute lists, defining physical storage formats for the data subsets, and storing the data subsets according to the physical storage formats. The embodiment of the invention also provides a corresponding dynamic data storage device. According to the dynamic data storage method and device, the dynamic data storage method is achieved through a layered and configurable storage structure and can meet the storage requirements of sparse data sets and dens data sets in mass data treatment simultaneously.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a dynamic data storage method and device. Background technique [0002] With the rapid development of the Internet, the Internet of Things, and the ICT industry, related business data is showing explosive growth. According to IDC reports, the global data volume will grow at a rate of 40+% in the next 10 years. For China Mobile's business analysis system (hereinafter referred to as the economic sub-system), with the introduction of emerging business data such as the Internet, the difficulty of data storage and the pressure on system support have increased sharply. As the core system of business analysis, the "economic sub-system" The quality of support will directly affect the leadership decision-making, which is related to the operation and development of the company. [0003] With the explosive growth of the data volume of economic subsystems, how to reasonably divide and eff...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/22
Inventor 苏燕赵洪松关德军李振嘉段云峰李红燕张美鸥王依兴孙德志迟建德李宏昌王雅文
Owner CHINA MOBILE GRP HEILONGJIANG CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap