A data storage system and method for large data

A data storage system and big data technology, applied in the field of data statistics, can solve the problems of difficult data use and data management, achieve efficient storage and use, and solve the effect of large data volume

Active Publication Date: 2019-02-01
GREAT WALL COMP SOFTWARE & SYST CO LTD
View PDF7 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For statistical micro data, the current main data sources are online direct reporting system and various survey collection systems, and there are problems such as difficult data management and data use

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data storage system and method for large data
  • A data storage system and method for large data
  • A data storage system and method for large data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The principles and features of the present invention are described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0026] The invention belongs to a data storage technology based on DDI (Data Documentation Initiative) metadata standard. DDI was initiated by Richard Rockwell of the American Political and Social Science Research Intercollegiate Alliance in 1995. It can provide integrated metadata for scientific research and improve Existing data archiving methods to make data exchange easier. The DDI3.0 Lifecycle standard covers the entire life cycle of statistical services, including system design, data collection, data processing, data distribution, data mining, data analysis, and data archiving.

[0027] The data storage method based on the DDI metadata standard has the following characteristics:

[0028] 1) Under the national...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data storage system and a data storage method of large data. The system comprises a four-layer structure. The metadata structure layer defines and stores a plurality of metadata types and attributes of the metadata types. The metadata layer defines and stores all the association relations between metadata object information and metadata object according to the attributesof metadata type. The data structure layer defines and stores the structural relationship of statistical data according to the metadata object information. The data layer stores statistical data according to the structural relationship of the statistical data. The invention is based on DDI metadata standard, Defines a four-tier structure for statistical data storage: metadata structure, Metadata,data structure and data, so as to unify the storage and management of massive micro-data according to the big data structure, break down the barriers of data resource integration, realize the flexible and efficient storage and use of statistical data, and then largely solve the problems of large amount of data, complex structure, rapid growth rate, and data analysis and use difficulties and so on.

Description

technical field [0001] The invention relates to the field of data statistics, in particular to a data storage system and method for big data. Background technique [0002] With the advent of the big data era, the pressure on data storage and data processing has increased. For statistical micro data, the current main data sources are online direct reporting system and various survey collection systems, which have problems such as difficult data management and data use. Contents of the invention [0003] In view of the above technical problems, the present invention provides a data storage system and method for big data. [0004] The technical solution of the present invention to solve the above-mentioned technical problems is as follows: a data storage system for big data, comprising: [0005] The metadata structure layer is used to define and store various metadata types and attributes of metadata types; [0006] The metadata layer is used to define and store all metada...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2457G06F16/22
Inventor 魏强裴亚波李丽辉王丹宁翟胜强马静静
Owner GREAT WALL COMP SOFTWARE & SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap