Data storage method and apparatus

A data storage and data technology, applied in database indexing, digital data processing, structured data retrieval, etc., can solve problems such as inability to meet database performance requirements, affecting user experience, and unreasonable databases.

Active Publication Date: 2018-06-01
CHINA MOBILE COMM LTD RES INST +1
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a data storage method and device, which are used to solve the problem that the selected database for storing data to be stored in the prior art is unreasonable, cannot meet the user's performance requirements for the database for storing data to be stored, and affects the user's experience.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and apparatus
  • Data storage method and apparatus
  • Data storage method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] figure 1 A schematic diagram of a data storage process provided by an embodiment of the present invention, the process includes:

[0056] S101: For the current data to be stored, extract a set amount of data from the data to be stored as test data.

[0057] The data storage method provided by the embodiment of the present invention is applied to an electronic device, and the electronic device may be a personal computer, a tablet computer, or a server or the like.

[0058] Specifically, for the current data to be stored, a set amount of data is extracted from the data to be stored as test data. The set number can be 5, 10, etc. For example, the current data to be stored contains 100 pieces Data, the set number is 10, and 10 pieces of data are randomly extracted from the data to be stored as test data. Of course, the set number can also be the proportional value of extracting the data to be stored, for example: the received data to be stored The data contains a total of...

Embodiment 2

[0072] In order to accurately determine the target database for data storage, on the basis of the above embodiments, in the embodiment of the present invention, before determining the test type for the database to be stored according to the preset performance requirements, the Methods also include:

[0073] According to the type of the data to be stored and the data type targeted by each storage database, a database corresponding to the type of the data to be stored is selected as the database to be stored.

[0074] According to the structure of the database, the database includes: key-value storage database, document database, column storage database and graph database. Among them, the key-value storage database mainly uses a hash table, which has a specific key and a pointer to specific data. The advantage of this type of database is that it is simple and easy to deploy. Typical key-value storage databases include: Redis, Memcached, Dynamo, Voldemort, and LevelDB. This type ...

Embodiment 3

[0085] In an embodiment of the present invention, the performance requirements include:

[0086] Prioritize loading performance, storage efficiency, and query performance.

[0087] Loading performance priority refers to the need to give priority to the loading performance of the database when selecting the target database; storage efficiency priority refers to the need to give priority to the storage efficiency of the database when selecting the target database; query performance priority refers to the need to consider the database when selecting the target database query performance.

[0088] In order to understand the corresponding performance requirements of each database to be stored, it is necessary to perform a corresponding test on the database to be tested, because each performance requirement is different, so the test types of the database to be tested are also different. Specifically, in the embodiment of the present invention, the determination of the test type for...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses a data storage method and apparatus. The method comprises: extracting a set quantity of data from to-be-stored data as test data for the currently to-be-stored data; determining a test type of the test on a to-be-stored database according to a preset performance requirement; according to the test type and the test data, testing each to-be-stored database to determine test parameters corresponding to each to-be-stored database; and according to the test parameters corresponding to each to-be-stored database and the preset performance requirement, determining a target database, and storing the to-be-stored data in the target database. The technical scheme of the present invention is used to solve the problems that in the prior art, the database selected for storing the to-be-stored data is unreasonable, cannot satisfy the requirement of the user for the performance of the database storing the to-be-stored data, and affects the user experience.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a data storage method and device. Background technique [0002] With the rapid development of information technology, data is exploding, the amount of data to be stored is also increasing, and the data types are becoming more and more complex. In the face of massive amounts of data, a single database can no longer meet the storage needs of all data. When the existing storage technology stores data, it generally sets up multiple databases. When the current database for data storage is full of data, then Start the next database for data storage. [0003] However, in the prior art, after receiving the data to be stored, the data is stored according to the storage order of the database, without considering the current storage environment requirements and the user's performance requirements when storing the data to be stored, so the existing The data storage method in the techn...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/22
Inventor 陈洪岭
Owner CHINA MOBILE COMM LTD RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products