Data storage and query method and device

A data storage and page storage technology, applied in the network field, can solve problems affecting storage system performance, low query speed, low storage speed, etc., to achieve the effect of increasing storage speed, increasing query speed, and avoiding I/O overhead

Active Publication Date: 2020-10-30
ADVANCED NEW TECH CO LTD
View PDF16 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, with the growth of time, the amount of data in fields such as date and timestamp will continue to increase. Creating and maintaining secondary indexes for these fields will seriously affect the performance of the storage system, and the storage speed is low; in addition, using secondary indexes to retrieve data It will also bring I / O overhead that cannot be ignored, and the query speed is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage and query method and device
  • Data storage and query method and device
  • Data storage and query method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0063] Based on the above, an optional implementation manner of step 104 includes:

[0064] The storage server uses the above timestamp to take the modulus of the preset time granularity, obtains the integer part and the remainder part, determines the storage file on the storage server for storing the above value according to the integer part, and determines the storage file used to store the above value according to the storage identifier storage page, and determine the starting position of the above value in the storage page according to the remainder.

[0065] For example, the time granularity may be "one day", "one week", "one month", "one year" and so on. Correspondingly, the values ​​of a day, a week, a month or a year are stored in a file, that is to say, the files on the storage server are stored in units of time granularity.

[0066] Taking the time granularity as "one day" as an example, the above storage file stores values ​​in units of "one day". Then the specifi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storage and query method and device. A storage server to which a numerical value belongs is indicated by an identifier of the storage server in metadata, a storage position of the numerical value in the storage server is indicated by a time stamp and the storage identifier in the metadata, and the numerical value is stored and queried based on the storage position, so that the storage server does not need to establish a secondary index for the time stamp, and the problem of influence on performance of a storage system caused by establishing the secondary index for the time stamp is avoided; and at the same time, the retrieval is no longer based on the secondary index of the time stamp, so that the I / O overhead for retrieving the numerical value through the secondary index is avoided, and the storage and query speed are increased.

Description

【Technical field】 [0001] The invention relates to the field of network technology, in particular to a data storage and query method and device. 【Background technique】 [0002] Whether it is a relational database management system (Relational Database Management System, RDBMS) or various non-relational database (NOSQL) products, they all support the storage of fields such as date (Date) and timestamp (Timestamp). Data in fields such as date and timestamp are generally periodic data. To improve retrieval performance, developers usually use these fields directly and create secondary indexes for all of them. However, with the growth of time, the amount of data in fields such as date and timestamp will continue to increase. Creating and maintaining secondary indexes for these fields will seriously affect the performance of the storage system, and the storage speed is low; in addition, using secondary indexes to retrieve data It will also bring I / O overhead that cannot be ignored...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/27G06F16/9032G06F16/903
Inventor 储晓颖
Owner ADVANCED NEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products