Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data storage method and apparatus

A data storage and data technology, applied in the computer field, can solve the problems of slow query speed, high resource occupation, large space occupation, etc., to avoid reading and traversing a large amount of unnecessary data, and speed up the query speed.

Active Publication Date: 2017-10-17
BEIJING QIHOO TECH CO LTD
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current problem is that even if we can determine which row the data to be queried is in the data table, we do not know the specific location of the data in the row
However, many columnar storage files take up a lot of space on the disk. If you traverse them, you will inevitably read a lot of useless data, resulting in slow query speed, low efficiency, and high resource usage.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and apparatus
  • Data storage method and apparatus
  • Data storage method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0032] figure 1 shows a schematic flow chart of a data storage method according to an embodiment of the present invention, such as figure 1 As shown, the method includes:

[0033] In step S110, the number of rows that can be stored in each page of the disk is preset as N, where N is a natural number.

[0034] Page (Page) is a logical concept. For a database, a page is a unit that stores physical records on a disk, and is also the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data storage method and apparatus. The method comprises the steps of presetting the number of storable rows of each page in a disk to be N, wherein N is a natural number; for each to-be-stored column in a data table, allocating a column block containing a group of pages to the column, and storing data in the column to each page in the column block in sequence, wherein each page stores N rows of data in the column; when a data query request is received, determining a to-be-queried column block according to the column corresponding to the query request, and determining a target page in the column block according to the rows in the corresponding column hit by the query request; and reading data in the target page to a memory and performing a query according to the data query request. According to the technical scheme, by improving column storage, a data address is quickly located when the row in which the to-be-queried data is located is determined, so that a large amount of unnecessary data is prevented from being read and traversed, and the query speed is increased.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data storage method and device. Background technique [0002] In big data scenarios, columnar storage has significant advantages over row-based storage. However, the current problem is that even if we can determine which row the data to be queried is in the data table, we do not know the specific location of the data in the row. However, many columnar storage files occupy a large amount of disk space. If you traverse them, you will inevitably read a large amount of useless data, resulting in slow query speed, low efficiency, and high resource usage. Contents of the invention [0003] In view of the above problems, the present invention is proposed to provide a data storage method and device for overcoming the above problems or at least partially solving the above problems. [0004] According to one aspect of the present invention, a data storage method is provided, includ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30G06F3/06
CPCG06F3/0608G06F3/0638G06F3/0676G06F16/2282G06F16/24569
Inventor 李振炜李远策陈永强翟鑫达
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products