Memory data warehouse query processing implementation method for database integrated machine

A technology of memory data and implementation method, which is applied in the direction of electrical digital data processing, special data processing applications, database models, etc., can solve problems such as immature optimization technology research, improve query throughput performance, improve overall performance, and improve utilization rate Effect

Active Publication Date: 2017-06-13
RENMIN UNIVERSITY OF CHINA
View PDF3 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current in-memory data warehouse technology is mainly oriented to the hardware architecture of homogeneous server clusters, and the optimization technology research for asymmetric server clusters and new storage and computing equipment is still immature

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Memory data warehouse query processing implementation method for database integrated machine
  • Memory data warehouse query processing implementation method for database integrated machine
  • Memory data warehouse query processing implementation method for database integrated machine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.

[0027] The present invention provides a method for realizing query processing of memory data warehouse for database all-in-one machine. The method is oriented to the asymmetric hardware architecture of database all-in-one machine, as well as new storage and computing hardware such as flash memory and multi-core coprocessor accelerator card, etc. to optimize the design, so that It adapts to the characteristics of in-memory OLAP query processing and provides high-performance in-memory data warehouse OLAP query processing capabilities. The specific steps are as follows:

[0028] 1) Construct the memory data warehouse storage model:

[0029] like figure 1 As shown, the hardware architecture of the all-in-one database usually adopts an asymmetric structure, which is usually composed of high-performance computing server clusters and storage service cluster...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a memory data warehouse query processing implementation method of a database oriented integrated machine. The steps of the memory data warehouse query processing implementation method comprise constructing a memory data ware house storage model; constructing a memory data warehouse integrated machine distributed storage model; adopting data updating strategy for a high performance computing server cluster: When the high performance computing server cluster having insufficient memory capacity, adopting a round-robin queue update strategy to eliminate the oldest data and to update to the latest data; and realizing OLAP query processing of the memory data warehouse integrated machine. The memory data warehouse query processing implementation method can improve the memory database integrated machine asymmetric storage and computing resource utilization, improve overall, performance of memory OLAP and can further process different multiple queried stages on the memory database integrated machine with pipelining parallelism and can improve system OLAP query throughput performance. The memory data warehouse query processing implementation method is suitable for a memory OLAP application scene of the memory oriented data warehouse integrated machine, and can adapt to the memory OLAP performance acceleration demand under the memory database integrated machine asymmetric hardware architecture.

Description

technical field [0001] The invention relates to a method for realizing a data warehouse, in particular to a method for realizing query processing of a memory data warehouse oriented to a database integrated machine. Background technique [0002] The database all-in-one machine is a software and hardware integrated design solution designed for the application characteristics of database big data storage and high-performance query processing. In terms of hardware design, the all-in-one database is usually a server cluster architecture with a cabinet as the unit, providing scalable big data storage and processing capabilities through the built-in high-speed network and server clusters. Provide different server cluster scale expansion capabilities in the cabinet, and achieve horizontal expansion in units of cabinets; database all-in-one machines usually use small-scale high-performance computing server clusters for complex query processing services and large-scale low-end storag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2264G06F16/235G06F16/24532G06F16/283
Inventor 张延松王珊杜小勇
Owner RENMIN UNIVERSITY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products