Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for processing data

A data processing and database technology, applied in the computer field, can solve problems such as poor system flexibility and scalability, slow system response, and inability to flexibly update cached data, so as to improve query response speed and query performance, and improve effectiveness and hits rate effect

Active Publication Date: 2013-09-25
HUAWEI TECH CO LTD
View PDF6 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has two disadvantages: (1) The cache data is only selected based on the developer's experience, without considering factors such as the frequency of data query and the complexity of hierarchical data query, the effectiveness of cache data and the cache hit rate are low ; (2) The cached data is solidified in the memory, the cached data cannot be updated flexibly, and the flexibility and scalability of the system are poor
The existing In Memory OLAP technology is not ideal in the face of massive data. The main problem is that the system responds slowly and the real-time performance is not ideal.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for processing data
  • Method and device for processing data
  • Method and device for processing data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0067] figure 2 It is a flow chart of the data processing method based on the above-mentioned OLAP system provided by this embodiment, as figure 2 Shown, the data processing method of the present invention comprises:

[0068] S101. Obtain a data query request, and generate a query plan according to the data query request.

[0069] Each data query request corresponds to a query plan. For example, the data that the user requests to query is the sales volume of subsidiary A in xx years, the OLAP device receives the data query request, and generates a corresponding query plan as: the sales volume of subsidiary A in xx years.

[0070] For the existing user query data in the data warehouse, the existing user query data is processed one by one through the method of this embodiment, and each data query request corresponds to a query plan.

[0071] S102. Decompose the query plan into multiple sub-query plans.

[0072] The intermediate result data of the query plan is correspondin...

Embodiment 2

[0136] Figure 4 is a schematic diagram of the data processing device provided in this embodiment, such as Figure 4 As shown, the data processing device of the present invention includes: a query plan processor 101 , a query plan parser 102 , a sub-plan manager 103 , a cost manager 104 and a data manager 105 .

[0137] The query plan processor 101 is configured to obtain a data query request, and generate a query plan according to the data query request.

[0138] The query plan processor 101 is an input terminal of the data processing device, and receives a data query request input by a user through a user data query interface. Each data query request corresponds to a query plan. For example, the data that the user requests to query is the sales volume of subsidiary A in xx years, the OLAP device receives the data query request, and generates a corresponding query plan as: the sales volume of subsidiary A in xx years.

[0139] For the existing user query data in the data w...

Embodiment 3

[0163] Figure 5 is a schematic structural diagram of the online analysis and processing equipment provided in this embodiment, such as Figure 5 As shown, the online analysis and processing device of the present invention includes: a processor 501, a network interface 502, a memory 503, other storage devices 504, and a data bus 505 for connection and communication.

[0164] The processor 501 may be a single-core or multi-core central processing unit (Central Processing Unit, CPU), or a specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits configured to implement embodiments of the present invention circuit.

[0165] The network interface 502 is used to interact with the data warehouse or network.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method and a device for processing data. The method includes acquiring a data query request and generating a query plan according to the data query request; decomposing the query plan into a plurality of sub-query plans; determining query costs of the multiple sub-query plans according to information of sub-query plans stored in a sub-query database; storing data corresponding to certain sub-query plans among the multiple sub-query plans in a cache. The query costs of the certain sub-query plans meet preset conditions. The method and the device for processing the data have the advantages that the cache can be sufficiently utilized for storing the data, the value realized by the cache is maximized, the validity of the data of the cache is improved, the hit rate of the data of the cache is increased, accordingly, the query response speed of OLAP (on-line analytical processing) is increased, and the query performance of the OLAP is improved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method and device. Background technique [0002] On-Line Analytical Processing (OLAP) is a software tool that can provide managers and analysts with fast and consistent interactive access to multi-dimensional information, so as to obtain more in-depth analysis of data. It is mainly used in various The field of business intelligence analysis. The OLAP logic system includes three parts: source data reading, cube modeling analysis processing and user presentation. Data sources for OLAP can come from a variety of different physical storage media: such as clustered data warehouses, local hard drives, flash memory or solid-state drives. The process of OLAP processing user query requests: (1) first load the original data from the storage medium; (2) model the loaded data through multi-dimensional cubes; (3) process the data according to the user's query req...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 姜松周炎谢俊
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com