Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and system for OLAP to automatically create and write MQ data

A technology for automatic creation and data, applied in the field of data processing, can solve problems such as strong limitations, low flexibility and scalability, and achieve the effect of reducing intermediate links, reducing system redundancy, and improving system robustness

Active Publication Date: 2020-10-23
上海微亿智造科技有限公司 +1
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the above solutions have strong limitations, and the flexibility and scalability are not high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for OLAP to automatically create and write MQ data

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0051] Specific examples provided according to the present invention are as follows:

[0052] SELECT

[0053] toFloat64OrZero(planPutNum) AS planPutNum,

[0054] toFloat64OrZero(actualPutNum) AS actualPutNum,

[0055] (actualPutNum / planPutNum)AS prodPlanAchieveRate,

[0056] FROM OLAP_M

[0057] WHERE customerId = 'XXX';

[0058] In this example, the toFloat64OrZero function is used to change the original data type of the planPutNum field in the OLAP_M table to the Float64 type, the value of the prodPlanAchieveRate field is calculated through the actualPutNum and planPutNum field values, and the WHERE is used to filter the composite customerId='XXX' data.

[0059] Step A5: Automatically create the OLAP_Distributed table according to the OLAP_MQ table information in step A3. Specifically, according to the information of the OLAP_Entity table, the OLAP cluster information creates the distributed mapping table of OLAP_Entity by concatenating the table sql.

[0060] The data ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a system for OLAP to automatically create and write MQ data. The method comprises the following steps: an automatic table creation step: automatically creating a plurality of OLAP data tables according to an MQ data structure; and a data ETL step of automatically consuming the MQ data to the OLAP data table. According to the invention, a mode of analyzing data fields and information characteristics in a data structure in the MQ to automatically establish the table is adopted, so that redundant and tedious operations of manual table establishment are reduced,the working efficiency is improved, and the risk of manual errors of manual table establishment is also reduced; the OLAP _ MQ table and the OLAP _ View table are adopted to directly obtain the datafrom the MQ, ETL intermediate links are reduced, system redundancy is reduced, and system robustness is improved. The OLAP _ View table can be flexibly adjusted according to service requirements, so that the flexibility and expansibility of the system are improved; according to the invention, the expansibility of the system is improved, and the OLAP efficiency is improved by fully utilizing the computing power of each node.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a method and system for automatically creating and writing MQ data in OLAP. Background technique [0002] Traditional data structure processing adopts the method of manual table creation, which has problems such as redundant and cumbersome operations, low work efficiency, and high risk of manual errors. [0003] The patent document CN103631911B discloses an OLAP query processing method based on array storage and vector processing. In this method, according to the referential integrity constraints in the data warehouse schema, array subscript mapping is performed on the primary-foreign key, so that the primary key of the dimension table and the foreign key of the fact table are directly mapped to the subscript address of the array, and the complex schema is converted into a Virtual materialized tables provide a unified data access view for different queries. OLAP query is simplifi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/25
CPCG06F16/2282G06F16/254
Inventor 金熙李强
Owner 上海微亿智造科技有限公司