Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and system for automatically creating and writing mq data by olap

A technology for automatic creation and data, applied in the field of data processing, can solve problems such as low flexibility and scalability, strong limitations, etc., to achieve the effect of reducing system redundancy, improving efficiency, and reducing the risk of manual errors

Active Publication Date: 2021-04-06
上海微亿智造科技有限公司 +1
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the above solutions have strong limitations, and the flexibility and scalability are not high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for automatically creating and writing mq data by olap

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0051] Specific embodiments provided according to the present invention are as follows:

[0052] SELECT

[0053] toFloat64OrZero(planPutNum)AS planPutNum,

[0054] toFloat64OrZero(actualPutNum)AS actualPutNum,

[0055] (actualPutNum / planPutNum)AS prodPlanAchieveRate,

[0056] FROM OLAP_M

[0057] WHERE customerId = 'XXX';

[0058] In the example, the toFloat64OrZero function is used to change the original data type of the planPutNum field in the OLAP_M table to a Float64 type, the value of the prodPlanAchieveRate field is calculated by the actualPutNum and planPutNum field values, and the WHERE is used to filter the composite customerId='XXX' data.

[0059] Step A5: Automatically create an OLAP_Distributed table according to the OLAP_MQ table information in Step A3. Specifically, according to the information of the OLAP_Entity table, the OLAP cluster information creates a distributed mapping table of OLAP_Entity by splicing the table sql.

[0060] The data ETL step includ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and system for automatically creating and writing MQ data by OLAP, including an automatic table building step: automatically creating multiple OLAP data tables according to the MQ data structure; and a data ETL step: automatically consuming MQ data to the OLAP data table. The present invention automatically builds tables by analyzing the data fields and information characteristics in the data structure in MQ, reduces the redundant and tedious operations of manually building tables, improves work efficiency, and reduces the risk of manual errors in manually building tables; The OLAP_MQ table and OLAP_View table directly obtain data from MQ, reducing ETL intermediate links, reducing system redundancy, and improving system robustness. The OLAP_View table can be flexibly adjusted according to business requirements, which improves the flexibility and scalability of the system; the invention improves the scalability of the system and fully utilizes the computing power of each node to improve OLAP efficiency.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a method and system for automatically creating and writing MQ data by OLAP. Background technique [0002] The traditional data structure processing adopts the method of manual table building. Manual table building has the problems of redundant and cumbersome operations, low work efficiency, and high risk of manual errors. [0003] The patent document is the invention patent of CN103631911B, which discloses an OLAP query processing method based on array storage and vector processing. In this method, the primary-foreign key is mapped to the array subscript according to the referential integrity constraint in the data warehouse schema, so that the primary key of the dimension table and the foreign key of the fact table are directly mapped to the subscript address of the array, and the complex schema is converted into a Virtualized materialized tables to provide a unified data access ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/25
CPCG06F16/2282G06F16/254
Inventor 金熙李强
Owner 上海微亿智造科技有限公司