Unlock instant, AI-driven research and patent intelligence for your innovation.

A data warehouse data processing method, device, electronic device and storage medium

A data processing and data warehouse technology, applied in the field of data processing, can solve the problems of occupied links and low efficiency of data warehouse model processing tasks, so as to reduce the occupancy of links, maximize processing efficiency, and improve processing efficiency.

Active Publication Date: 2022-08-05
LIANLIAN HANGZHOU INFORMATION TECH
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The current data warehouse model generally repeatedly calls data from the same data source, or repeats the same data processing multiple times, and even multiple tasks repeatedly call data from a large number of data sources, resulting in low efficiency of data warehouse model processing tasks , occupying a large number of links

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data warehouse data processing method, device, electronic device and storage medium
  • A data warehouse data processing method, device, electronic device and storage medium
  • A data warehouse data processing method, device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiment is only one embodiment of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of this application.

[0033]Reference herein to an "embodiment" refers to a particular feature, structure, or characteristic that may be included in at least one implementation of the present application. In the description of the embodiments of the present application, it should be understood that the orientations or positional relationships indicated by the terms "upper", "lower", "left", "right", "top", "bottom", etc. are based on the drawings. The or...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the present application provide a data warehouse data processing method, device, electronic device, and storage medium. The method includes: receiving a task request; the task request carries a task identifier; parsing a target task based on the task identifier; the target task includes a current execution file; The execution file includes execution description information and data processing statements; based on the execution description information, the data to be processed is determined from the current data set; the current data set is determined based on multiple historical data sets; the data to be processed is processed according to the data processing statement to obtain the target data; Send target data. With the data processing method of the data warehouse according to the embodiment of the present application, data processing can be performed based on the optimized processing task, and the processing efficiency of the data warehouse task can be improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, and in particular, to a data processing method, device, system and storage medium of a data warehouse. Background technique [0002] With the advent of the era of big data, data is growing explosively. More and more businesses need to use big data capabilities for data analysis. Data warehouses have more and more tasks and more and more complex links. A large amount of redundant data is stored in the data warehouse, and data processing tasks often need to call a large amount of data. As the data processing business needs become larger and larger, the demand for the data processing efficiency of the data warehouse is also gradually increasing. [0003] Current data warehouse models generally call data repeatedly from the same data source, or process the same data multiple times, and even multiple tasks call data multiple times from a large number of data sources, resulting in low e...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/21G06F16/28
CPCG06F16/217G06F16/283
Inventor 林晶晶甘红伟
Owner LIANLIAN HANGZHOU INFORMATION TECH