Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device, equipment and storage medium

A data processing and data technology, applied in the computer field, can solve the problems of reducing data processing efficiency, high Flink development cost, and difficult data verification process, etc., and achieve the effect of low processing cost, improved efficiency, and simple processing process

Pending Publication Date: 2022-03-15
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the development cost of Flink, the real-time computing engine of the existing real-time data warehouse, is relatively high, and the data verification process is difficult
[0004] It can be seen from the above that in scenarios with a large amount of data query, or in scenarios such as real-time data query, calculation, and analysis, the existing data query methods cannot meet the requirements of the above scenarios, thereby reducing the efficiency of data processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, equipment and storage medium
  • Data processing method and device, equipment and storage medium
  • Data processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] In order to make those skilled in the art better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0063] It should be noted that the terms "first", "second" and the like in the description and claims of the present disclosure and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances such that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data processing method and device, equipment and a storage medium, relates to the technical field of computers, and can improve the data processing efficiency. The data processing method comprises the steps that to-be-processed data are acquired, the to-be-processed data comprise first-class data or second-class data, and the complexity of the second-class data is higher than that of the first-class data; if the to-be-processed data is the first type of data, writing the first type of data into a click stream data warehouse; and if the to-be-processed data is the second type of data, executing at least one processing operation on the second type of data, and writing detail data and result data obtained by each processing operation into the click stream data warehouse.

Description

technical field [0001] The present disclosure relates to the field of computer technologies, and in particular, to a data processing method, apparatus, device, and storage medium. Background technique [0002] In the era of big data, due to the continuous iterative update of data, users usually query the data stored in the system in the form of tables according to different needs. Through the query of massive data, it is convenient for users to make more wise business decisions . [0003] At present, data query includes offline data query and real-time data query. Offline data query is generally based on the Hadoop data warehouse system (Hadoop is a distributed system infrastructure developed by the Apache Foundation), and different businesses are queried through task scheduling of different hive (hive is a Hadoop-based data warehouse tool). data. However, the Hadoop data warehouse system is mostly used for data query on offline data. When the amount of data to be querie...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/28G06F16/245
CPCG06F16/283G06F16/245
Inventor 康全忠林业宁
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD