Application report implementation method, device and storage medium based on hadoop platform
An implementation method and report technology, applied in the database field, to achieve the effects of ensuring consistency, increasing data computing power and throughput, large scalability and elasticity
Active Publication Date: 2022-01-14
WEBANK (CHINA)
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] The main purpose of the present invention is to provide a Hadoop platform-based application report implementation method, equipment and computer-readable storage medium, aiming to solve how to realize the submission of massive data at low cost and meet the technology of high data quality reporting requirements question
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0030] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
[0031] Such as figure 1 as shown, figure 1 It is a schematic structural diagram of the device hardware operating environment involved in the solution of the embodiment of the present invention.
[0032] The device for implementing the application report in the embodiment of the present invention may be a PC, a server, or a tablet computer, a portable computer, or the like.
[0033] Such as figure 1 As shown, the device for implementing application reports may include: a processor 1001 , such as a CPU, a communication bus 1002 , a user interface 1003 , a network interface 1004 , and a memory 1005 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), a...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a method for implementing an application report based on a Hadoop platform, comprising: extracting and transforming source data stored in HDFS and loading it into the source layer data table of a data warehouse, and extracting data from it for data quality verification , if the verification is passed, the extracted data is converted and loaded into the model layer data table of the data warehouse, and then the data is extracted from it for data quality verification. If the verification is passed, the extracted data is converted and loaded Go to the application layer data table of the data warehouse; perform data quality verification on the data in the application layer data table. If the verification passes, the application layer data table will be used as the application report to be reported, otherwise a verification exception alarm will be issued. The invention also discloses a Hadoop platform-based application report realization device and a computer-readable storage medium. The invention can realize massive data submission under low-cost hardware resources, and can meet the requirement of high data quality submission.
Description
technical field [0001] The invention relates to the technical field of databases, in particular to a Hadoop platform-based application report realization method, device and computer-readable storage medium. Background technique [0002] In the field of database data processing, existing technical solutions usually rely on the performance of machines and database software itself to process data. At present, in order to cope with the timeliness and storage of massive data, domestic enterprises are constantly improving the configuration of mainframes / minicomputers / servers and expanding the shared storage capacity of high-end SANs. However, the scalability of the system is not strong, and the construction cost is high. [0003] Due to the huge amount of data processing, the performance of data verification is not good, and the data quality verification is carried out by relying on the constraints of traditional database structure, but there is no systematic data quality verifica...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/28G06F16/27G06F16/22G06F16/215
CPCG06F16/182G06F16/215G06F16/2282G06F16/27G06F16/283
Inventor 汪亚男李晶冼炳洪肖和兵李朝阳魏小胜王新玉夏佳周东
Owner WEBANK (CHINA)