Application report form realization method and application report form realization equipment based on Hadoop platform and storage medium

A technique for implementing methods and reports, applied in the database field

Active Publication Date: 2018-04-13
WEBANK (CHINA)
View PDF10 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the present invention is to provide a Hadoop platform-based application report implementation method, equipment and computer-readable ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Application report form realization method and application report form realization equipment based on Hadoop platform and storage medium
  • Application report form realization method and application report form realization equipment based on Hadoop platform and storage medium
  • Application report form realization method and application report form realization equipment based on Hadoop platform and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0031] Such as figure 1 as shown, figure 1 It is a schematic structural diagram of the device hardware operating environment involved in the solution of the embodiment of the present invention.

[0032] The device for implementing the application report in the embodiment of the present invention may be a PC, a server, or a tablet computer, a portable computer, or the like.

[0033] Such as figure 1 As shown, the device for implementing application reports may include: a processor 1001 , such as a CPU, a communication bus 1002 , a user interface 1003 , a network interface 1004 , and a memory 1005 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an application report form realization method based on a Hadoop platform. The method includes: carrying out extraction and conversion processing on source data stored in an HDFS, then loading the data into a data form of a near-source layer of a data warehouse, and extracting data therefrom for data quality verification; if verification is successful, carrying out conversion processing on the extracted data, then loading the data into a data form of a model layer of the data warehouse, and then extracting data therefrom for data quality verification; if verification issuccessful, carrying out conversion processing on the extracted data, and then loading the data into a data form of an application layer of the data warehouse; and carrying out data quality verification on data in the data form of the application layer, if verification is successful, using the data form of the application layer as a to-be-reported application report form, and otherwise, issuing averification anomaly alarm. The invention also discloses application report form realization equipment based on the Hadoop platform and a computer-readable storage medium. According to the method, massive data submission can be realized under low-cost hardware resources, and high-data-quality submission requirements are satisfied.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a Hadoop platform-based application report realization method, device and computer-readable storage medium. Background technique [0002] In the field of database data processing, existing technical solutions usually rely on the performance of machines and database software itself to process data. At present, in order to cope with the timeliness and storage of massive data, domestic enterprises are constantly improving the configuration of mainframes / minicomputers / servers and expanding the shared storage capacity of high-end SANs. However, the scalability of the system is not strong, and the construction cost is high. [0003] Due to the huge amount of data processing, the performance of data verification is not good, and the data quality verification is carried out by relying on the constraints of traditional database structure, but there is no systematic data quality verifica...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/182G06F16/215G06F16/2282G06F16/27G06F16/283
Inventor 汪亚男李晶冼炳洪肖和兵李朝阳魏小胜王新玉夏佳周东
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap