Access configuration system supporting multivariate heterogeneous type data

Abstract

The invention provides an access configuration system supporting multivariate heterogeneous type data, and the system comprises: a statistical module which is used for carrying out the multi-dimensional data statistics of accessed multi-source heterogeneous type data, and displaying a statistical result through a visual interface at intervals of preset time; a data source management module which is used for accessing a third-party data source, supporting a Restful API relational database, an ESB interface, WebService and Socket, and supporting user login verification; a source interface management module which is used for managing data interface access under a data source, configuring various data interfaces under the data source and supporting data encryption; and an interface managementmodule which is used for managing the output of the data interface and outputting the original data in various formats in a standardized manner according to the user-defined data items. According to the invention, a visual interface is provided, and the coding burden is saved; a unified interface of data is provided; cleaning rules can be customized on a visual interface, and personalized servicesare provided for users.

Description

technical field [0001] The invention relates to the technical field of big data processing, in particular to an access configuration system supporting multiple heterogeneous types of data. Background technique [0002] At present, the access to multiple heterogeneous data requires cross-departmental communication and coordination for testing and comparison, access, cleaning, and integration to subsequent applications, which is time-consuming, laborious, inefficient, and costly. [0003] And in the data cleaning stage, the current data cleaning needs to design the cleaning strategy first, and then realize the cleaning logic through code writing. This kind of data cleaning method is relatively cumbersome. [0004] Moreover, the interfaces may be subordinate to a functional module and are connected to each other, but the interfaces are independent from each other, so that the connection between the interfaces may not be close. Contents of the invention [0005] The aim of th...

AI Technical Summary

Problems solved by technology

[0002] At present, the access of multiple heterogeneous data needs to be tested, compared, accessed, cleaned, and the application after integration requires cross-departmental communication and coordination, which is time-consuming, laborious, inefficient, and costly.

[0003] And in the data cleaning stage, the current data cleaning needs to design the cleaning strategy first, and then realize the cleaning logic through code writing. This kind of data cleaning method is relatively cumbersome

[0004] Moreover, the interfaces may be subordinate to a functional module and are connected to each other, but the interfaces are independent from each other, which may cause the interface to be not closely related.

Images