Big data uniform interface method and device, equipment and storage medium

An interface device, big data technology, applied in database management systems, relational databases, database models, etc., can solve the problems of export data timeout, database instability, affecting the use of other users, etc., to ensure the use demand and reduce the effect of impact.

Active Publication Date: 2018-08-03
CHINA PING AN LIFE INSURANCE CO LTD
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] When the amount of data exported by Sqoop is large, or the network is congested, it will cause the exported data to time out, the external system cannot obtain the desired data smoothly, and it will affect the database serving the external system, making the database unstable , affecting the use of other users
In addition, because the Sqoop tool can only be exported in batches, when the data source of big data changes, the data needs to be re-exported, and the external system cannot obtain updated data in time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data uniform interface method and device, equipment and storage medium
  • Big data uniform interface method and device, equipment and storage medium
  • Big data uniform interface method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0025] Please refer to figure 1 , which shows a flow chart of the big data unified interface method provided by the embodiment of the present invention.

[0026] The big data unified interface method includes the following steps:

[0027] Step S101, establishing different types of access interfaces connected with the big data source database in the service database.

[0028] Wherein, the service database refers to a general relational database, which is used to manage the metadata information of the big data source database. Preferably, the service database is a ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of application of big data, and provides a big data uniform interface method and device, equipment and a storage medium. The method comprises the following steps: establishing different types of access interfaces connected with a big data source database in a service database, acquiring external requests accessing the service database through an external interface system connected with the service database, and acquiring the access interfaces corresponding to the external requests according to the external request; acquiring access speed of a plurality of access interfaces when the plurality of access interfaces exist, and acquiring the access interfaces according to the access speed; and inputting the external requests into the access interfaces so thatthe external interface system accesses the big data source database through the access interfaces. According to the big data uniform interface method and device, the equipment and the storage medium provided by the invention, an external system can successfully acquire the data under various network environments, influence on a database of the service external system is reduced, and a use requirement of the external system is ensured.

Description

technical field [0001] The invention belongs to the field of big data application, and more specifically relates to a big data unified interface method, device, equipment and storage medium. Background technique [0002] At present, when the data source of big data needs to be used, it is exported from the data source of big data such as Hadoop to the service database through the Sqoop data export tool for use by external systems. Among them, Sqoop is a tool for data import and export between Hadoop and relational databases, and Hadoop is a distributed system infrastructure. [0003] When the amount of data exported by Sqoop is large, or the network is congested, it will cause the exported data to time out, the external system cannot obtain the desired data smoothly, and it will affect the database serving the external system, making the database unstable. , affecting the use of other users. In addition, because the Sqoop tool can only be exported in batches, when the data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/25G06F16/258G06F16/284
Inventor 许四平朱子虎戴珍
Owner CHINA PING AN LIFE INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap