Data transmission method and device, electronic equipment and computer readable storage medium

A data transmission method and technology of electronic equipment, applied in the direction of computing, relational database, database model, etc., to prevent excessive memory usage, improve user experience, and improve data transmission efficiency

Pending Publication Date: 2022-02-25
阳光保险集团股份有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present application provides a data transmission method, device, electronic equipment and computer-readable storage medium to solve the problem that the Sqoop tool in the prior art cannot realize data transmission between the distributed database and the Hadoop ecosystem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method and device, electronic equipment and computer readable storage medium
  • Data transmission method and device, electronic equipment and computer readable storage medium
  • Data transmission method and device, electronic equipment and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0049] In one embodiment, after the Sqoop tool establishes a connection with the target distributed database, when the Sqoop tool detects that the connection with the target distributed database is disconnected, if the disconnection time reaches the first preset threshold, the Sqoop tool will reconnect with the target distributed database. to establish a connection to the database. The process of establishing a connection between the Sqoop tool and the distributed database is the same as the connection method recorded in S300, which is a brief description and will not be repeated here.

[0050] Wherein, the above-mentioned first preset threshold can be 1 millisecond, 2 milliseconds, 3 milliseconds... 1 second, 2 seconds, 3 seconds, n seconds, etc., n is a real number greater than 0, and the specific value of the first threshold can be determined according to the actual Requirements setting, no limitation here.

[0051] Among them, after the Sqoop tool establishes a connection...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data transmission method and device, electronic equipment and a computer readable storage medium, and belongs to the technical field of computers. The method comprises the steps of obtaining and analyzing a database connection character string input by a user, and obtaining connection parameters contained in the connection character string; determining the type of a target distributed database needing to be connected according to the connection parameters; calling a corresponding target driving class according to the target distributed database type, and establishing connection with the target distributed database; and acquiring target data from the target distributed database, mapping the data type of the target data into a Java data type corresponding to the data type of the target distributed database, performing serialization processing, and writing the serialized target data into the Hadoop database. And connection with the target distributed database is realized by calling the target drive class corresponding to the target distributed database type, thereby realizing writing of the data in the target distributed database into the Hadoop database.

Description

technical field [0001] The present application relates to the technical field of computers, and in particular, to a data transmission method, device, electronic equipment, and computer-readable storage medium. Background technique [0002] With the implementation of Xinchuang Project in the financial industry, more and more financial companies have begun to use domestic databases to replace traditional databases such as oracle and mysql, among which domestic distributed databases (oceanbase, tdsql, kingwow, etc.) are more and more widely used in core business system. [0003] The Sqoop tool is an open source tool for transferring data between the Hadoop ecosystem and relational databases. The Sqoop tool supports traditional databases such as oracle and mysql very well, but the Sqoop tool cannot be used between the domestic distributed database and the Hadoop ecosystem. data transfer between. Contents of the invention [0004] The present application provides a data trans...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458G06F16/27G06F16/28
CPCG06F16/2471G06F16/27G06F16/284
Inventor 李胜军王卓尹琛金龙孙杨陈炳印李冰曾岸林邵长宏范文祥周鹏辉
Owner 阳光保险集团股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap