Data transmission method between data sources

A data transmission method and data source technology, applied in structured data retrieval, database management systems, special data processing applications, etc., can solve the problems of cumbersome testing and time-consuming, and achieve the effect of simplifying and reforming application codes

Inactive Publication Date: 2019-10-15
石化盈科信息技术有限责任公司
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method requires a lot of labor to write code, and the test is also very cumbersome and takes a lot of time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method between data sources
  • Data transmission method between data sources
  • Data transmission method between data sources

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] figure 1 It is a flowchart of a data transmission method between data sources provided by the present invention, combined below figure 1 Describe each step in detail. Such as figure 1 As shown, the method mainly includes the following steps:

[0044] S1: Configure the connection parameter information of the data output end and the connection parameter information of the target end through the configuration management interface, and save the connection parameter information.

[0045] In this step, configure the data source of the data output end and the target end of the data output task to be performed through the management interface of the typical architecture. The types of the data output end and the target end include database, data warehouse, network service (WebService) and / or message queue and other types of data sources. When the data source is a database, the connection parameter information of the configuration data output terminal includes: the type of th...

Embodiment 2

[0060] An example is used to illustrate the application of the present invention in practice. Compared with the example in the prior art that e-commerce member A freezes membership on the payment platform, if data transmission is realized through the method provided by the present invention, the user only needs to configure the page to realize it. The payment platform is divided into multiple system applications such as member center and account center. The page configuration scheme is as follows:

[0061] 1) Data source configuration: Configure the connection parameter information of member center database D1 and account center database D2, including link information such as type, URL, user name, password, port, etc., and save it. At the same time, the interface C of the application program interface (Application Program Interface, API) center is also saved to the interface of the data source—the member center database D1 and the account center database D2.

[0062] 2) Select...

Embodiment 3

[0065] Figure 4 It is a schematic diagram of the system structure of the embodiment of the present invention. The invention also provides a data transmission system between data sources. Such as Figure 4 As shown, the system includes a data output terminal 1, a data extraction module 2 and an output terminal 3. In this embodiment, the data output terminal 1 includes: an application terminal (Application, APP), a database (Database, DB), a message queue (Message Queue, MQ), and an interface (Application Program Interface, API). The data extraction module 2 includes a data access module and an extraction node module (Function Collection Service, FCS). Target 3 includes data DB, API, MQ and APP.

[0066] First, configure the connection parameter information of the data output terminal 1 and the connection parameter information of the target terminal 3 through the configuration management interface, and save the connection parameter information. In this embodiment, the data...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data transmission method between data sources, which comprises the following steps: S1, configuring connection parameter information of a data output end and connection parameter information of a target end through a configuration management interface, and storing the connection parameter information; S2, selecting a data output end according to the stored connection parameter information, and configuring a data extraction condition of the data output end; S3, allocating the data output end to the selected target end according to the stored connection parameter information, and setting a data loading condition of the target end; and S4, acquiring to-be-synchronized data of the data output end according to the data extraction condition and the data loading condition, and loading the to-be-synchronized data into the target end. The data sources of the data output end and the target end of the data output task to be carried out are configured through the management interface of the typical architecture, data filtering is carried out through multiple data extraction conditions, and the data synchronization and migration functions among the multiple data sourcescan be achieved in any environment.

Description

technical field [0001] The invention relates to data transmission service technology, in particular to a data transmission method between data sources. Background technique [0002] Due to the increasing number of Internet developments, various platforms are striving to build an open cloud architecture, and cloud services are becoming more and more abundant. At the same time, the demand for migrating traditional applications to private clouds is also increasing. Therefore, the data transmission service between different data sources needs to be improved and enhanced. In the existing technology, each transmission service can only provide one-sided functions. Existing products can only provide fixed target data sources, or can only perform data transmission on their own cloud service platform. , there are technical difficulties. The existing technology can only perform data filtering, data extraction, and data loading through complicated code logic. [0003] For example, fo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/25
CPCG06F16/258G06F16/27
Inventor 严龙云卞晓莹张奎赖秋朱奎帅
Owner 石化盈科信息技术有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap