A data integration processing method and device for multiple data sources

A multi-data source, data integration technology, applied in the direction of electrical digital data processing, special data processing applications, network data retrieval, etc., can solve the problems of increasing the difficulty of development and maintenance, affecting the efficiency of data integration processing, etc., to achieve hot deployment , improve efficiency, and the effect of high-efficiency scalability

Active Publication Date: 2017-10-24
TAOBAO CHINA SOFTWARE
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] Since the above-mentioned method flow is oriented to a specific business scenario, if the business scenario changes, the computer program code corresponding to steps 1-4 needs to be modified and republished after the modification is completed; and, with the increase of application scenarios, only The data integration processing of multiple data sources can be realized by redeveloping the computer program code. Therefore, the data integration processing method based on multiple data sources in the prior art increases the difficulty of development and maintenance, and seriously affects the efficiency of data integration processing.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data integration processing method and device for multiple data sources
  • A data integration processing method and device for multiple data sources
  • A data integration processing method and device for multiple data sources

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0054] Example 1: The business scenario in an e-commerce website is to perform integrated calculations on some data items, and these data items come from different business systems within the website, including security systems, search systems, advertising systems, penalty systems, marketing systems, etc. Wait. The security system of the e-commerce website will record the information of certain abnormal accounts (including buyer accounts and seller accounts). It is documented in the security system. In addition, the punishment system of the e-commerce website will also record the punishment information of some accounts. The current business requirement is that, based on the P4P (Pay for performance) subsystem in the advertising system, advertisers are not based on the time of advertising, but on the actual effect brought about by the advertising, that is, the actual number of users. The payment function improves the security of the P4P subsystem and prevents accounts with ba...

example 2

[0055] Example 2: The search system of an e-commerce website will record user behavior information, including buyer account and corresponding clicked product information, buyer account and corresponding purchased product information, etc. In addition, the advertising system of the e-commerce website will also record the behavior information of the user, including the buyer's account number, the information of clicking on the advertisement, and the corresponding product information. The current business requirement is that the marketing system wants to recommend products according to the personalized needs of users. The corresponding business scenario is to obtain corresponding data items from the search system and advertising system in the process of obtaining marketing recommendation objects, and perform corresponding Data integration processing, in this business scenario, the information of the target data item may include: user behavior information in the search system, and ...

example 3

[0056] Example 3: An e-commerce website includes a user evaluation system and a product search system. The current business scenario is to lower the ranking weight of the products of users with more negative reviews in the user evaluation system in the product search system. In this business scenario, the information of the target data item may include users whose evaluation scores are lower than a certain threshold in the user evaluation system (bad review users), and the product information corresponding to the bad review users in the product search system and the corresponding ranking Weight (determines the sorting position when searching for products).

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-data-source data integrated processing method and device. the method comprises obtaining information of target data items required by current data integrated processing; extracting corresponding data items from corresponding multiple data sources respectively based on the data item and data source mapping relation and according to the information of the target data items to form the target data items; performing corresponding integrated calculation on the target data items according to preset target data item integrated calculation rules. By means of the method and the device, data integrated processing development and maintenance difficulties of the multiple data sources can be reduced, and the multi-data-source data integrated processing efficiency can be improved.

Description

technical field [0001] The present application relates to the technical field of network application systems, in particular to a multi-data source data integration processing method, and a multi-data source data integration device. Background technique [0002] At present, with the rapid development of the Internet, the network application system presents the characteristics of high complexity. The function realization of a single system no longer depends only on one data source. With the widespread application of distributed ideas in the Internet field, network application systems can support different data sources, such as remote services of network application systems, direct database reading, and data warehouses. and other data sources. [0003] Application scenarios corresponding to multiple data sources emerge. A typical application scenario is: the specific value of a certain data item (target data item) depends on the mutual integrated calculation of other N (N>1...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30H04L29/08
CPCG06F16/986
Inventor 庄卓然张俊王蒙
Owner TAOBAO CHINA SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products