System, apparatus, and method for integrating data spanning data sources

A data integration and cross-data source technology, which is applied in the field of cross-data source data integration systems, can solve problems such as performance degradation, user traffic consumption, and large-scale calculations that cannot be applied, and achieve the effect of improving collection and reducing traffic costs

Active Publication Date: 2014-03-26
BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
View PDF4 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] 1. Sometimes developers only need one or several fields in a set of data returned by an interface, and the return of a large amount of data will cause user traffic consumption and slow down;
[0004] 2. Sometimes you need to process and calculate the data yourself

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System, apparatus, and method for integrating data spanning data sources
  • System, apparatus, and method for integrating data spanning data sources
  • System, apparatus, and method for integrating data spanning data sources

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] In this embodiment, after receiving the data message, the server 102 selects the api of the open service platform 103 of user relationship such as SNS (Social Network Site, social networking site) according to the action field user, and converts the id into the token and query corresponding to each platform parameter, assemble and integrate the result of the data request according to the semantics, and return it to the client 101, as follows:

[0055] The data request url is: http: / / api.baidu.com / user?id=123

[0056] A platform api returns:

[0057]

[0058]

[0059] B platform api returns:

[0060]

[0061] Merge result:

[0062]

[0063] In carrying out the merging process described above, the following rules apply:

[0064] 1. Field name merging rules:

[0065] For uname and name automatically, according to the general analysis rules, they are merged into name, and the fields are merged (merged) into name.

[0066] 2. Field content merging rules:

...

Embodiment 2

[0074] This embodiment is a modification of Embodiment 1. The user needs to query the store name and phone number, so the return field can be defined as: return={name, phone}, which means that the client needs to return the name field and phone field. At this time, the data request url becomes for:

[0075] http: / / api.baidu.com / user?id=123&return={name,phone}

[0076] Then the return value becomes:

[0077]

[0078] The extend field is used to indicate the returned field that needs to be calculated. The extend field can be a string in json format.

[0079] You can add extend to the data request to ask the server to perform calculations. The calculation types include general four arithmetic operations, and also support sort! , =, >, < and other common operators and rules, and can be expanded.

Embodiment 3

[0081] When a user requests a merchant list, the url of the default data request is:

[0082] http: / / api.baidu.com / shops?p=1&pn=2 (where p is the start page, pn is the number of pages per page), when requesting, according to the action field shops, the system selects Dianping, Baidu Such as the API of the life consumption platform, generate token and query parameters corresponding to each platform, obtain the result of the data request, and return the result to the client according to the semantic assembly and integration of the data (the assembly and integration process is the same as the previous The user in the example is the same):

[0083] The platform returns:

[0084]

[0085] When you need to obtain a field that the user wants, you can support obtaining a field that can return the sum of the number of favorite stores and the number of visits to this store. At this time, you can define an extension field extend={allCount:[collectCount,+,bennToCount] }, at this point...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a system for integrating data spanning data sources. The system for integrating data spanning data sources comprises a client, a server, and multiple open service platforms. The client is used for transmitting a data request message to a server. The server is used for analyzing an operation segment in the data request message in order to generate a data acquisition instruction, selecting at least part of the open service platforms from the multiple open service platforms according to the data acquisition instruction, acquiring data according to user identity information, and summarizing and integrating the data in order to provide the data for the client and the multiple open service platforms. Each of the multiple open service platforms is used for providing data. The invention also provides a server, a client, and a data-integrating method spanning data sources. The system for integrating data spanning data sources carries out a large number of calculation tasks such as ordering, comparison, and assembly by using the powerful calculated performance of a cloud server, achieves merging and integrating of data from different data platform sources, increases data query efficiency, and decreases user flow expense.

Description

technical field [0001] The invention relates to the technical field of Internet cloud service platforms, in particular to a data integration system, server, client and method across data sources. Background technique [0002] With the development of the Internet, the application of cloud service platforms is becoming more and more popular. At present, the open API interface (Application Programming Interface, application programming interface) of the cloud service platform is generally designed in the Rest style, and returns a set of data according to a URL (Uniform / Universal Resource Locator, Uniform Resource Locator) requested by the user. , the returned data is predefined by the system and cannot be changed. 3 questions arise from this: [0003] 1. Sometimes developers only need one or several fields in a set of data returned by an interface, and the return of a large amount of data will cause user traffic consumption and slow down; [0004] 2. After the data is retrie...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/06
Inventor 劳勇
Owner BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap