Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

System and method for providing sorted data

A technology with ordered data and data, which is applied in the field of systems and methods for providing ordered data, and can solve problems such as complex implementation, performance degradation, and performance degradation

Active Publication Date: 2015-08-19
BEIJING JINGDONG 360 DEGREE E COMMERCE CO LTD
View PDF7 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The machine where the middleware is located has limited memory and cannot handle large amounts of data. If the data needs to be transferred to the disk, the implementation will be more complicated and the performance will be severely degraded. If the data needs to be aggregated to another machine, then It will increase network IO and also reduce performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for providing sorted data
  • System and method for providing sorted data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0012] According to an embodiment of the present invention, a system for providing ordered data is provided, including a data source part, a connection part, a sorting mechanism part and a client. Each data source provides locally ordered data to the sorting mechanism through the connection part, and after being processed by the sorting mechanism, finally provides globally ordered data on the client side.

[0013] Each data source in the data source section is, for example, a MySQL instance.

[0014] The connection part is used for managing and distributing the connection to each data source, so as to realize the pipeline for the sorting mechanism to access each data source, so that the sorting mechanism can obtain data from each data source.

[0015] The data obtained by the sorting mechanism from each data source is obtained in a prescribed order, that is, the data provided by each data source is locally ordered, for example, in an increasing order. Sorting agencies need to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention relates to a system and a method for providing sorted data. The system comprises: a client, configured to generate a query request with a sorting requirement, a plurality of data sources, a link part and a sorting mechanism, wherein each data source generates a sorting data record according to a corresponding sub query request and transmits the data record to a corresponding link; a link part, configured to manage and assign links to the data sources; a sorting mechanism, configured to process the data record of the partial sorting from the data sources via the corresponding links to provide the data record for overall sorting to the client. The sorting mechanism uses a limit mark of a buffer region corresponding to each link to control the use of a memory, and repeatedly performs heapsort on each link to complete the overall sorting of the data.

Description

technical field [0001] The present invention relates to systems and methods for obtaining ordered data from multiple data sources. Background technique [0002] With the continuous development of the Internet, the amount of data on the Internet is increasing rapidly. Traditional stand-alone databases have faced obvious bottlenecks in processing large-scale data. Major Internet companies have begun to study the implementation of distributed databases. There are two types of implementation schemes for distributed databases, one is the client-side solution, which introduces a new client to process data in pieces, and the other is the introduction of database middleware, which processes data in pieces by The middleware is completed, and the application only needs to access the database middleware. The entire access process is almost the same as accessing the native database. [0003] Among the solutions of database middleware, there are relatively many solutions for MySQL middl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/2471G06F16/27
Inventor 张成远田琪季锡强
Owner BEIJING JINGDONG 360 DEGREE E COMMERCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com