Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A system and method for providing ordered data

A technology with ordered data and data, applied in the field of systems and methods for providing ordered data, and can solve problems such as performance degradation, performance degradation, and limited machine memory.

Active Publication Date: 2018-06-01
BEIJING JINGDONG 360 DEGREE E COMMERCE CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The machine where the middleware is located has limited memory and cannot handle large amounts of data. If the data needs to be transferred to the disk, the implementation will be more complicated and the performance will be severely degraded. If the data needs to be aggregated to another machine, then It will increase network IO and also reduce performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A system and method for providing ordered data
  • A system and method for providing ordered data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0012] According to an embodiment of the present invention, a system for providing ordered data is provided, including a data source part, a connection part, a sorting mechanism part and a client. Each data source provides local ordered data to the sorting mechanism through the connection part, and after being processed by the sorting mechanism, it finally provides global ordered data on the client.

[0013] Each data source in the data source part is, for example, a MySQL instance.

[0014] The connection part is used to manage and distribute the connection to each data source, so as to realize the access pipeline of each data source by the sorting mechanism, so that the sorting mechanism can obtain data from each data source.

[0015] The data obtained by the sorting agency from each data source is obtained in a specified order, that is, the data provided by each data source is locally ordered, for example, in increasing order. Sorting agencies need to globally sort data fr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention relates to a system and a method for providing sorted data. The system comprises: a client, configured to generate a query request with a sorting requirement, a plurality of data sources, a link part and a sorting mechanism, wherein each data source generates a sorting data record according to a corresponding sub query request and transmits the data record to a corresponding link; a link part, configured to manage and assign links to the data sources; a sorting mechanism, configured to process the data record of the partial sorting from the data sources via the corresponding links to provide the data record for overall sorting to the client. The sorting mechanism uses a limit mark of a buffer region corresponding to each link to control the use of a memory, and repeatedly performs heapsort on each link to complete the overall sorting of the data.

Description

technical field [0001] The present invention relates to systems and methods for obtaining ordered data from multiple data sources. Background technique [0002] With the continuous development of the Internet, the amount of data on the Internet is increasing rapidly. Traditional stand-alone databases have faced obvious bottlenecks in processing large-scale data. Major Internet companies have begun to study the implementation of distributed databases. There are two types of distributed database implementation schemes, one is the client solution, which introduces a new client to process data fragmentation, and the other is the introduction of database middleware, which processes data fragmentation by The middleware is completed, the application only needs to access the database middleware, and the whole access process is almost the same as accessing the original database. [0003] Among database middleware solutions, there are relatively many middleware solutions for MySQL. A...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/2471G06F16/27
Inventor 张成远田琪季锡强
Owner BEIJING JINGDONG 360 DEGREE E COMMERCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com