Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A big data aggregation query method

A query method and big data technology, applied in the field of data query, to achieve the effect of improving query efficiency and accuracy

Pending Publication Date: 2019-06-04
BEIJING OPEN DISTANCE EDUCATION CENT
View PDF8 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present invention provides a big data aggregation query method, which can solve the cross-service and cross-database correlation query problem in the micro-service architecture, and improve the query efficiency of software on the education cloud platform

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A big data aggregation query method
  • A big data aggregation query method
  • A big data aggregation query method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to make the technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0039] figure 1 It is a flow chart of the big data aggregation query method in the embodiment of the present invention, figure 2 It is a schematic diagram of the deployment of the big data aggregation query method in the embodiment of the present invention. Such as figure 1 with figure 2 As shown, the big data aggregation query method in the embodiment of the present invention includes the following steps:

[0040] Step 11, adding an identification field in the source data table to be synchronized.

[0041] In this step, an identification field can be added in each source data table that needs to be synchronized as an identification of whether the verification data has changed.

[0042] For example, preferably, in a specific embodiment of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a big data aggregation query method. The method comprises the following steps: adding an identification field in a source data table needing to be synchronized; deploying a Logstash cluster as data synchronization middleware; Deploying an Elasticsearch cluster as a data storage system; Setting a data synchronization configuration file in the Logstash cluster; Setting an Elasticsearch index in an Elasticsearch cluster, and storing service information and service statistical data; And starting the Logstash cluster to synchronize the data. By applying the method and the system, the cross-service and cross-database association query problem in the micro-service architecture can be solved, and the query efficiency of software on an education cloud platform is improved.

Description

technical field [0001] The present application relates to the technical field of data query, in particular to a large data aggregation query method. Background technique [0002] At present, with the innovation and progress of computer technology and network technology, especially the progress of virtualization technology, as well as the innovation and development of new concepts and new solutions, especially the rapid development of Docker technology, it has laid the foundation for the launch of the online education cloud platform . [0003] In the existing technology, the education cloud platform generally adopts the microservice architecture. The microservice architecture solves some problems in the traditional layered architecture. Its core features are high scalability, easy development, testing, and deployment of independent service components. These service components are decoupled, distributed, and independent of each other. . [0004] However, when the microservi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/22G06F16/2455G06F16/23
CPCY02D10/00
Inventor 王雪松刘铁生王勇
Owner BEIJING OPEN DISTANCE EDUCATION CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com