The method of big data queue stack operation based on mongodb

A stack operation and operation method technology, which is applied in the field of MongoDB-based big data queue stack operation, can solve the problems of not being able to provide large storage capacity and high concurrency, etc., and achieve the effect of solving data processing problems, convenient operation, and efficient storage

Active Publication Date: 2019-02-19
中科云(东莞)科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The technical problem solved by the present invention is to provide a method for efficient operation of a large data queue stack based on MongoDB, which can solve the large storage capacity and high concurrency queue stack that cannot be provided by general programming tools in some applications with large data volume and high concurrency. The problem of operation can be applied to high real-time scenarios such as real-time analysis of securities, concurrent electronic transactions with large data volumes, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • The method of big data queue stack operation based on mongodb

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] like figure 1 Shown, method implementation step of the present invention is as follows:

[0034] Step 1: Build an independent MongoDB or a cluster of multiple MongoDBs on the same server as the application or on another independent server for data access operations;

[0035] Step 2: By analyzing the business logic of high-concurrency and large-volume data access, extract the sort order characteristics of data storage and retrieval from the data that requires queue or stack operations, and configure the relevant characteristics on the system;

[0036] Step 3: According to the configured sort order feature, establish index support on MongoDB for fast data sorting query; if the sorting order is not specified, you can create an auto-increment feature for fast data sorting query;

[0037] Step 4: Through the program, implement the interface program similar to the operation of the queue stack, implement thread-safe methods such as PUSH, POP, and COUNT, receive data access co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of big data storage, particularly a high-efficiency processing method for queuing and stacking big data based on a MongoDB. According to the method, through utilization of high-efficiency storage and abundant search support, more types of index support and an Auto-Sharding function of the MongoDB, the MongoDB is taken as a high-efficiency data access space; related counter sequence features are configured; POP and PUSH methods for queuing or stacking are realized in an operation process; and the problem that the efficiency is low due to the fact that the space of an operation environment is insufficient and the maintenance of a new space is increased when a queuing or stacking operation is carried out on batch data in an application is solved. Through application of the method, when the high-concurrency and high-data volume application carries out the queuing or stacking operation, high-efficiency storage of the data is realized, the load is balanced, a data access operation is converted to the MongoDB, and the queuing and stacking operation efficiency of the high data volume is greatly improved.

Description

technical field [0001] The invention relates to the technical field of big data storage, in particular to a method for operating a MongoDB-based big data queue stack. Background technique [0002] With the development of computer software application business, there are more and more scenarios where applications use queue stacks, and the amount of data and concurrency of applications is also increasing; such as real-time analysis of securities data, real-time transaction analysis of e-commerce In other cases, a large amount of data storage is required in unit time. For the built-in programs provided by general programming tools, due to the limitation of the operating environment of the application, they cannot well meet the large data volume and high concurrency requests; resulting in a bottleneck in the operation of the application. Contents of the invention [0003] The technical problem solved by the present invention is to provide a method for efficient operation of a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F7/78
CPCG06F7/78
Inventor 郑锐韬李勇波孙傲冰季统凯
Owner 中科云(东莞)科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap