Unlock instant, AI-driven research and patent intelligence for your innovation.

Salt-based massive mongodb slow log management system

A management system and log technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of low automation, inability to view historical information, high maintenance costs, etc., to improve performance tuning effect and visualization effect Good, low maintenance effect

Active Publication Date: 2018-05-01
杭州铭师堂数字科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] (1) High maintenance cost: more manual maintenance of mongodb log management work is required, and the efficiency is low
[0005] (2) The function is simple: the mongodb slow log cannot be parsed and displayed, and the historical information cannot be viewed
[0006] (3) Lack of automation: the degree of automation is low and a large amount of human operation is required

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Salt-based massive mongodb slow log management system
  • Salt-based massive mongodb slow log management system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] figure 1 It is the overall architecture diagram of the massive mongodb slow log management system based on salt in the present invention. Overall, it includes four parts: salt management terminal, mongodb node, distributed storage and slow log management platform. The salt management terminal first obtains the mongodb slow log meta information of all mongodb nodes, then collects and analyzes the slow logs, stores the slow log files and slow log analysis files in distributed storage, and displays the mongodb slow log analysis on the slow log management platform document content.

[0041] figure 2 It is a flow chart of each module of the present invention calling each other. First, the salt management module obtains mongodb service meta information on all mongodb nodes through the salt client, and registers it in the meta information management module; through the salt client, the slow log file is regularly cut, and the slow log collection module collects the slow log...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a massive mongodb slow log management system based on the salt. The system includes a salt management end, a mongodb node and a distributed type memory. The salt management end is used for registering and cancelling a salt client and sending a command to the salt client; the mongodb node is a server used for deploying mongodb service, and each mongodb node needs to deploy the salt client; the slat client receives a command of the salt management end, completes the corresponding operation and returns the result to the salt management end; the mongodb node includes a slow log management module; the distributed type memory is a distributed type file system used for storing a mass of small files and includes a slow log storage module. The system adopts the distributed type memory, and large-scale mongodb slow log storage can be supported; an automation mode is adopted for managing slow logs, and the maintenance cost is low; the mongodb slow logs are analyzed, a slow query low in efficiency can be easily seen, and the performance optimization effect is greatly improved. A platform mode is adopted to show the slow log analysis file, the result is more intuitive, and the visualization effect is better.

Description

technical field [0001] The invention belongs to the fields of slow log management and performance tuning of a mongodb database, and is mainly applied to massive storage and performance tuning scenarios in the Internet industry. Background technique [0002] With the vigorous development of the Internet industry, business needs for databases are more diverse. Among them, mongodb database, as a non-relational database, is more and more widely used in production environments. For large-scale mongodb clusters, managing massive slow logs is becoming more and more important. [0003] Disadvantages of existing management slow log systems: [0004] (1) High maintenance cost: It requires more manual maintenance of mongodb log management work, which is inefficient. [0005] (2) The function is simple: the mongodb slow log cannot be parsed and displayed, and the historical information cannot be viewed. [0006] (3) Lack of automation: the degree of automation is low and requires a l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/2471G06F16/27
Inventor 顾伟涛
Owner 杭州铭师堂数字科技有限公司