Massive data storage method used for sewage treatment industry

A mass data and sewage treatment technology, applied in the database field, achieves strong scalability, high reliability, and good performance

Active Publication Date: 2018-03-06
HEFEI CITY COULD DATA CENT
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the defect that it is difficult to efficiently access massive data in the prior art, and to provide a massive data storage method for the sewage treatment industry to solve the above problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Massive data storage method used for sewage treatment industry
  • Massive data storage method used for sewage treatment industry
  • Massive data storage method used for sewage treatment industry

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In order to have a further understanding and understanding of the structural features of the present invention and the achieved effects, the preferred embodiments and accompanying drawings are used for a detailed description, as follows:

[0052] Such as figure 1 As shown, a kind of massive data storage method for sewage treatment industry described in the present invention comprises the following steps:

[0053] The first step is to collect data and obtain the measurement point data of intelligent terminals at all levels of the sewage treatment plant to be stored in the database.

[0054] In the system based on the NoSQL database to realize the instant storage of massive information, the problems faced mainly include the efficiency of data reading and writing operations and the expansion of data storage capacity. In the existing related research work, the problem of data storage expansion is mainly solved by data fragmentation storage and "hot and cold" data partition...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a massive data storage method used for a sewage treatment industry. Compared with the prior art, the defect of difficulty in performing efficient storage for massive data is overcome. The method comprises the following steps of collecting data, and obtaining measurement point data of an intelligent terminal of each stage of a sewage treatment plant; arranging distributed cache data nodes and pre-storing the measurement point data; performing partition storage of a database; performing optimization processing of Key information; and storing the measurement point data. Adistributed cache expansion scheme is proposed; the data is partitioned and quickly located through a corresponding method; and in combination with signal collection characteristics of a collection system in the sewage industry, a generation mechanism of Key and Value is optimized according to a time rule, and a set of complete distributed dynamically expandable cache processing method is established.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a massive data storage method used in the sewage treatment industry. Background technique [0002] In the context of urbanization, the government has been committed to improving the rate of sewage data collection and treatment. Taking a certain project as an example, all kinds of sewage measuring point data are collected in real time from smart terminals at all levels. The data collection operations of various measuring points include 5 minutes, 1 minute and 50 milliseconds collection according to the collection frequency, and also include meeting the on-site real-time collection . According to calculations, the real-time data can reach 200,000 pieces of data per second, and the average daily data collection volume can reach more than 35GB. With the further application of intelligent acquisition equipment, the data acquisition system has entered the era of big data. The syste...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F3/06H04L29/08
CPCG06F3/0614G06F3/0644G06F3/067G06F16/2255G06F16/2282H04L67/1097
Inventor 潘勇胜刘胜军李晓洁谢飞孟虎范寅孙浪
Owner HEFEI CITY COULD DATA CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap