Supercharge Your Innovation With Domain-Expert AI Agents!

File storage method and system based on mongodb distributed cluster architecture

A distributed cluster and file storage technology, applied in the field of database management and application, can solve the problem of no file storage solution, and achieve the effects of high access volume, large concurrency support, and high maintainability

Active Publication Date: 2021-03-26
AEROSPACE INFORMATION
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Currently existing file storage solutions, such as GFS, HDFS, Luster, Ceph, mogileFS, TFS, FastDFS, Hadoop, Hive, etc., can only be deployed in EXT2, EXT3 and other file systems of the Liunx system, while FAT and NTFS of Windows are almost No storage solution for massive files

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File storage method and system based on mongodb distributed cluster architecture
  • File storage method and system based on mongodb distributed cluster architecture
  • File storage method and system based on mongodb distributed cluster architecture

Examples

Experimental program
Comparison scheme
Effect test

no. 1 approach

[0041] The file storage method based on the MongoDB distributed cluster architecture of this embodiment, combined with figure 1 Be explained. figure 1 It is a schematic flow chart of the file storage method based on the MongoDB distributed cluster architecture according to the first embodiment of the present invention. Such as figure 1 As shown, the file storage method based on the MongoDB distributed cluster architecture of the present embodiment includes the following steps:

[0042] Step S1, check whether there is a stored file identical to the file to be stored in the MongoDB distributed cluster architecture; if it exists, execute step S2; if not, execute step S3.

[0043] In this step, check whether there is a stored file identical to the file to be stored in the MongoDB distributed cluster architecture, further including:

[0044] Obtain the FileKey of the file to be stored, check whether there is the same FileKey in the MongoDB distributed cluster architecture; if it...

no. 2 approach

[0069] image 3 It is an architecture diagram of a file storage system based on the MongoB distributed cluster architecture according to the second embodiment of the present invention. Such as image 3 As shown, the file storage system of this embodiment provides a unified client program access interface through HTTP, TCP, and SSL, and the backup strategy and security authentication mechanism therein belong to the prior art and will not be repeated here. The file storage module is the main body of the distributed cluster architecture, including MD5, SHA1 summary module, storage logic and strategy module, interface encapsulation module and MongoDB module. It should be noted that the division of modules here is based on the entire file storage system architecture, each of which can constitute a small independent subsystem, which is at a different level from the specific implementation modules in the second embodiment. Combine below Figure 4 , this embodiment will be specific...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a document storage method and a document storage system based on a MongoDB distributed cluster architecture. The method comprises the steps of firstly checking whether a stored document which is the same as a to-be-stored document exists in the MongoDB distributed cluster architecture; if so, associating the stored document with the to-be-stored document; if not, judging the size of the to-be-stored document; when the to-be-stored document is greater than or equal to a preset value, storing the to-be-stored document in a GridFS; when the to-be-stored document is smaller than the preset value, converting the to-be-stored document into a BJSON format and storing the to-be-stored document in a Document. The document storage method and the document storage system fully display the advantages of the MongoDB distributed cluster architecture, a small document and a large document are differently read and written, the method and the system have the advantages of NoSQL, low cost, high performance and high maintainability and support high visits and high concurrence, and thus the operation cost is reduced and the efficiency is improved.

Description

technical field [0001] The invention belongs to the field of database management and application, and in particular relates to a file storage method and system based on a MongoDB distributed cluster architecture. Background technique [0002] With the advent of the era of big data, massive files make the storage requirements are increasing. Alibaba’s statistics in 2010 are as follows: “Taobao’s overall picture storage system has a capacity of 1800TB (1.8PB), and has already occupied 990TB (about 1PB). The number of saved picture files has reached more than 28.6 billion.” The number of files currently used for commercial purposes , The amount of storage space occupied and the amount of visits have greatly exceeded the range that a single server can bear, so alternatives to distributed cluster architectures are becoming more and more popular. [0003] Currently existing file storage solutions, such as GFS, HDFS, Luster, Ceph, mogileFS, TFS, FastDFS, Hadoop, Hive, etc., can on...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/13G06F16/182
CPCG06F16/13G06F16/182
Inventor 冯尔斌朱兴张学军
Owner AEROSPACE INFORMATION
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com