Small file storage method based on Hadoop distributed file system
A distributed file and small file technology, applied in the computer field, can solve the problem of low memory usage and storage access efficiency, and achieve the effect of satisfying low-latency access, reducing storage burden, and high efficiency
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Example Embodiment
[0042] The present invention will be further described below in conjunction with the drawings.
[0043] Reference figure 1 The specific implementation steps of the present invention are as follows:
[0044] Step 1. Add two services.
[0045] In addition to the Hadoop distributed file system HDFS, a new web server Websever is added to monitor file read and write requests, and a small file processing server is added to process small files: the system architecture of the present invention consists of the web server Websever, The small file processing server and the original HDFS system consist of three parts. The small file processing server mainly performs file merging, file mapping, and file prefetching operations on small files.
[0046] Step 2. Determine whether the file is a small file.
[0047] The web server Websever judges whether the monitored request file is a file smaller than 16M. If it is smaller than 16M, it is regarded as a small file and proceed to step 4; otherwise, it is...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.
© 2023 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap