Distributed file system and method for storing lots of small files
A technology for distributed files and massive small files, applied in file systems, file access structures, special data processing applications, etc., can solve the problem of low efficiency of massive small file storage, simplify IO access process, and reduce the number of reads and writes , Improve the effect of processing performance
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0048] The first embodiment provides a distributed file system, figure 1 It is a distributed file system provided by Embodiment 1 of the present invention. Such as figure 1 As shown, the system includes a client, a resource location module, and a data storage module,
[0049] The client is the user's operation portal, which is respectively connected to the resource locating module and the data storage module. The client is configured to send a small file upload request to the resource locating module and upload the small file to the data storage module.
[0050] The resource locating module includes at least one resource locator, the resource locator is configured to: process the small file upload request sent by the client, allocate the source node for the client, and designate a data storage node in the data storage server as the main server of the combined storage , The main server is configured to: allocate free storage units for small files and complete the combined storage ...
Embodiment 2
[0055] The second embodiment provides a method for storing a large number of small files based on the distributed file system in the first embodiment. The method includes the following steps: building a distributed file system, uploading small files, synchronization of source nodes, and synchronization of the main server. The steps are explained in detail.
[0056] (1) Establish a distributed file system
[0057] Specifically, a distributed file system of a component embodiment.
[0058] (2) Small file upload
[0059] The upload of small files includes steps 2.1 to 2.10, and steps 2.1 to 2.10 are described in detail below.
[0060] Step 2.1: When the user needs to upload a small file, the client initiates an upload request to the resource locator.
[0061] Step 2.2: The resource locator queries available data storage nodes as source nodes and designates the main server.
[0062] Step 2.3: The resource locator returns the IP and port information of the source node to the client.
[0063] S...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com