Unlock instant, AI-driven research and patent intelligence for your innovation.

File processing method and server, and computer readable storage medium

A file processing and processor technology, applied in computing, digital data processing, special data processing applications, etc., can solve the problems of storage space waste, storage space fragmentation, etc., to save storage space, reduce the number of files, and reduce time consumption Effect

Active Publication Date: 2017-11-10
COMP NETWORK INFORMATION CENT CHINESE ACADEMY OF SCI
View PDF11 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] What the present invention aims to solve is the problem of waste of storage space caused by the generation of storage space fragments in the existing file transfer operation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File processing method and server, and computer readable storage medium
  • File processing method and server, and computer readable storage medium
  • File processing method and server, and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0035] The embodiment of the present invention provides a file processing method, such as image 3 As shown, the method includes the following steps:

[0036] S1. Obtain a file to be transferred. The file to be transferred may be a file generated when a data source writes data to a target file. combine Figure 4 As shown, for example, the real-time data source continuously sends HDFS files to the n Write real-time analysis results. When the set transition time threshold is reached, s n Needs to be transfe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a file processing method and server and a computer readable storage medium. The file processing method comprises the following steps: obtain a file to be transferred; judging whether the size of a current preset file exceeds a predetermined threshold or not; and writing the file to be transferred to the tail of the current preset file if the size of the current preset file does not exceed the predetermined threshold. According to the file processing method and server and the computer readable storage medium provided by the invention, when the file to be transferred is obtained, firstly judge whether the size of the preset file used for storing the file to be transferred exceeds the predetermined threshold or not; and if the size of the preset file does not exceed the predetermined threshold, the file to be transferred is not stored in addition directly; on the contrary, the file to be transferred is written to the tail of the current preset file as a combined storage operation. The invention can effectively reduce the number of small files, so as to save the storage space.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a file processing method, a server and a computer-readable storage medium. Background technique [0002] At present, a file system that connects multiple nodes through a computer network for data storage, that is, a distributed file system (Distributed File System, DFS), effectively solves the problem that the physical storage resources managed by the file system are limited by local node storage. A question of space size. Using distributed file system management, DFS can greatly solve the problem of storage space expansion. Hadoop Distributed File System (HDFS for short) is a distributed file system that can run on general-purpose hardware devices. It has many similarities with existing distributed file systems. Compared with other distributed file systems, HDFS is a highly fault-tolerant system suitable for deployment on cheap hardware devices. At the same time, HDFS can provide...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/148G06F16/1724G06F16/182
Inventor 王绍节龙春万巍赵静宋丹劼
Owner COMP NETWORK INFORMATION CENT CHINESE ACADEMY OF SCI