75 results about "File system fragmentation" patented technology

A system and method for hybrid virtual machine monitor system is provided. A first operating system uses a file system to manage data storage and retrieval within a data storage area. A second operating system, which is not compatible with the first operating system's file system, executes a management application backup utility. The first operating system includes a filter driver that sends logical block addresses, which correspond to data reads/writes, to the management application backup utility. In turn, the management application backup utility uses the logical block addresses to perform operations on the data storage locations. In one embodiment, the management application backup utility performs actions on the data storage area, such as a disk defragmentation, and subsequently sends data location changes to the filter driver. In this embodiment, the filter driver instructs the first operating system's file system to update its translation tables based upon the data location changes.

The invention discloses a file encryption and decryption method based on cloud storage. The file encryption and decryption method comprises the following steps of starting file write to a cloud storage platform by an application terminal, and conducting fragmentation storing on a file by the cloud storage platform; conducting distributed encryption on the file which is stored in the cloud storage platform in a fragmentation mode by an encryption and decryption platform; conducting distributed decryption on the file which is stored in the cloud storage platform in the fragmentation mode by the encryption and decryption platform. The invention further provides a file encryption and decryption system based on the cloud storage. According to the technical scheme, repeated file fragmentation and aggregation processes are reduced, waste of computing capability is avoided, and meanwhile the processing speed of encryption and decryption is improved.

A defragmentation technique determines the extent to which data blocks of a file are fragmented on disks of a computer and, in response, efficiently relocates those blocks if such relocation improves the on-disk layout of the file. Each indirect block of the file is examined and the current layout of the range of pointers referencing the data blocks is determined. In addition, the number of operations needed to retrieve those data blocks from disks is calculated. A potential new layout is then estimated based on an average fullness of the file system. If the potential new layout improves the fragmentation of the current layout, then the data blocks for that range are relocated, if there is sufficient free space on disk. Otherwise, the blocks are not relocated and the current on-disk layout of the file is maintained.

The embodiment of the invention provides a disk defragmentation method, a disk defragmentation device and a host. The method comprises the following steps: judging the fragmentation degree of a first disk area according to a first space management object; if determining that the fragmentation degree of the first disk area reaches the preset fragmentation degree, writing a data block of each object corresponding to a defragmentation sub-area into a continuous disk space according to the first space management object, and writing metadata, which is generated when the data block of each object is written in the continuous disk space, in the continuous space, wherein the defragmentation sub-area is smaller or equal to the first disk area; and releasing the defragmentation sub-area. Visibly, a section of continuous idle space in the first disk area can be obtained after the defragmentation sub-area is subjected to disk defragmentation according to space management information; and thus, the disk defragmentation efficiency is increased.

A method and apparatus for queuing FBNs of received write blocks for a file to a queuing data structure for assigning LBNs to the FBNs is described herein. A queuing data structure may comprise a modified binary search tree, such as a modified red-black search tree. Each node of a queuing data structure may comprise a base field for storing a base FBN and a range field for storing a range value comprising X bits. The range field of a single node may represent a range of two or more FBNs (“FBN range”), the FBN range being based on the base FBN. Each FBN in the FBN range may have a corresponding bit in the range field, the base FBN corresponding to a “base bit” in the range field. The value of the corresponding bit in the range field may indicate whether the FBN has been received.

A data migration method and device for a distributed file system, and a metadata server. The data migration method for a distributed file system comprises: according to the number of accessed bytes of a file fragmentation and the size of the file fragmentation, making statistics about the access frequency of file fragmentation; and according to the access frequency of the file fragmentation, migrating the file fragmentation on storage devices of different performance. The method improves the utilization rate of space and performance for a storage device of a distributed file system.

The invention discloses a method for blocking and storing a stored file in a cloud storage system by adopting a dynamic adaptation method, and mainly aims to solve the problems of low space utilization rate and disk fragments caused by the use of a fixed block size in the prior art. The implementation scheme comprises the following steps of: setting a grouping factor vector by using the cloud storage system, obtaining the size and heat mark of a file when the file is to be stored, and when the size of the file is smaller than a minimum grouping factor, using the final size of the file; if the heat mark is 1, copying and storing the file, and on the contrary, directly storing the file on a single node; and when the size of the file is larger than the minimum grouping factor, comparing the size of the file with a grouping factor to obtain an optimal block size. Compared with the method using the fixed block size, the invention has higher file uniformity, can better solve a load balancing problem caused by hot files, and is particularly suitable for the cloud storage system.

The invention discloses a video recording file management method and device for easily preventing disk fragments from being generated. The method comprises the following steps that firstly, disk formatting is conducted on a video recorder, a disk is fixedly set to one subarea or multiple subareas, and different formatting methods provided by an operating system are applied to different file systems; secondly, a video recording file index database is established, and the video recording file retrieval service is provided; thirdly, the size of each video recording file is fixed and marked as A (Byte); fourthly, when the disk is not fully occupied, a general file establishment and write-in method is applied; fifthly, when the disk is fully occupied, the file which is established earliest on the disk is found out and used as a new video recording file, write-in is conducted from the start position of the file in a covering mode, and the step is repeated. The video recording file management method and device for easily preventing disk fragments from being generated have the advantages of being simple, easy to achieve and compatible with different file systems due to the fact that the management method and device capable of easily preventing the disk fragments from generating the video recording file are established on a general file system; the problems that after audio and video data are written in a hard disk recorder in a circulating mode for a long time, a great number of disk fragments are generated and the system operating efficiency is influenced are solved.

The embodiment of the invention discloses a disk data management method and a disk control device, which are used for efficiently managing a fragment on a disk. The disk data management method disclosed by the embodiment of the invention is applied to the disk control device that comprises a disk, wherein the disk comprises a data area and a log area. The method comprises the following steps: writing data in a buffer memory; judging whether the data is hot spot data, wherein the hot spot data, after stored in the disk, is the data that can make the disk generate fragments of which the number is preset after the preset number of times is amended and released; if the data is not the hot spot data, then allocating a data area space for the data in the data area, and writing the data into the data area space; if the data is hot spot data, then allocating a log area space for the data in the log area, and writing the data into the log area space. By storing different types of data at different areas in the disk and managing in different ways, the efficiency for managing the fragment on the disk can be improved, and the high-efficiency management for the disk fragment in the log area can reduce the generation of the disk fragment.

The invention discloses a disk fragment arranging method, a terminal and a computer readable storage medium. The method includes the steps of obtaining the data storage concentration degree of to-be-moved documents on a magnetic disk during current storage; selecting at least one unoccupied block in current unoccupied blocks of the magnetic disk to form at least one area where the documents are going to be stored, wherein the size of the areas where the documents are going to be stored is not smaller than the size of the to-be-moved documents; filling one of the areas where the documents are going to be stored with the to-be-moved documents when the to-be-moved documents are stored in the areas where the documents are going to be stored and the data storage concentration degree is higher than that of the to-be-moved documents stored in the current storage mode, thereby achieving automatic arranging of disk fragments. The disk fragmentation degree can be reduced through migration of theto-be-moved documents, the data storage concentration degree in the magnetic disk is increased, the increase of the disk fragments can be easily reduced, and the probability of getting stuck caused by the disk fragments is reduced.

The invention provides a file storage method and device to solve the problems of unreasonable file storage, easy fragmentation or overflow, and low file query efficiency. Wherein, the method includes: according to the size of the file uploaded by the received client, storing the content data of the file in at least one file storage block; obtaining the information of the file storage block storing the content data; generating and The metadata corresponding to the content data; store the metadata of the file in the preset storage space. The present invention can avoid disk fragmentation and overflow caused by directly storing all the content data of the file as a whole in the corresponding storage space, the storage method is more reasonable, and the metadata is stored independently, so that unified management of files can be realized Metadata, thereby improving the query efficiency of subsequent files.

The invention discloses a method for data deletion in batch in an ORACLE database, which has the following steps: A. a where condition for retention data is analyzed according to deletion conditions; B. an exp command is used for exporting retention data meeting the where condition in a compression way; C. the original table is cleared; and D. the retention data is exported back to the database. In step C, the original table is cleared in the way of a drop original table and a truncate original table, compression of high water line and recovery of database table space can be realized. The method deletes data in batch under the conditions of batch data, has high deletion efficiency, performs disk efragmentation in the data table, and completes the compression operation of the high water line in the process of data deletion in one step without any additional database operations.

The invention provides a method and a device for optimizing the disk space utilization ratio in digital television time shifting. During recording of time shifting programs, if the duration of the time shifting program recorded currently exceeds the set maximum time shifting time, and if the stream bit rate of a transport stream received currently is lower than the average stream bit rate, time shifting programs of which the recording time is longest are deleted to release redundant disk fragmentation, and the newly-recorded time shifting program covers time shifting programs of which the recording time is longest in current files. By the aid of the method and the device, the size of the disk space occupied by time shifting programs can be changed dynamically according to the requirements, so that the problem of the low disk space utilization ratio when the disk space is not sufficient can be solved.

The invention discloses an on-line fault tolerance method in a cluster data processing system. The method comprises the following steps that firstly, a last level processing node stores a processing result in a file fragmentation mode; secondly, a next level processing node reads a file fragmentation to continue to carry out processing; thirdly, a database is used for recording file fragmentation marks processed on all nodes; fourthly, when the node fault is detected, a new node is started to replace the fault node to work; fifthly, the new node reads the file fragmentation on the fault node from the database, and the fault field is recovered. The fault tolerance in the data processing process is achieved.

Disclosed is a method for preparing a disk drive of a computing system for test, including the steps of recording a plurality of test files to a partition of the disk drive until a free space of the partition is less than a predetermined value; and thereafter deleting a portion of the plurality of test files from the partition. A computer program product including a computer readable medium carrying a program for preparing a disk drive of a computing system for test, the computer program product having code for recording a plurality of test files to a partition of the disk drive until a free space of the partition is less than a predetermined value; and code for deleting a portion of the plurality of test files from the partition.

The invention provides a processing method of tile images. The processing method comprises the steps of obtaining the number of co-occurrence times of the first tile image and the second tile image according to historical request data and the first tile image; according to the number of co-occurrence times and a preset co-occurrence threshold value, combining the first tile image and the second tile image so as to obtain the third tile image; storing the third tile image; storing the first corresponding relation between the first tile image and the third tile image and the second corresponding relation between the second tile image and the third tile image. The invention further provides a processing system of the tile images. According to the processing method and system of the tile images, the disk fragmentization degree of a disk storing the tile images is lowered.

The invention relates to the technical field of data processing, and discloses a data compression method which includes the steps: firstly, writing data into a compression buffer memory; secondly, reading the data from the compression buffer memory by a compression engine in a fixed capacity manner; finally, compressing the read data by the compression engine. The invention further discloses a data compression device which comprises a data writing module, a data reading module and a data compression module, the data writing module is used for writing the data into the compression buffer memory, the data reading module is used for reading the data from the compression buffer memory by the compression engine in a fixed capacity manner; the data compression module is used for compressing the read data by the compression engine. The data compression method solves the problems that compressed data are written in the disk, disk fragmentations are generated in a disk, a lot of disk space is occupied, so that disk space is wasted in the prior art.

The present invention discloses a multi-path audio/video stream storage method for preventing disk fragments from formation. The multi-path audio/video stream storage method comprises the following main steps of: (1) establishing data files for storing audio/video streams; (2) distributing data files stored by the plurality of the audio/video streams, namely respectively setting a storage space needed by each path of the audio/video stream, automatically distributing the data files with the corresponding quantity according to the storage space needed by each path of the audio/video stream, and respectively establishing a data file index database table corresponding to each path of the audio/video stream and inserting the data file index database table into a record of the data file distributed by the data file index database table; and (3) storing the plurality of paths of audio/video streams, namely independently storing each path of audio/video stream by combining a database and updating a database record corresponding to the audio/video stream according to the requirements. The multi-path audio/video stream storage method for preventing the disk fragments from formation has the advantages that the disk fragments are not formed; the storage efficiency of the audio/video streams is not reduced along the increasing of time, and total recording time of each path of audio/video stream is accurately controlled; and a disk space occupied by the data file of each path of audio/video stream is continuous so that the accessing efficiency of the audio/video stream files is improved.

The invention provides image file management method and system, relating to the image storage technology and aiming at solving the defects of obtaining and displaying images slowly and easily generating disk fragments after an image is deleted in the prior art. The image file managing method comprises the storage steps of: receiving an image storage request, extracting attribute information of an image, finding useable storage positions in a corresponding storage region in a managing file and corresponding compression modes according to the image resolution; and compressing the image to the size corresponding to the compression mode according to the compression mode, then storing the compressed image to the useable storage position, generating a storage record according to the attribute information and the like, and adding into the managing file. Image data is classified and stored according to the resolution. Therefore, the speed of acquiring and displaying the image can be improved, and the disk fragments generated in the deletion are reduced. In addition, various kinds of attribute information of the image data are recorded by the image managing file to strengthen the management of the image data.

Storage space on one or more hard disks of a network caching appliance is divided into a plurality S of stripes. Each stripe is a physically contiguous section of the disk(s), and is made up of a plurality of sectors. Content, whether in the form of objects or otherwise (e.g., byte-cache stream information), is written to the stripes one at a time, and when the entire storage space has been written the stripes are recycled as a whole, one at a time. In the event of a cache hit, if the subject content is stored on an oldest D ones of the stripes, the subject content is rewritten to a currently written stripe, where 1≦D≦(S−1).

An invention is provided for handling target disk access requests during disk defragmentation in a solid state drive caching environment. The invention includes detecting a request to access a target storage device. In response, data associated with the request is written to the target storage device without writing the data to the caching device, with the proviso that the request is a write request. In addition, the invention includes reading data associated with the request and marking the data associated with the request stored in the caching device for discard, with the proviso that the request is a read request and the data associated with the request is stored on the caching device. Data marked for discard is discarded from the caching device when time permits, for example, upon completion of disk defragmentation.

A plurality of processors (10) in a multiprocessor circuit is coupled to a plurality of independently addressable memory banks (12) via a connection circuit (14). The connection circuit is arranged to forward addresses from a combination of the processors (10) to addressing inputs of memory banks (12) selected by the addresses. The connection circuit (14) provides for a conflict resolution scheme wherein at least one of the processors (10) is associated with an associated one of the memory banks (12) as an associated processor. The connection circuit (14) guarantees the associated processor a higher minimum guaranteed access frequency to said associated one of the memory banks (12) than to a further one of the memory banks (12) other than the associated one of the memory banks (12). A defragmenter (16) detects data associated with a task running on the associated processor (10) that is stored on the further one of the memory banks (12) and move said data to the associated one of the memory banks (12) during execution of the task. The defragmenter causes addressing of the data by the associated processor (10) to be remapped from said further one of the memory banks (12) to the associated one of the banks after said moving, preferably incrementally as movement of data progresses.