75 results about "File system fragmentation" patented technology

A system and method for hybrid virtual machine monitor system is provided. A first operating system uses a file system to manage data storage and retrieval within a data storage area. A second operating system, which is not compatible with the first operating system's file system, executes a management application backup utility. The first operating system includes a filter driver that sends logical block addresses, which correspond to data reads / writes, to the management application backup utility. In turn, the management application backup utility uses the logical block addresses to perform operations on the data storage locations. In one embodiment, the management application backup utility performs actions on the data storage area, such as a disk defragmentation, and subsequently sends data location changes to the filter driver. In this embodiment, the filter driver instructs the first operating system's file system to update its translation tables based upon the data location changes.

The invention discloses a file encryption and decryption method based on cloud storage. The file encryption and decryption method comprises the following steps of starting file write to a cloud storage platform by an application terminal, and conducting fragmentation storing on a file by the cloud storage platform; conducting distributed encryption on the file which is stored in the cloud storage platform in a fragmentation mode by an encryption and decryption platform; conducting distributed decryption on the file which is stored in the cloud storage platform in the fragmentation mode by the encryption and decryption platform. The invention further provides a file encryption and decryption system based on the cloud storage. According to the technical scheme, repeated file fragmentation and aggregation processes are reduced, waste of computing capability is avoided, and meanwhile the processing speed of encryption and decryption is improved.

A defragmentation technique determines the extent to which data blocks of a file are fragmented on disks of a computer and, in response, efficiently relocates those blocks if such relocation improves the on-disk layout of the file. Each indirect block of the file is examined and the current layout of the range of pointers referencing the data blocks is determined. In addition, the number of operations needed to retrieve those data blocks from disks is calculated. A potential new layout is then estimated based on an average fullness of the file system. If the potential new layout improves the fragmentation of the current layout, then the data blocks for that range are relocated, if there is sufficient free space on disk. Otherwise, the blocks are not relocated and the current on-disk layout of the file is maintained.

The invention relates to a method for recording and searching hard disk video having analog tape serial mode, which is characterized in that the method comprises the process of establishing disk track files in advance, video tape data buffering serial write procedure, token management process ensuring preferential writing and process of quickly searching and reading video tape data. The method has the advantages that 1) a disk preallocation mode is used for solving the problem of disk defragment generated by establishing and deleting files temporarily, so that the service life of the disk is prolonged. 2) As the operation of establishing and deleting files is not involved in the processing of using the disk, the probability of damaging the disk can be greatly reduced in certain extreme cases. 3) Data buffering technology, serial writing technology and track file technology are used for decreasing the operating times of the disk and the moving frequency of a magnetic head to the utmost extent, reducing the heat rise of the disk and prolonging the service life of the disk. 4) By adopting the token technology, the method better adapts to the requirements for ensuring the normal work of the video tape in the application of video surveillance.

The invention relates to a block storage algorithm applicable to multiple paths of concurrent-written stream media data. In the security and protection monitoring industry, requirements on the storage property of a video server are higher and higher as the project scale is continuously expanded and a high-definition front-end camera is used. A bottleneck formed by concurrent writing of hundreds of external video data of the camera into a single storage server is analyzed. A file system breaks down easily and the data is seriously lost under the abnormal condition of the server. After a disk is repeatedly covered and written, a large number of disk fragmentations are generated and the storage property is also reduced. According to the invention, the problems are analyzed, and a strategy for establishing a self-cache system through bypassing a file system layer, as well as a block storage idea and an available block searching algorithm on the basis of the block storage idea are provided. Through the online use of a practical product, the feasibility and the reliability of the block storage algorithm are verified.

A method for determining file fragmentation and performing subsequent defragmentation, including measuring a file fragmentation factor, measuring a file extent distance factor, measuring a file fragmentation level, selecting a file stored as multiple extents on at least one disk, selecting a free space extent on the disk whose length most closely matches the length of the file, calculating a fragmentation level of the disk from a fragmentation factor and a file extent distance factor of free space extents or allocated space extents of the disk, calculating the effect that moving the file to the free space extent would have on the fragmentation level, and moving the file to the free space extent provided that doing so causes the fragmentation level to satisfy a criterion.

The embodiment of the invention provides a disk defragmentation method, a disk defragmentation device and a host. The method comprises the following steps: judging the fragmentation degree of a first disk area according to a first space management object; if determining that the fragmentation degree of the first disk area reaches the preset fragmentation degree, writing a data block of each object corresponding to a defragmentation sub-area into a continuous disk space according to the first space management object, and writing metadata, which is generated when the data block of each object is written in the continuous disk space, in the continuous space, wherein the defragmentation sub-area is smaller or equal to the first disk area; and releasing the defragmentation sub-area. Visibly, a section of continuous idle space in the first disk area can be obtained after the defragmentation sub-area is subjected to disk defragmentation according to space management information; and thus, the disk defragmentation efficiency is increased.

A method and apparatus for queuing FBNs of received write blocks for a file to a queuing data structure for assigning LBNs to the FBNs is described herein. A queuing data structure may comprise a modified binary search tree, such as a modified red-black search tree. Each node of a queuing data structure may comprise a base field for storing a base FBN and a range field for storing a range value comprising X bits. The range field of a single node may represent a range of two or more FBNs (“FBN range”), the FBN range being based on the base FBN. Each FBN in the FBN range may have a corresponding bit in the range field, the base FBN corresponding to a “base bit” in the range field. The value of the corresponding bit in the range field may indicate whether the FBN has been received.

A data migration method and device for a distributed file system, and a metadata server. The data migration method for a distributed file system comprises: according to the number of accessed bytes of a file fragmentation and the size of the file fragmentation, making statistics about the access frequency of file fragmentation; and according to the access frequency of the file fragmentation, migrating the file fragmentation on storage devices of different performance. The method improves the utilization rate of space and performance for a storage device of a distributed file system.

The invention discloses a method for blocking and storing a stored file in a cloud storage system by adopting a dynamic adaptation method, and mainly aims to solve the problems of low space utilization rate and disk fragments caused by the use of a fixed block size in the prior art. The implementation scheme comprises the following steps of: setting a grouping factor vector by using the cloud storage system, obtaining the size and heat mark of a file when the file is to be stored, and when the size of the file is smaller than a minimum grouping factor, using the final size of the file; if the heat mark is 1, copying and storing the file, and on the contrary, directly storing the file on a single node; and when the size of the file is larger than the minimum grouping factor, comparing the size of the file with a grouping factor to obtain an optimal block size. Compared with the method using the fixed block size, the invention has higher file uniformity, can better solve a load balancing problem caused by hot files, and is particularly suitable for the cloud storage system.

The invention discloses a video recording file management method and device for easily preventing disk fragments from being generated. The method comprises the following steps that firstly, disk formatting is conducted on a video recorder, a disk is fixedly set to one subarea or multiple subareas, and different formatting methods provided by an operating system are applied to different file systems; secondly, a video recording file index database is established, and the video recording file retrieval service is provided; thirdly, the size of each video recording file is fixed and marked as A (Byte); fourthly, when the disk is not fully occupied, a general file establishment and write-in method is applied; fifthly, when the disk is fully occupied, the file which is established earliest on the disk is found out and used as a new video recording file, write-in is conducted from the start position of the file in a covering mode, and the step is repeated. The video recording file management method and device for easily preventing disk fragments from being generated have the advantages of being simple, easy to achieve and compatible with different file systems due to the fact that the management method and device capable of easily preventing the disk fragments from generating the video recording file are established on a general file system; the problems that after audio and video data are written in a hard disk recorder in a circulating mode for a long time, a great number of disk fragments are generated and the system operating efficiency is influenced are solved.

The embodiment of the invention discloses a disk data management method and a disk control device, which are used for efficiently managing a fragment on a disk. The disk data management method disclosed by the embodiment of the invention is applied to the disk control device that comprises a disk, wherein the disk comprises a data area and a log area. The method comprises the following steps: writing data in a buffer memory; judging whether the data is hot spot data, wherein the hot spot data, after stored in the disk, is the data that can make the disk generate fragments of which the number is preset after the preset number of times is amended and released; if the data is not the hot spot data, then allocating a data area space for the data in the data area, and writing the data into the data area space; if the data is hot spot data, then allocating a log area space for the data in the log area, and writing the data into the log area space. By storing different types of data at different areas in the disk and managing in different ways, the efficiency for managing the fragment on the disk can be improved, and the high-efficiency management for the disk fragment in the log area can reduce the generation of the disk fragment.

The invention provides a file storage method and device, and is used for solving the problems that fragments or overflowing is always caused since a traditional file storage way is unreasonable and file query efficiency is low. The method comprises the following steps: according to the size of a received file uploaded by a client side, storing the content data of the file into at least one file storage block; obtaining the information of the file storage block which stores the content data; according to the information of the file storage block, generating metadata corresponding to the content data; and storing the metadata of the file into a preset storage space. The disk fragments or overflowing caused in a way that all content data of the file is directly stored into the corresponding storage space as a whole can be avoided, a storage mode is more reasonable, the metadata is independently stored, and therefore, the metadata of the file can be uniformly managed so as to improve the query efficiency of a subsequent file.

The invention discloses a method for reducing disk fragments. The method comprises: a certain amount of files are allocated to a disk in advance when a network video recorder (NVR) is used for the first time, file information is written in a database, when video recording is needed, a present available file is searched in the database, and then data are written in the present available file; according to the method for reducing the disk fragments through disk pre-allocation technology, integrity and consistency of the data are kept by modifying database records of corresponding camera information of file names in video files without modifying file information in a file allocation table (FAT).

The invention discloses a method for data deletion in batch in an ORACLE database, which has the following steps: A. a where condition for retention data is analyzed according to deletion conditions; B. an exp command is used for exporting retention data meeting the where condition in a compression way; C. the original table is cleared; and D. the retention data is exported back to the database. In step C, the original table is cleared in the way of a drop original table and a truncate original table, compression of high water line and recovery of database table space can be realized. The method deletes data in batch under the conditions of batch data, has high deletion efficiency, performs disk efragmentation in the data table, and completes the compression operation of the high water line in the process of data deletion in one step without any additional database operations.

The invention provides a method and a device for optimizing the disk space utilization ratio in digital television time shifting. During recording of time shifting programs, if the duration of the time shifting program recorded currently exceeds the set maximum time shifting time, and if the stream bit rate of a transport stream received currently is lower than the average stream bit rate, time shifting programs of which the recording time is longest are deleted to release redundant disk fragmentation, and the newly-recorded time shifting program covers time shifting programs of which the recording time is longest in current files. By the aid of the method and the device, the size of the disk space occupied by time shifting programs can be changed dynamically according to the requirements, so that the problem of the low disk space utilization ratio when the disk space is not sufficient can be solved.

The invention discloses a multimedia data processing method and processing system suitable for digital media broadcast. The processing system comprises a storage medium for storing files, a storage space index module for providing index information of vacant continuous space blocks on the storage medium, a file index module for storing index entries of video files written to the storage medium, and an index structure for providing video index information and video data information, wherein the video index information comprises frame index information of the video files, and the video data information comprises an I-frame positive sequence, an I-frame reverse sequence and original video files. The multimedia data processing method and processing system suitable for digital media broadcast are adopted, so that a plurality of coding forms are supported, the same quantity of IO (input output) resource is consumed in normal broadcast and multi-time broadcast, the IO performance is sustained and stable, the access efficiency is high, the reading and writing efficiency is high, and a lot of disk fragmentations are not generated.

The invention discloses a document storage managing method of a document system. The method comprises the following steps: communicating with a client-side, receiving documents sent by the client-side, obtaining the data size of the documents received from the client-side, comparing the data size with a preset reference value, distributing storage space for the documents in a dynamic mode according to the data size, providing distributable storage space, and storing the documents in the storage space. The invention further discloses the document system. According to the document system and the document storage managing method thereof, the utilization efficiency and the service life of a disk used as a carrier storing the documents in the document system are both considered, the waste of storage space in the document system is reduced, disk fragmentation in the document system is reduced, the moving times of a magnetic reading head at document reading time is reduced, and the usability of the disk used as the carrier storing the documents in the document system is improved.

The invention discloses an on-line fault tolerance method in a cluster data processing system. The method comprises the following steps that firstly, a last level processing node stores a processing result in a file fragmentation mode; secondly, a next level processing node reads a file fragmentation to continue to carry out processing; thirdly, a database is used for recording file fragmentation marks processed on all nodes; fourthly, when the node fault is detected, a new node is started to replace the fault node to work; fifthly, the new node reads the file fragmentation on the fault node from the database, and the fault field is recovered. The fault tolerance in the data processing process is achieved.

Disclosed is a method for preparing a disk drive of a computing system for test, including the steps of recording a plurality of test files to a partition of the disk drive until a free space of the partition is less than a predetermined value; and thereafter deleting a portion of the plurality of test files from the partition. A computer program product including a computer readable medium carrying a program for preparing a disk drive of a computing system for test, the computer program product having code for recording a plurality of test files to a partition of the disk drive until a free space of the partition is less than a predetermined value; and code for deleting a portion of the plurality of test files from the partition.

The invention provides a processing method of tile images. The processing method comprises the steps of obtaining the number of co-occurrence times of the first tile image and the second tile image according to historical request data and the first tile image; according to the number of co-occurrence times and a preset co-occurrence threshold value, combining the first tile image and the second tile image so as to obtain the third tile image; storing the third tile image; storing the first corresponding relation between the first tile image and the third tile image and the second corresponding relation between the second tile image and the third tile image. The invention further provides a processing system of the tile images. According to the processing method and system of the tile images, the disk fragmentization degree of a disk storing the tile images is lowered.

The invention relates to the technical field of data processing, and discloses a data compression method which includes the steps: firstly, writing data into a compression buffer memory; secondly, reading the data from the compression buffer memory by a compression engine in a fixed capacity manner; finally, compressing the read data by the compression engine. The invention further discloses a data compression device which comprises a data writing module, a data reading module and a data compression module, the data writing module is used for writing the data into the compression buffer memory, the data reading module is used for reading the data from the compression buffer memory by the compression engine in a fixed capacity manner; the data compression module is used for compressing the read data by the compression engine. The data compression method solves the problems that compressed data are written in the disk, disk fragmentations are generated in a disk, a lot of disk space is occupied, so that disk space is wasted in the prior art.

The present invention discloses a multi-path audio / video stream storage method for preventing disk fragments from formation. The multi-path audio / video stream storage method comprises the following main steps of: (1) establishing data files for storing audio / video streams; (2) distributing data files stored by the plurality of the audio / video streams, namely respectively setting a storage space needed by each path of the audio / video stream, automatically distributing the data files with the corresponding quantity according to the storage space needed by each path of the audio / video stream, and respectively establishing a data file index database table corresponding to each path of the audio / video stream and inserting the data file index database table into a record of the data file distributed by the data file index database table; and (3) storing the plurality of paths of audio / video streams, namely independently storing each path of audio / video stream by combining a database and updating a database record corresponding to the audio / video stream according to the requirements. The multi-path audio / video stream storage method for preventing the disk fragments from formation has the advantages that the disk fragments are not formed; the storage efficiency of the audio / video streams is not reduced along the increasing of time, and total recording time of each path of audio / video stream is accurately controlled; and a disk space occupied by the data file of each path of audio / video stream is continuous so that the accessing efficiency of the audio / video stream files is improved.

The invention discloses a data storage management method and device. The data storage management method and device are used for solving the problems that a disk is fragmented, and files are prone to being lost. The method comprises the steps that in the system configuration stage, the management device sets up at least one CQFS, and the at least one CQFS comprises CQFS data blocks of the preset number and the preset size; in the system running stage, the management device writes generated service data in each CQFS data block of the at least one CQFS one by one, and every time one CQFS data block is used, a corresponding data block recovery timestamp is generated corresponding to the used CQFS data block. The management device removes the service data in each data block in sequence according to the data block recovery timestamp corresponding to each CQFS data block. Every time the service data in one data block are removed, newly-generated service data continue to be written in the corresponding CQFS data block with the service data removed.

The invention provides image file management method and system, relating to the image storage technology and aiming at solving the defects of obtaining and displaying images slowly and easily generating disk fragments after an image is deleted in the prior art. The image file managing method comprises the storage steps of: receiving an image storage request, extracting attribute information of an image, finding useable storage positions in a corresponding storage region in a managing file and corresponding compression modes according to the image resolution; and compressing the image to the size corresponding to the compression mode according to the compression mode, then storing the compressed image to the useable storage position, generating a storage record according to the attribute information and the like, and adding into the managing file. Image data is classified and stored according to the resolution. Therefore, the speed of acquiring and displaying the image can be improved, and the disk fragments generated in the deletion are reduced. In addition, various kinds of attribute information of the image data are recorded by the image managing file to strengthen the management of the image data.

An invention is provided for handling target disk access requests during disk defragmentation in a solid state drive caching environment. The invention includes detecting a request to access a target storage device. In response, data associated with the request is written to the target storage device without writing the data to the caching device, with the proviso that the request is a write request. In addition, the invention includes reading data associated with the request and marking the data associated with the request stored in the caching device for discard, with the proviso that the request is a read request and the data associated with the request is stored on the caching device. Data marked for discard is discarded from the caching device when time permits, for example, upon completion of disk defragmentation.

A plurality of processors (10) in a multiprocessor circuit is coupled to a plurality of independently addressable memory banks (12) via a connection circuit (14). The connection circuit is arranged to forward addresses from a combination of the processors (10) to addressing inputs of memory banks (12) selected by the addresses. The connection circuit (14) provides for a conflict resolution scheme wherein at least one of the processors (10) is associated with an associated one of the memory banks (12) as an associated processor. The connection circuit (14) guarantees the associated processor a higher minimum guaranteed access frequency to said associated one of the memory banks (12) than to a further one of the memory banks (12) other than the associated one of the memory banks (12). A defragmenter (16) detects data associated with a task running on the associated processor (10) that is stored on the further one of the memory banks (12) and move said data to the associated one of the memory banks (12) during execution of the task. The defragmenter causes addressing of the data by the associated processor (10) to be remapped from said further one of the memory banks (12) to the associated one of the banks after said moving, preferably incrementally as movement of data progresses.