52 results about "Journaling file system" patented technology

A method and system that reduces the length of time required to complete antivirus scans. An enhanced journal file system (JFS) includes an antivirus utility function, which utilizes a low level log of the JFS to store a history of transactions that occur since a previous scan operation. The log is immune from normal purge operations by the JFS and cannot be circumvented without driver level access. Thus, a virus that changes the timestamp on the file or otherwise attempts to hide its viral activity does not affect the log. When the antivirus scanning utility initiates an antivirus scan of the system, the antivirus scanning utility obtains the history since the last scan from the persistent log. The antivirus scanning utility “replays” the log and carries out the antivirus scan on all files, directories, etc. associated with any transactions that occurred since the last scan.

A method and apparatus for ensuring valid journaled file system metadata during a backup operation are provided. With the method and apparatus, mechanisms are provided for suspending write I / O operations to storage devices during a point-in-time backup operation. Once the point-in-time backup operation is completed, the suspended write I / O operations are released and may then be processed by the storage system. In one exemplary embodiment, when a point-in-time operation is initiated, a point-in-time backup flag is set in a logical volume manager. In response to receiving a write I / O operation, the logical volume manager checks the status of the point-in-time backup flag to determine if a point-in-time backup operation is currently being performed. If the flag is not set, then the write I / O operation is logged and performed in a normal manner. If the flag is set, then the write I / O operation is stored in a hold queue of the logical volume manager. The write I / O is not permitted to be sent to the storage system while stored in the hold queue. When the point-in-time backup operation is completed, the suspended write I / O operations in the hold queue are permitted to be sent to the storage system and the metadata for the file system is updated to reflect the committing of the write I / O operations.

The invention discloses an SCM (storage-class memory) based method for improving the performance of a log file system. An SCM serves as a memory device for storing metadata and logs of the file system, so that the reading and writing of the metadata are optimized; coverage writing and additional writing are distinguished, only coverage writing data are written in the logs, additional writing data are directly written in the file system, and an update sequence is controlled to ensure the consistency of the file system, reduce the log overhead, and improve the performance of the file system; and the characteristic of modification by byte for the SCM is utilized, and the difference between new and old log blocks is computed, so that the update of log byte granularity is realized, and log data streams are reduced. The method mainly comprises five operations of storage system construction, log writing, garbage collection, data back-writing and system recovery, can be used for various log file systems, is suitable for constructing high-performance, high-capacity and high-reliability large-sized storage systems, and solves the problems of high extra overhead, high metadata back-writing frequency, low recovery speed after downtime and the like of a log technology in an existing log file system.

The invention provides a multi-version control method of a memory file system, based on an HMFS (hybrid memory file system). The method includes the following steps of: data modification and updating: performing multi-version backup on a node address tree of the memory file system via a copy-on-write mode, and multiplexing nodes in the address tree to perform data modification and updating; data sharing: adopting level reference counting to realize metadata sharing of the multi-version file system, wherein metadata refer to data for describing data and are recorded data for realizing multi-file system versions. Files not modified are utilized to restore the file system to the file system before the files are modified, file sharing among the multi-version file systems is realized by level reference counting, and all the files of the original file system do not need to be back-upped when the file system is snapshot, so that time-space cost needed for snapshooting of the file system is reduced, and performance of the file system is improved.

A computer system includes a disk apparatus and a host computer including a journal file system. The disk apparatus includes a memory unit which is capable of permanently storing a journal, a storing control unit which stores a journal, which is sent from the host computer, in the memory unit, and an updating unit which executes data update corresponding to the journal stored in the memory unit in accordance with an instruction from the host computer. The journal file system of the host computer includes a writing unit which executes, each time the data on the disk apparatus is updated, writing of a journal, which corresponds to the data update, to the disk apparatus, and an informing unit which informs the disk apparatus of an instruction to execute the data update corresponding to the written journal.

The invention discloses an internal storage log file system based on an EXT 4 file system. The internal storage log file system is characterized by comprising an internal storage log area establishing module, a log file refreshing module and a log area write-back module, wherein the internal storage log area establishing module is used for establishing an internal storage log area for mapping an internal storage log area of a hard disk partition EXT4 file system log area in the internal storage. The log file refreshing module is used for reading a log area file in a hard disk partition into the internal storage log area when the hard disk partition is mounted, and the log file refreshing module is used for writing the internal storage log area as the log area file into a hard disk when the hard disk partition is dismounted. The log area write-back module is used for writing the internal storage log area for mapping a hard disk partition EXT4 file system into the other hard disk partition log area after the hard disk partition is dismounted. The power consumption of the hard disk is reduced by reducing the access times of the hard disk, and meanwhile due to the fact that the speed of the internal storage is far higher than that of the hard disk, the performance of the whole can be improved through the internal storage log system.

A method and system that reduces the length of time required to complete antivirus scans. An enhanced journal file system (JFS) includes an antivirus utility function, which utilizes a low level log of the JFS to store a history of transactions that occur since a previous scan operation. The log is immune from normal purge operations by the JFS and cannot be circumvented without driver level access. Thus, a virus that changes the timestamp on the file or otherwise attempts to hide its viral activity does not affect the log. When the antivirus scanning utility initiates an antivirus scan of the system, the antivirus scanning utility obtains the history since the last scan from the persistent log. The antivirus scanning utility “replays” the log and carries out the antivirus scan on all files, directories, etc. associated with any transactions that occurred since the last scan.

The invention discloses a cellphone file recovery method and device. The method includes the steps of S1, traversing data blocks in which logs are stored, searching a log file system for an index node Inode of a detected file; S2, analyzing the index node Inode to acquire file attribute of an original file; S3, locating data blocks of the original file according to the acquired file attribute; and S4, recovering the deleted file according to data in the data blocks. According to the cellphone file recovery method and device, the detected files in a cellphone are recovered through the log file system; the problem that files mistakenly deleted by a cellphone user cannot be recovered at present is effectively solved, conveniences are brought to the cellphone user, and unnecessary loss is avoided.

A method is provided for detecting viruses. According to the method, data is stored in a journal area of memory before changes embodied in the data are written to virtual memory. At least a first portion of the data in the journal area of memory is scanned for viruses. In some embodiments, a second portion of data that immediately precedes and / or immediately follows data to which the first portion of the data pertains is scanned for viruses. Preferably, the virtual memory includes a persistent storage device. Also provided is a system that includes a processor, a memory that includes virtual memory and a journal storage area, and a virus scanner controlled by the processor. The virus scanner scans the journal storage area for viruses.

A host of a multi-device file system may instruct an external data mover implementing a third party copy to move data from one storage device to another without the host reading or writing data as part of the move. The data being moved may remain accessible through the file system after being moved. A host may instruct an external data mover to write moved data to multiple mirrored devices. A host may instruct the data mover to move data between storage classes in a multi storage class file system. A journaling file system may utilize an external data mover implementing a third party copy to move data from a system log to another storage destination and may also instruct the data mover to move metadata as well as data.

The invention relates to a performance optimizing method for a log file system based on a nonvolatile memory. The method comprises the following steps: connecting an NVM and a DRAM to a memory bus ofa CPU, updating small data by in-situ write so as to minimize occupation of the memory, carrying out fine-grained backup on the data to be updated by using a small data log, and recording the newest data information, which requires to be changed, of the file; storing a global hash table by a fixed-length circular buffer region, and recording an initial address of every update for rapid indexing tothe data page when in next in-situ updating; recording the initial address of the updated data page for next rapid indexing to the data page; and after data writing is finished, updating log tail byupdating a pointer, which points to a data block, of metadata to submit write at this time as a mark for completion of operation at this time. Expenditure and performance for data consistency can be balanced, space distribution costs are reduced, write amplification in a small data updating process is avoided, and meanwhile, powerful data consistency is ensured.

The invention provides a log file system construction method based on an LSM-Tree structure.The method comprises the following steps of constructing a log file system fuse frame interface of the LSM-Tree structure, wherein the step of constructing multiple catalog operation functions and file operation functions of the log file system based on the LSM-Tree structure is included; adopting the Hash mapping function for adding recorded data into the constructed log file system based on the LSM-Tree structure and inquiring the recorded data.By means of the log file system construction method, on the premise that read-write performance of a large file is maintained unchanged, read-write performance of a catalog and a small file can be effectively improved.

A problem with a journaling file system is that the load on input / output processing executed between a server and a storage system is increased because a journal log is written when the file system is updated and updated data is written when flush processing is executed. In a system according to the present invention, a storage system that has received journal logs from a server uses updated data included in the journal logs to execute flush processing.

Disclosed herein are a buffer cache apparatus, a journaling file system, and a journaling method capable of incorporating journaling features based on nonvolatile memory. The buffer cache apparatus provides a data buffering function between a central processing unit (CPU) and storage. The buffer cache apparatus includes a plurality of cache blocks and a journal management unit. The plurality of cache blocks are configured as volatile or nonvolatile memory devices. The journal management unit maintains states of freezing for write-protecting dirty up-to-date cache blocks among the plurality of cache blocks.

The invention provides a log file analysis system and the method, wherein, the log file system comprises: a comparison file storage module for prestoring a comparison file for comparing with the log file; a receiving module for receiving the log file of the operational state relating to the server and / or terminal on a train; a comparison module for comparing the log file and the comparison file; and an analysis module for analyzing the operational state of the server and / or terminal according to the comparative result. Through the invention, the program broadcast situation on each train can be reflected in time, real time, and truly, comprising no broadcast log, abnormal shutdown, not broadcasting when start, and failure in loading programme source, etc. no manual intervention is needed, all the steps can be automatically completed by the system; the invention has the characteristics of high efficiency, high speed and accuracy data, etc.

The invention provides a trash recycling method for a log file system on the basis of repeated data deleting, and relates to computer data storage methods. The trash recycling method includes the steps of initializing, parallel data processing, trash recycling and ending. According to a reference value of a data block obtained by a repeated data deleting technology, data are divided into strong data and weak data, the strong data and the weak data are respectively migrated into different segments when trashes of the log file system are recycled, and divided storage of the strong data and the weak data is realized. Data blocks in a strong data segment are low in failure rate, and the times of trash recycling are less; data blocks in a weak data segment are high in failure rate, and effective data blocks needing migration are less during trash recycling. The trash recycling method for the log file system on the basis of repeated data deleting has the advantages that the times of data block migration during trash recycling in the log file system can be reduced effectively, and performance and reliability of a flash memory system can be improved.

The invention discloses a data processing method and device. The data processing method comprises following steps of consuming task failure data in a message queue by a specific thread, wherein the task failure data is used for indicating failure tasks related to data operations in a database; and writing at least part of the consumed task failure data in a log file system. According to the data processing method and device, the task failure data is transferred from the message queue to the log file system, therefore, the task failure data will not be stored in the message queue for a long time, and the storage pressure of the message queue can be effectively mitigated.

The invention discloses an intelligent device reporting data method and system, wherein the method comprises the steps: A, an intelligent device storing data to be reported in a multi-row format, each row of recording being composed of fields representing different services; B, after storage, performing coding and compression processing on the data to be reported, and transmitting the processed data to a logger interface server through calling a logger interface; C, the logger interface server receiving the data, then storing the data in a logger file, and uploading the logger file to a logger file system; and D, the logger interface server receiving all data, and then returning successfully received returning codes to the intelligent device. The method and system improve a data transmission format, and reduce the number of interfaces defined by a service terminal, thereby providing great convenience for an intelligent television to call an interface; in addition, the method and system employ coding and compression processing, reduce the band width occupied in reporting data, and guarantee data security and reliability.

The invention discloses a method for restoring deleted data of a journaling file system (JFS). The method comprises the steps that a journal record is obtained, and the JFS is analyzed; it is determined that subfile entries of the journal record are mounted in a directory entry obtained through analysis; subfile entries of the directory entry obtained through analysis are compared with the subfile entries of the journal record; inode information of the parts, different from the subfile entries of the journal record, of the subfile entries of the directory entry obtained through analysis is obtained; the file content of a deleted file is obtained according to a memory address in the inode information. The memory address corresponding to the deleted data can be obtained according to the journal record embedded in the JFS, and the deleted data is found according to the memory address and restored.

The invention provides a log collection method, a log collection system and a server. The log collection method comprises the following steps: isolating a target collection point according to the identity information of collection points of a server; combining log information generated by the isolated collection point according to a preset configuration file to form an information object set; and converting the information object set to a specified format according to the preset configuration file, and storing the information object set in the specified format in a log file system of the server. According to the technical scheme of the invention, log information shunting is realized, the work efficiency of the server is improved, the flexibility and accuracy of log information collection are increased, the inference of irrelevant log information is reduced, and the analysis efficiency of log information is improved.

The invention relates to a data processing method for a distributed file system and the distributed file system. The method comprises the steps as follows: an Fac obtains file data and pushes the file data to an Fas; the Fas records pushed file data, records modification of metadata corresponding to the Fas in a buffer zone, writes the modification into a log file, and returns a file data push completion message to the Fac; the Fac transmits a metadata modification change request to an Flr; the Flr modifies the corresponding metadata according to the metadata modification change request and records the metadata into a log file system; and the Flr carries out rollback operation of corresponding modified data according to a log record when monitoring abnormal restart of the Fas. According to the data processing method and the distributed file system, final high consistency of the file after the distributed file system is reset and restarted is ensured; the data inconsistency among multiple replicas caused by downtime and restart of a machine is avoided; and corresponding delay and performance loss caused by addition of a log system are reduced to the maximal extent.

A problem with a journaling file system is that the load on input / output processing executed between a server and a storage system is increased because a journal log is written when the file system is updated and updated data is written when flush processing is executed. In a system according to the present invention, a storage system that has received journal logs from a server uses updated data included in the journal logs to execute flush processing.

A method and apparatus for ensuring valid journaling file system metadata during backup operations provides a mechanism for suspending write I / O operations to a storage device during point-in-time backup operations. After the real-time point backup operation is completed, the pending write I / O operation is released, and then processed by the storage system. Sets the point-in-time backup flag in the Logical Volume Manager when initiating a point-in-time operation. When receiving a write I / O operation, the logical volume manager checks the status of the real-time point backup flag to determine whether the real-time point backup operation is currently being performed. If the flag is not set, write I / O operations are logged and performed as normal. If the flag is set, write I / O operations are stored in the holding queue of the logical volume manager. When a write I / O is stored in the holding queue, it is not allowed to be sent to the storage system. When the real-time point backup operation is completed, the pending write I / O operations in the holding queue are allowed to be sent to the storage system, and the metadata for the file system is updated to reflect the submission of the write I / O operations.

A method is provided for detecting viruses. According to the method, data is stored in a journal area of memory before changes embodied in the data are written to virtual memory. At least a first portion of the data in the journal area of memory is scanned for viruses. In some embodiments, a second portion of data that immediately precedes and / or immediately follows data to which the first portion of the data pertains is scanned for viruses. Preferably, the virtual memory includes a persistent storage device. Also provided is a system that includes a processor, a memory that includes virtual memory and a journal storage area, and a virus scanner controlled by the processor. The virus scanner scans the journal storage area for viruses.

The embodiment of the invention discloses a file protection method and device. The method comprises the steps that attribute information of a to-be-protected file stored in a file system is determined; a backup file corresponding to the attribute information is created; whether the attribute information of the file is altered or not is detected; when it is detected that the attribute information of the file is altered, the altered attribute information is read, and the corresponding backup file is updated according to the altered attribute information. Thus, the to-be-protected file is subjected to backup so that file restoration can be realized according to the corresponding backup file when the file is deleted and needs to be restored, and the problem that in the prior art, inode stored in a log file system is covered and updated, and consequently a deleted file cannot be restored is solved.

The invention provides a security log file system, an implementation method thereof and a medium. The system comprises the following components of: a file configuration module which is used for distributing files and folders to directory entries, wherein the directory entries comprise file names, sizes and file content initial addresses, and the directory entries serve as directory file contents to be stored in a data area; a conversion module used for carrying out mapping from a logic address to a physical address, outage recovery, garbage collection and wear leveling, and providing a virtualdisk, so that an upper-layer application directly uses a storage device based on the flash memory; a storage module used for dividing a logic block into a data block and a log block according to a mixed flash memory conversion layer thought, wherein the data block adopts block-level mapping and is used for storing data. and the log block adopts page-level mapping and is used for storing and updating. The security log file system, the implementation method thereof and the medium provided by the invention meet the requirements, are innovated on the existing basis, and have relatively strong operability and expansibility.

A journaling file allocation table (FAT) file system includes an FAT file system module, a storage device and a driver. The FAT file system module includes a journaling module and receives a file operation instruction sent by an operating system. The storage device has an FAT file system and an FAT journaling cache. The driver is coupled to the FAT file system module, the journaling module and the storage device in order to access the storage device. When the FAT file system stored in the storage device is a journaling FAT file system, the FAT file system module enables the journaling module to receive and execute the file operation instruction sent by the operating system and to accordingly produce a corresponding file operation instruction to the driver for performing a journaling file operation on the storage device.

System and method for implementing a reliable persistent random access compressed data stream is described. In one embodiment, the system comprises a computer-implemented journaled file system that includes a first file for storing a series of independently compressed blocks of a data stream; a second file for storing a series of indexes corresponding to the compressed blocks, wherein each one of the indexes comprises a byte offset into the first file of the corresponding compressed block; and a third file for storing a chunk of data from the data stream before it is compressed and written to the first file. The system further comprises a writer module for writing uncompressed data to the third file and writing indexes to the second file and a compressor module for compressing a chunk of data from the third file and writing it to the end of the first file.