52 results about "File deletion" patented technology

The invention relates to a distributed file system recycle bin performance optimization method, which comprises the following steps: in the execution process of an unlink interface of a Linux file system, sequentially completing recycle bin function starting judgment, file deletability verification and recycle bin storage suitability judgment, and obtaining metadata of a target deleted file parent directory from a server; when a file system is created, a global unified root recycle bin directory is synchronously generated, and when a file is deleted, a corresponding recycle bin subdirectory is created in a target MDS based on a parent directory inode number; an atomic operation is executed through a Linux standard rename interface, the file is moved to a corresponding recycle bin subdirectory, and the operation is limited to the interior of a single MDS; when the file is recovered, extracting an inode number of a parent directory, and iteratively querying metadata to restore an original complete path; and during batch recovery, if the original catalogue does not exist or needs to be recovered to a new catalogue, directly and integrally moving the catalogue corresponding to the recycle bin, otherwise, executing recovery operation one by one. The file deletion and recovery performance is remarkably improved, the resource overhead is reduced, and the data consistency is guaranteed.

Methods, systems, and devices for data management are described. A data system may capture a first snapshot of a target computing system at a first time, and a second snapshot at a second time that is later than the first time. The system may compare the second snapshot with the first snapshot to identify whether a set of deleted files includes a quantity of deleted files that satisfies a file deletion threshold. Using metadata associated with the target computing system, the system may identify a subset of the set of deleted files as corresponding to one or more system files. The DMS may then determine whether a ratio between a first value of a deletion metric and a second value of the deletion metric satisfies a threshold ratio. In some examples, the system may refrain from generating an alert based on the ratios satisfying the threshold ratio.

The invention relates to the technical field of distributed storage and big data, and discloses a distributed storage and management method and system for clinical multi-source and multi-modal data, and the method comprises the steps: receiving and preprocessing multi-modal clinical data of a plurality of heterogeneous data sources, and obtaining a data package containing a binary file, a source identifier and preliminary metadata; integrating the data type, the label and the preliminary metadata to generate complete metadata; the file is stored in a FastDFS distributed file system, and an MD5 value is calculated; writing the metadata into the MySQL metadatabase, and triggering file deletion when the metadata fails; and performing retrieval in the MySQL metadatabase according to the query condition, obtaining a target file identifier meeting the query condition, generating a file access address based on the target file identifier, and returning the file access address to the user side. According to the invention, the storage efficiency, the sharing cooperation capability and the system performance stability of clinical multi-source and multi-modal data can be improved.

File names and inodes are indexed directly in a filesystem namespace consisting of a layered set of key value store (KVS) database logical tables. The KVS is used directly for organizing file and directory metadata on a cluster file system instead of traditional Btree structures. Embodiments provide file deletion in the file system namespace, and other features include snapshot deletion and cleaning the namespace. A name hash index is used to speed filename lookup in the file system namespace. Two key types of INODE and DIRENT are used to encode namespace metadata using self-identify variable length records in the namespace. Point-in-time snapshot copies are also formalized using KVS database operations as well operations on sets of snapshots for operations including garbage collection and data replication.

The invention relates to the technical field of computer programming, in particular to a redundant file deleting method and system, electronic equipment and a storage medium. The redundant file deleting method comprises the steps of obtaining a clearing command input by a user, wherein the clearing command comprises a target root directory and a target file extension; starting from the target root directory as a path, traversing the whole item directory of the target item corresponding to the target root directory, searching for all target files of which the extension names are target file extension names, and storing absolute paths of the target files into a file array; obtaining a target file name corresponding to each absolute path in the file array; traversing file contents of all non-target extension name files of which the extension names are not target file extension names in the preset directory array, and judging whether a target file name exists in the file contents or not; if not, taking the target file name as an unreferenced file name and adding the unreferenced file name into an unreferenced array; and outputting all unreferenced file names in the unreferenced array. Redundant files can be effectively deleted, and the project size is reduced.

The invention discloses a data storage and file management method for managing an SATA (Serial Advanced Technology Attachment) disk based on NorFlash, and belongs to the technical field of disk management. The method is used for a storage control system and comprises the following steps that a PL end of a ZYNQ embedded storage control unit initializes an SATA disk, the storage space of the SATA disk is equally divided into a preset number of storage blocks, and each storage block is distributed with a fixed storage block address in sequence; the method comprises the following steps of: mounting a jffs2 file system on a NorFlash chip; the PS end establishes an SATA disk storage block state total list file in the NorFlash chip, and the occupation state of all storage blocks in the SATA disk storage block state total list is set to be idle; the PS end establishes a file storage thread, a file reading thread and a file deleting thread, and when a file operation instruction is received, the corresponding thread is executed according to the instruction type. According to the method, the jffs2 file system is mounted on the NorFlash chip, so that the stored data can be managed and operated according to files without mounting the file system on the SATA disk.

The application discloses a renaming processing method, a server, a client and a computer readable storage medium. The method comprises the following steps: receiving a data request sent by a client, wherein the data request comprises at least one of a data write request, a data read request, a renaming request, a directory deletion request and a file deletion request; when it is detected that the data request is the renaming request, determining a first name and a second name carried in the data request; obtaining a target object name matched with the first name from a mapping relationship table, wherein the mapping relationship table comprises a corresponding relationship among the target object name, a mapping key and a mapping value, the mapping key comprises the target object name and a mapping value corresponding to an upper level object name of the target object name, and the mapping value comprises a UUID of the target object, wherein the UUID is used to indicate metadata and a data storage address of the target object; replacing the target object name in the mapping key with the second name, and sending feedback information of the renaming success to the client. The application improves the renaming efficiency.

The invention discloses a reconfiguration method of a read-only file system mirror image, electronic equipment and a storage medium, and relates to the technical field of storage, and the reconfiguration method comprises the following steps: determining a mirror image reconfiguration type, modifying a file according to first data block index information corresponding to each first data block in a to-be-modified file, and directly replacing the corresponding file in the mirror image of the old read-only file system, and updating the index information according to a modification result. And for the newly added file, storing the newly added file according to the second data block index information corresponding to each second data block in the newly added file, and updating the index information according to a file newly adding result. For file deletion, the file is deleted according to the third data block index information corresponding to each third data block in the file to be deleted, so that the technical problems of relatively high time consumption for reconstructing the file system mirror image and low mirror image construction efficiency are solved, the time for reconstructing the file system mirror image is greatly shortened, and the efficiency of reconstructing the file system mirror image is improved. And the technical effect of improving the mirror image construction efficiency is achieved.

The invention discloses a file processing method and electronic equipment, and relates to the technical field of a distributed file system.The file processing method can effectively intercept a deduplication request for the same file by introducing a globally unique and monotonous serial number mechanism, thereby getting rid of the strong dependence that underlying storage must support idempotent operation, and improving the file processing efficiency. According to the method and the system, the complexity of bottom storage implementation is reduced, the flexibility of a system architecture is improved, and by combining memory mapping and log persistence, the metadata storage overhead is minimized while the state recoverability is ensured, so that high-robustness and high-flexibility distributed file deletion is realized.

A method for preventing the deletion and modification of data files in special material monitoring software includes the following steps: S1: Create a new system user; S2: Install the software and specify the storage location; S3: Establish a one-to-one correspondence between the software user and the system user; S4: Create a new software operator; S5: Configure software user operation permissions; S6: Set read, write, and execute permissions; S7: Set read / write and non-delete permissions; S8: Set a sticky bit; S9: Multi-user software data sharing; S10: User private data protection; This patent is based on the NeoKylin operating system, with multi-user partition management and independent operation. The software login username corresponds one-to-one with the system user account, and modular management is implemented. Software operation permissions can be flexibly configured, folder permission settings can be progressively layered, multi-user software data can be securely shared, and cannot be deleted or modified; multi-user operating spaces are securely isolated, enabling secure protection of user private data.

The invention provides an HDFS (Hadoop Distributed File System)-based fine-grained file permission control method. The HDFS-based fine-grained file permission control method comprises the following steps of: splitting a write permission of an HDFS into a file write permission and a file delete permission; in the file uploading process, a deletion operation on the temporary file is allowed through a temporary permission verification mechanism; when a file deletion request is received, the operation type is mapped to be a delete permission for verification, and inheritance verification logic of the HDFS native write permission is blocked. The authority control granularity can be improved by 300%, the data mistaken deletion accident rate can be reduced by 80%, novel authority strategies such as'only uploading but not deleting 'are supported, and existing problems are solved.

The present invention discloses a registration method, system, electronic device and storage medium for a data item file. The method comprises: obtaining a data item file to be registered, wherein the data item file declares a data item registration interface; parsing the data item file and calling the data item registration interface declared by the data item file to store the data item file in a target storage area that matches the category of the data item file; obtaining the storage address of the target storage area; generating registration information for the data item file based on the file information of the data item file and the storage address, wherein the registration information is used to identify the data item file so as to call the data item file. By modularizing the management of each data item file, file deletion and modification operations are no longer complicated. Secondly, the registration interface can automatically store the file in the corresponding location and obtain the location information, making it more automated.

Embodiments of the present application disclose a file playing method and device, electronic equipment, storage medium and product, and relate to the technical field of mobile Internet. The method comprises: selecting at least two file attribute information according to a target selection mode, and generating a corresponding current file attribute information group; pre-downloading and playing a to-be-played file corresponding to the current file attribute information group; in response to a file deletion operation, deleting the to-be-played file corresponding to the current file attribute information group, and taking a next file attribute information group as the current file attribute information group. The embodiments of the present application can solve the problem of unable to download or memory overflow caused by insufficient storage or memory space, realize grouped downloading of to-be-played files, save a large amount of memory resources and network resources, and make the running more stable.

The application discloses a reconstruction method of a read-only file system image, an electronic device and a storage medium, and relates to the technical field of storage. The method comprises the following steps: determining an image reconstruction type, directly replacing corresponding files in an old read-only file system image according to first data block index information corresponding to each first data block in a file to be modified, and updating index information according to a modification result; saving a newly-added file according to second data block index information corresponding to each second data block in the newly-added file, and updating index information according to a file addition result; and deleting files according to third data block index information corresponding to each third data block in a file to be deleted. The method solves the technical problems of high time consumption and low image construction efficiency of reconstructing a file system image, greatly reduces the time for reconstructing a file system image, and improves the image construction efficiency.

This application discloses a file deletion method, system, apparatus, processor, and electronic device. The method includes: a master metadata system receiving at least one deletion request from a client; the master metadata system marking the target directory in the recycle bin as deleted and determining whether the recycle bin's state is a no-task state; if the recycle bin's state is no-task, the master metadata system controls the target thread to execute the deletion operation corresponding to each deletion request, updating the recycle bin's state to a task processing state, and recording the cursor and operation identifier of the deletion operation; if the master metadata system detects that the cursors of all threads indicate that all files in the target directory have been deleted, the recycle bin's state is updated to a no-task state. This application solves the problem of low efficiency when deleting files from the recycle bin in related technologies.

Embodiments of the present application provide a memory database encryption method, a database system and an electronic device. The method comprises: in response to an encryption function start request, encrypting a memory database and writing the encrypted memory database into a first persistent file, and encrypting real-time commands for the memory database and writing the encrypted real-time commands into a second persistent file; deleting a third persistent file to determine the first persistent file as a backup file of the memory database, and deleting a fourth persistent file, the third persistent file being a backup file that is not encrypted before the encryption function is started, and the fourth persistent file being a command log that is not encrypted before the encryption function is started, thereby achieving transparent encryption of the memory database and improving data security.

This application discloses a file deletion method and electronic device, relating to the field of distributed file system technology. The method categorizes files to be deleted into large and small files based on a preset first volume threshold. Different deletion processes are applied to files of different sizes, allowing for simultaneous deletion of large and small files, thus improving file deletion efficiency. Specifically, for small files, data block information of at least two small files is recorded in a storage object, and the physical storage space corresponding to the data block information of at least two small files in the storage object is released in batches. This avoids frequent interactions with the storage device, improving the efficiency of physical storage space release, and further enhancing the efficiency of small file deletion.

The present invention discloses a method and device for preventing files from being deleted in a Linux file system, and relates to the technical field of cloud computing. The method and device comprise the following steps: step 1: creating an anti-deletion configuration file based on a Linux operating system, and loading the configuration file into an operating system kernel, recording configuration information through the configuration file, wherein each item of configuration information includes a matching rule, each matching rule includes a file path or a regular expression, a protection policy, and priority information of the rule, checking the syntax and validity of the matching rules, and whether there are conflicts in paths and priorities between the matching rules, and adding the matching rules that pass the inspection to a rule set; step 2: monitoring and intercepting any request for attempting to delete a file, parsing the path of the file requested to be deleted, reading a rule set, matching the file path requested to be deleted with the file path in the matching rule in descending order of priority, executing the protection policy if the match is successful, otherwise allowing the operating system to continue to execute the original deletion operation, and step 3: displaying and notifying a user of deletion requests that require protection intervention, issuing a warning message, and recording each attempt to delete a protected file.

The invention provides a file processing method and device, equipment, a medium and a product, and relates to the technical field of data processing, and the specific technical scheme is as follows: obtaining a file path, a file extraction range, a file identifier, a local archiving and cleaning condition and a centralized archiving and cleaning condition corresponding to a target server, setting a uniform file processing rule, and a basis is provided for subsequent file processing. According to the file processing method, the file in the file path is extracted, and the target file matched with the file identifier is screened, so that the phenomena of file mistaken deletion and file mistaken backup are avoided, the file processing accuracy is improved, meanwhile, the complexity and omission of manual searching are avoided, and the file processing efficiency is improved. According to the file processing method and device, the target file is locally archived and cleaned, or the target server is controlled to send the target file to the server and delete the target file in the target server, centralized archiving and cleaning are carried out on the target file, multiple screening and matching are carried out, the target file is accurately determined, and the file processing accuracy is improved.

The invention is suitable for the field of data processing, and discloses a bidirectional guessing method for FAT32 cluster numbers, terminal equipment and a storage medium. The bidirectional guessing method for the FAT32 cluster number comprises the following steps: obtaining a lookup table according to file items and directory items of which the cluster numbers are not deleted, and obtaining a target file item set according to the file items of which the cluster numbers are deleted; creating time ascending order traversal and creating time descending order traversal are conducted on the target file item set, in each traversal process, for each target file item in the target file item set, a guess cluster number of the target file item is determined, and the target file items are inserted into a lookup table according to the guess cluster number and the creating time order; and determining a target cluster number of each target file item in the target file item set according to each guess cluster number in the lookup table. According to the invention, the accuracy of cluster number guessing and the adaptability to a large number of file deletion scenes are improved.

The application discloses a data processing method and device, equipment and a storage medium, and belongs to the computer technical field. The method comprises the following steps: acquiring occupation information of a storage space, wherein the occupation information is used for indicating the occupation of a plurality of running files of a production device on the storage space; in the case that the occupation information exceeds a first storage threshold and does not exceed a second storage threshold, retaining the running files in a first file subset and deleting the running files in a second file subset; in the case that the occupation information exceeds the second storage threshold, retaining the running files in a third file subset and deleting the running files in a fourth file subset; wherein the first file subset comprises a first number of running files with generation time belonging to a first time period, the third file subset comprises a second number of running files with the generation time belonging to the first time period, and the first number is greater than the second number.

The invention provides a database stability testing method and device, equipment, a storage medium and a program product, and relates to the technical field of computers. The method comprises the following steps: acquiring a full-quantity SQL case set, wherein the full-quantity SQL case set comprises SQL statements related to business in a production environment; filtering the full SQL case set, and removing invalid cases to generate a to-be-tested case set; the invalid case comprises at least one of a user-defined excluded SQL (Structured Query Language) statement, a grammar error SQL statement and a file deletion operation SQL statement, and the file deletion operation refers to a command related to user-defined file or system file deletion operation in the SQL statement; executing the to-be-tested case set to obtain an execution result; the execution result is used for verifying the stability of the database; and outputting a stability report according to the execution result. The method is used for achieving the effect of improving the test efficiency.

The invention provides an inter-process interaction method and system, a storage medium and a vehicle-mounted terminal. The inter-process interaction method comprises the following steps: creating an event monitoring thread for monitoring process file deletion events corresponding to a plurality of target processes through an event server process, and storing process file names corresponding to the plurality of target processes; creating a shared memory for data transmission between a target process and an opposite process through the preset target process; wherein when any target process exits, the process file deletion event is triggered through the event monitoring thread on the basis of the process file name corresponding to the target process, so that the process exit state is sent to the opposite process of the target process through the event server process, and the shared memory is deleted. According to the method, the problems of shared memory leakage and the like caused by abnormal exit of one party can be avoided, and the reliability of the system is greatly improved.

The application provides a file deletion method and device of a NAS disk, applied to a NAS disk and a system disk, comprising: receiving a first instruction for a target file in the NAS disk; judging whether the first instruction corresponds to a deletion operation of the target file, wherein if the first instruction corresponds to the deletion operation of the target file, a first path corresponding to the target file in the system disk is obtained; a deletion destination path of the first path and a parent directory path of the deletion destination path are obtained, the deletion destination path corresponds to the deletion operation, and it is judged whether the parent directory path of the deletion destination path is a recycle bin path of the system disk, wherein if the parent directory path of the deletion destination path is the recycle bin path of the system disk, the parent directory path of the first path is modified to the parent directory path of the deletion destination path, and the target file in the NAS disk is put into the recycle bin of the NAS disk.

This application provides a method, electronic device, storage medium, and chip for cleaning cache files, relating to the field of data processing technology. The method comprehensively considers the time of the most recent access to a cache file, the file size of the cache file, and the number of times the cache file has been accessed, thereby determining the probability that the cache file will be accessed again. The higher the probability of a cache file being accessed again, the lower the cleaning score; conversely, the lower the probability of a cache file being accessed again, the higher the cleaning score. Therefore, deleting cache files in descending order of cleaning score allows the retention of cache files with a higher probability of being accessed again, while deleting cache files with a lower probability of being accessed again, thus achieving intelligent cleaning of cache files that users do not frequently use, improving user experience.

The invention discloses a file deletion method and electronic equipment, and relates to the technical field of distributed file systems, files to be deleted are divided into large files and small files according to a preset first volume threshold value, the files of different sizes are deleted according to different deletion processes, the large files and the small files can be deleted at the same time, and the deletion efficiency is improved. According to the method, file deletion efficiency can be improved, data block information of at least two small files is recorded to a storage object for the small files, physical storage spaces of the at least two small files corresponding to the data block information in the storage object are released in batches, frequent interaction with a storage device can be avoided, physical storage space release efficiency is improved, and file deletion efficiency is improved. And therefore, the file deletion efficiency of the small files is further improved.

The application relates to a metadata sharing method and system for a deletion marker in a union file system, and belongs to the technical field of computers. The method solves the problem of inode resource consumption and inode resource exhaustion risk in the prior art. The method comprises the following steps: initiating a file deletion operation, checking whether a deletion marker file template exists, returning a directory entry of the deletion marker file template if the deletion marker file template exists, creating a temporary deletion marker file, pointing an inode pointer field in a directory entry of the temporary deletion marker file to an inode pointer of the deletion marker file template, establishing a temporary hard link of the temporary deletion marker file to the deletion marker file template, making the temporary deletion marker file inherit the inode of the deletion marker file template, and atomically renaming the temporary deletion marker file to a file name to be deleted and storing the file name to an upper directory of the union file system. The application reduces inode consumption and avoids inode resource exhaustion risk.

A method of distributed file deletion, performed by a storage system, is provided. The method includes receiving, at the storage system, a request to delete a directory and contents of the directory and adding the directory to a first set, listed in a memory in the storage system. The method includes operating on the first set, by examining each directory in the first set to identify subdirectories, adding each identified subdirectory to the first set as a directory, and adding each examined directory to a second set listed in the memory. The method includes deleting in a distributed manner across the storage system without concern for order, contents of directories, and the directories listed in the second set.

The application relates to a file management method based on a Loongson 2K1000 and a domestic path operating system, and the method is based on a domestic Loongson 2K1000 and a path operating system software and hardware platform, a file management task is created after starting, is used for generating a new storage directory and a storage file, and hard disk space is monitored in real time to clean early data files in time. When the directory and the file are created, a real-time clock module (RTC) in the Loongson is used to generate a date and time string, which is attached to the name, so as to facilitate user retrieval and automatic cleaning. Basic file IO in the path operating system is used to perform file system operations such as directory and file creation, file reading and writing, remaining hard disk space query, directory and file deletion and the like. The message queue mechanism of the path operating system is used to design an information storage flow, so as to guarantee reliable reception and storage of data.

This invention relates to a performance optimization method for a distributed file system recycle bin. During the execution of the Linux file system unlink interface, the method sequentially performs recycle bin functionality activation checks, file deletability verification, and recycle bin storage compatibility checks, obtaining metadata of the parent directory of the target deleted file from the server. A globally unified root recycle bin directory is generated synchronously during file system creation. When a file is deleted, a corresponding recycle bin subdirectory is created in the target MDS based on the parent directory's inode number. An atomic operation is performed using the Linux standard rename interface to move the file to the corresponding recycle bin subdirectory; this operation is limited to a single MDS. When restoring a file, the parent directory's inode number is extracted, and the original complete path is reconstructed by iteratively querying the metadata. During batch restoration, if the original directory does not exist or needs to be restored to a new directory, the entire recycle bin directory is moved; otherwise, restoration is performed file-by-file. This significantly improves file deletion and restoration performance, reduces resource overhead, and ensures data consistency.