69 results about "File deletion" patented technology

Novel techniques are described for maintaining file consistency between different cloud infrastructure regions during cross-region file storage replication. The novel techniques comprise upon detecting a file deletion status (i.e., a file directory entry version marked as deletion) in a source file system during a replication cycle, retrieving file name from a valid file directory entry of a prior snapshot to construct a temporary file directory entry containing necessary information for a target file system to reconstruct a duplicate file directory entry version marked as deletion. The temporary file directory entry is transferred from the source file system to the target file system during the same replication cycle.

The invention relates to a distributed file system recycle bin performance optimization method, which comprises the following steps: in the execution process of an unlink interface of a Linux file system, sequentially completing recycle bin function starting judgment, file deletability verification and recycle bin storage suitability judgment, and obtaining metadata of a target deleted file parent directory from a server; when a file system is created, a global unified root recycle bin directory is synchronously generated, and when a file is deleted, a corresponding recycle bin subdirectory is created in a target MDS based on a parent directory inode number; an atomic operation is executed through a Linux standard rename interface, the file is moved to a corresponding recycle bin subdirectory, and the operation is limited to the interior of a single MDS; when the file is recovered, extracting an inode number of a parent directory, and iteratively querying metadata to restore an original complete path; and during batch recovery, if the original catalogue does not exist or needs to be recovered to a new catalogue, directly and integrally moving the catalogue corresponding to the recycle bin, otherwise, executing recovery operation one by one. The file deletion and recovery performance is remarkably improved, the resource overhead is reduced, and the data consistency is guaranteed.

Methods, systems, and devices for data management are described. A data system may capture a first snapshot of a target computing system at a first time, and a second snapshot at a second time that is later than the first time. The system may compare the second snapshot with the first snapshot to identify whether a set of deleted files includes a quantity of deleted files that satisfies a file deletion threshold. Using metadata associated with the target computing system, the system may identify a subset of the set of deleted files as corresponding to one or more system files. The DMS may then determine whether a ratio between a first value of a deletion metric and a second value of the deletion metric satisfies a threshold ratio. In some examples, the system may refrain from generating an alert based on the ratios satisfying the threshold ratio.

The present invention discloses a multi-user revocable searchable encryption method based on blockchain, which relates to the fields of blockchain and searchable encryption technologies. The method includes: a system establishment stage, a user management stage, an update stage, and a search stage. By adopting blockchain technology and IPFS decentralized storage, the immutability of system information is guaranteed, and the risk of privacy leakage is reduced. By introducing a homomorphic exclusive-or function and verifying after wrapping the user identifier, a multi-user application scenario is realized, the interaction efficiency of the system is improved, and the security and reliability under multiple users are also ensured; by introducing a Bloom filter and a pseudorandom puncturing function, the operability of file identifiers is improved, and a secure and efficient key generation and transmission mechanism is designed in cooperation; for file deletion, a revocation mechanism is added, and a secondary search mechanism is emphatically designed, reducing the update and search overhead, thereby improving the overall performance of the system.

The invention relates to the technical field of distributed storage and big data, and discloses a distributed storage and management method and system for clinical multi-source and multi-modal data, and the method comprises the steps: receiving and preprocessing multi-modal clinical data of a plurality of heterogeneous data sources, and obtaining a data package containing a binary file, a source identifier and preliminary metadata; integrating the data type, the label and the preliminary metadata to generate complete metadata; the file is stored in a FastDFS distributed file system, and an MD5 value is calculated; writing the metadata into the MySQL metadatabase, and triggering file deletion when the metadata fails; and performing retrieval in the MySQL metadatabase according to the query condition, obtaining a target file identifier meeting the query condition, generating a file access address based on the target file identifier, and returning the file access address to the user side. According to the invention, the storage efficiency, the sharing cooperation capability and the system performance stability of clinical multi-source and multi-modal data can be improved.

File names and inodes are indexed directly in a filesystem namespace consisting of a layered set of key value store (KVS) database logical tables. The KVS is used directly for organizing file and directory metadata on a cluster file system instead of traditional Btree structures. Embodiments provide file deletion in the file system namespace, and other features include snapshot deletion and cleaning the namespace. A name hash index is used to speed filename lookup in the file system namespace. Two key types of INODE and DIRENT are used to encode namespace metadata using self-identify variable length records in the namespace. Point-in-time snapshot copies are also formalized using KVS database operations as well operations on sets of snapshots for operations including garbage collection and data replication.

The invention relates to the technical field of computer programming, in particular to a redundant file deleting method and system, electronic equipment and a storage medium. The redundant file deleting method comprises the steps of obtaining a clearing command input by a user, wherein the clearing command comprises a target root directory and a target file extension; starting from the target root directory as a path, traversing the whole item directory of the target item corresponding to the target root directory, searching for all target files of which the extension names are target file extension names, and storing absolute paths of the target files into a file array; obtaining a target file name corresponding to each absolute path in the file array; traversing file contents of all non-target extension name files of which the extension names are not target file extension names in the preset directory array, and judging whether a target file name exists in the file contents or not; if not, taking the target file name as an unreferenced file name and adding the unreferenced file name into an unreferenced array; and outputting all unreferenced file names in the unreferenced array. Redundant files can be effectively deleted, and the project size is reduced.

The invention discloses a data storage and file management method for managing an SATA (Serial Advanced Technology Attachment) disk based on NorFlash, and belongs to the technical field of disk management. The method is used for a storage control system and comprises the following steps that a PL end of a ZYNQ embedded storage control unit initializes an SATA disk, the storage space of the SATA disk is equally divided into a preset number of storage blocks, and each storage block is distributed with a fixed storage block address in sequence; the method comprises the following steps of: mounting a jffs2 file system on a NorFlash chip; the PS end establishes an SATA disk storage block state total list file in the NorFlash chip, and the occupation state of all storage blocks in the SATA disk storage block state total list is set to be idle; the PS end establishes a file storage thread, a file reading thread and a file deleting thread, and when a file operation instruction is received, the corresponding thread is executed according to the instruction type. According to the method, the jffs2 file system is mounted on the NorFlash chip, so that the stored data can be managed and operated according to files without mounting the file system on the SATA disk.

The application discloses a renaming processing method, a server, a client and a computer readable storage medium. The method comprises the following steps: receiving a data request sent by a client, wherein the data request comprises at least one of a data write request, a data read request, a renaming request, a directory deletion request and a file deletion request; when it is detected that the data request is the renaming request, determining a first name and a second name carried in the data request; obtaining a target object name matched with the first name from a mapping relationship table, wherein the mapping relationship table comprises a corresponding relationship among the target object name, a mapping key and a mapping value, the mapping key comprises the target object name and a mapping value corresponding to an upper level object name of the target object name, and the mapping value comprises a UUID of the target object, wherein the UUID is used to indicate metadata and a data storage address of the target object; replacing the target object name in the mapping key with the second name, and sending feedback information of the renaming success to the client. The application improves the renaming efficiency.

The invention discloses a reconfiguration method of a read-only file system mirror image, electronic equipment and a storage medium, and relates to the technical field of storage, and the reconfiguration method comprises the following steps: determining a mirror image reconfiguration type, modifying a file according to first data block index information corresponding to each first data block in a to-be-modified file, and directly replacing the corresponding file in the mirror image of the old read-only file system, and updating the index information according to a modification result. And for the newly added file, storing the newly added file according to the second data block index information corresponding to each second data block in the newly added file, and updating the index information according to a file newly adding result. For file deletion, the file is deleted according to the third data block index information corresponding to each third data block in the file to be deleted, so that the technical problems of relatively high time consumption for reconstructing the file system mirror image and low mirror image construction efficiency are solved, the time for reconstructing the file system mirror image is greatly shortened, and the efficiency of reconstructing the file system mirror image is improved. And the technical effect of improving the mirror image construction efficiency is achieved.

The invention discloses a file processing method and electronic equipment, and relates to the technical field of a distributed file system.The file processing method can effectively intercept a deduplication request for the same file by introducing a globally unique and monotonous serial number mechanism, thereby getting rid of the strong dependence that underlying storage must support idempotent operation, and improving the file processing efficiency. According to the method and the system, the complexity of bottom storage implementation is reduced, the flexibility of a system architecture is improved, and by combining memory mapping and log persistence, the metadata storage overhead is minimized while the state recoverability is ensured, so that high-robustness and high-flexibility distributed file deletion is realized.

A method for preventing the deletion and modification of data files in special material monitoring software includes the following steps: S1: Create a new system user; S2: Install the software and specify the storage location; S3: Establish a one-to-one correspondence between the software user and the system user; S4: Create a new software operator; S5: Configure software user operation permissions; S6: Set read, write, and execute permissions; S7: Set read / write and non-delete permissions; S8: Set a sticky bit; S9: Multi-user software data sharing; S10: User private data protection; This patent is based on the NeoKylin operating system, with multi-user partition management and independent operation. The software login username corresponds one-to-one with the system user account, and modular management is implemented. Software operation permissions can be flexibly configured, folder permission settings can be progressively layered, multi-user software data can be securely shared, and cannot be deleted or modified; multi-user operating spaces are securely isolated, enabling secure protection of user private data.

The invention provides an HDFS (Hadoop Distributed File System)-based fine-grained file permission control method. The HDFS-based fine-grained file permission control method comprises the following steps of: splitting a write permission of an HDFS into a file write permission and a file delete permission; in the file uploading process, a deletion operation on the temporary file is allowed through a temporary permission verification mechanism; when a file deletion request is received, the operation type is mapped to be a delete permission for verification, and inheritance verification logic of the HDFS native write permission is blocked. The authority control granularity can be improved by 300%, the data mistaken deletion accident rate can be reduced by 80%, novel authority strategies such as'only uploading but not deleting 'are supported, and existing problems are solved.

The present invention discloses a registration method, system, electronic device and storage medium for a data item file. The method comprises: obtaining a data item file to be registered, wherein the data item file declares a data item registration interface; parsing the data item file and calling the data item registration interface declared by the data item file to store the data item file in a target storage area that matches the category of the data item file; obtaining the storage address of the target storage area; generating registration information for the data item file based on the file information of the data item file and the storage address, wherein the registration information is used to identify the data item file so as to call the data item file. By modularizing the management of each data item file, file deletion and modification operations are no longer complicated. Secondly, the registration interface can automatically store the file in the corresponding location and obtain the location information, making it more automated.

A method of distributed file deletion, performed by a storage system, is provided. The method includes receiving, at the storage system, a request to delete a directory and contents of the directory and adding the directory to a first set, listed in a memory in the storage system. The method includes operating on the first set, by examining each directory in the first set to identify subdirectories, adding each identified subdirectory to the first set as a directory, and adding each examined directory to a second set listed in the memory. The method includes deleting in a distributed manner across the storage system without concern for order, contents of directories, and the directories listed in the second set.

Embodiments of the present application disclose a file playing method and device, electronic equipment, storage medium and product, and relate to the technical field of mobile Internet. The method comprises: selecting at least two file attribute information according to a target selection mode, and generating a corresponding current file attribute information group; pre-downloading and playing a to-be-played file corresponding to the current file attribute information group; in response to a file deletion operation, deleting the to-be-played file corresponding to the current file attribute information group, and taking a next file attribute information group as the current file attribute information group. The embodiments of the present application can solve the problem of unable to download or memory overflow caused by insufficient storage or memory space, realize grouped downloading of to-be-played files, save a large amount of memory resources and network resources, and make the running more stable.

The application discloses a reconstruction method of a read-only file system image, an electronic device and a storage medium, and relates to the technical field of storage. The method comprises the following steps: determining an image reconstruction type, directly replacing corresponding files in an old read-only file system image according to first data block index information corresponding to each first data block in a file to be modified, and updating index information according to a modification result; saving a newly-added file according to second data block index information corresponding to each second data block in the newly-added file, and updating index information according to a file addition result; and deleting files according to third data block index information corresponding to each third data block in a file to be deleted. The method solves the technical problems of high time consumption and low image construction efficiency of reconstructing a file system image, greatly reduces the time for reconstructing a file system image, and improves the image construction efficiency.

This application discloses a file deletion method, system, apparatus, processor, and electronic device. The method includes: a master metadata system receiving at least one deletion request from a client; the master metadata system marking the target directory in the recycle bin as deleted and determining whether the recycle bin's state is a no-task state; if the recycle bin's state is no-task, the master metadata system controls the target thread to execute the deletion operation corresponding to each deletion request, updating the recycle bin's state to a task processing state, and recording the cursor and operation identifier of the deletion operation; if the master metadata system detects that the cursors of all threads indicate that all files in the target directory have been deleted, the recycle bin's state is updated to a no-task state. This application solves the problem of low efficiency when deleting files from the recycle bin in related technologies.

Methods, systems, and devices for data management are described. A data system may capture a first snapshot of a target computing system at a first time, and a second snapshot at a second time that is later than the first time. The system may compare the second snapshot with the first snapshot to identify whether a set of deleted files includes a quantity of deleted files that satisfies a file deletion threshold. Using metadata associated with the target computing system, the system may identify a subset of the set of deleted files as corresponding to one or more system files. The DMS may then determine whether a ratio between a first value of a deletion metric and a second value of the deletion metric satisfies a threshold ratio. In some examples, the system may refrain from generating an alert based on the ratios satisfying the threshold ratio.

Embodiments of the present application provide a memory database encryption method, a database system and an electronic device. The method comprises: in response to an encryption function start request, encrypting a memory database and writing the encrypted memory database into a first persistent file, and encrypting real-time commands for the memory database and writing the encrypted real-time commands into a second persistent file; deleting a third persistent file to determine the first persistent file as a backup file of the memory database, and deleting a fourth persistent file, the third persistent file being a backup file that is not encrypted before the encryption function is started, and the fourth persistent file being a command log that is not encrypted before the encryption function is started, thereby achieving transparent encryption of the memory database and improving data security.

A method for protecting files from malicious software attacks is described, comprising: providing a plurality of files to be protected (F1-FN); defining (201) the following requests to be verified: file read request (RR), file write request (WR), file delete request (DR); defining (203) the following types of software enablement: software certificate-based (CRT), software hash-based (HSH); software usage history-based (LG); a software agent (AG) reveal (204) by the software agent (AG) a request for operation relating to a file of interest (F1) included in the plurality of files to be protected; the request for operation being issued by a requesting software (REQ-SW; SA, MW)) potentially malicious; verify (206) by the software agent (AG) the presence of at least one of said enabling types (CRT, LG) for the requesting software (REQ-SW); enable (RQ-ES) by the software agent (AG) the execution of the operation request when the presence of at least one of said enabling types has been verified or, otherwise inhibit (RQ-INB) from executing the operation request.

Methods, systems, and devices for data management are described. A database instance associated with managing data of one or more users may be generated. In the database instance, a table of a database for a user of the one or more users may be generated. The table may be configured to store metadata for managing data of the user and may include a partitioning category. Based on generating the table, a file that indicates a policy for partitioning the table and for retaining partitions in the table may be identified. The policy may be based on a data retention policy associated with the data of the user. Based on identifying the file, partitions for the table may be generated in accordance with the partitioning category and the file, and based on generating the partitions, one or more partitions of the partitions may be deleted in accordance with the file.

This application discloses a file deletion method and electronic device, relating to the field of distributed file system technology. The method categorizes files to be deleted into large and small files based on a preset first volume threshold. Different deletion processes are applied to files of different sizes, allowing for simultaneous deletion of large and small files, thus improving file deletion efficiency. Specifically, for small files, data block information of at least two small files is recorded in a storage object, and the physical storage space corresponding to the data block information of at least two small files in the storage object is released in batches. This avoids frequent interactions with the storage device, improving the efficiency of physical storage space release, and further enhancing the efficiency of small file deletion.

The present invention provides a data cross-network transmission method and device, which is applied to an external network processing device, and the method includes: collecting data to be processed, and storing the data to be processed in a message queue; classifying and packaging the data to be processed into multiple second data to be processed according to a preset number of items or a preset data size; when sending the second data to be processed, for each second data to be processed, performing a hash calculation on the second data to be processed, using the obtained hash value as the file name of the second data to be processed, and caching the second data to be processed in a distributed database Redis in the form of a file name as key and file content as value; using multithreading to ferry the second data to be processed to an internal network processing device; receiving a response file sent by the internal network processing device, and deleting the second data to be processed in Redis based on the response file. The above method improves transmission efficiency and ensures data integrity.

The present disclosure discloses a file publishing method, apparatus, storage medium and electronic device. Among them, the method includes: obtaining first version identification information of a version file to be published, where the first version identification information includes: a branch identifier and a first time identifier, the branch identifier is used to describe the publishing channel of the version file, and the first time identifier is used to describe the packaging moment of the version file; creating a corresponding version directory for the version file to be published in a shared directory according to the first version identification information, where the shared directory is a directory area shared by the version directories corresponding to different version files to be published on the server; outputting the version file to the version directory; uploading the version file to the server through the version directory so that the server publishes the version file. The present disclosure solves the technical problem that the file publishing method in the prior art causes page errors due to file deletion or modification during the publishing process.

The present invention discloses a method and device for preventing files from being deleted in a Linux file system, and relates to the technical field of cloud computing. The method and device comprise the following steps: step 1: creating an anti-deletion configuration file based on a Linux operating system, and loading the configuration file into an operating system kernel, recording configuration information through the configuration file, wherein each item of configuration information includes a matching rule, each matching rule includes a file path or a regular expression, a protection policy, and priority information of the rule, checking the syntax and validity of the matching rules, and whether there are conflicts in paths and priorities between the matching rules, and adding the matching rules that pass the inspection to a rule set; step 2: monitoring and intercepting any request for attempting to delete a file, parsing the path of the file requested to be deleted, reading a rule set, matching the file path requested to be deleted with the file path in the matching rule in descending order of priority, executing the protection policy if the match is successful, otherwise allowing the operating system to continue to execute the original deletion operation, and step 3: displaying and notifying a user of deletion requests that require protection intervention, issuing a warning message, and recording each attempt to delete a protected file.

The invention provides a file processing method and device, equipment, a medium and a product, and relates to the technical field of data processing, and the specific technical scheme is as follows: obtaining a file path, a file extraction range, a file identifier, a local archiving and cleaning condition and a centralized archiving and cleaning condition corresponding to a target server, setting a uniform file processing rule, and a basis is provided for subsequent file processing. According to the file processing method, the file in the file path is extracted, and the target file matched with the file identifier is screened, so that the phenomena of file mistaken deletion and file mistaken backup are avoided, the file processing accuracy is improved, meanwhile, the complexity and omission of manual searching are avoided, and the file processing efficiency is improved. According to the file processing method and device, the target file is locally archived and cleaned, or the target server is controlled to send the target file to the server and delete the target file in the target server, centralized archiving and cleaning are carried out on the target file, multiple screening and matching are carried out, the target file is accurately determined, and the file processing accuracy is improved.

The invention is suitable for the field of data processing, and discloses a bidirectional guessing method for FAT32 cluster numbers, terminal equipment and a storage medium. The bidirectional guessing method for the FAT32 cluster number comprises the following steps: obtaining a lookup table according to file items and directory items of which the cluster numbers are not deleted, and obtaining a target file item set according to the file items of which the cluster numbers are deleted; creating time ascending order traversal and creating time descending order traversal are conducted on the target file item set, in each traversal process, for each target file item in the target file item set, a guess cluster number of the target file item is determined, and the target file items are inserted into a lookup table according to the guess cluster number and the creating time order; and determining a target cluster number of each target file item in the target file item set according to each guess cluster number in the lookup table. According to the invention, the accuracy of cluster number guessing and the adaptability to a large number of file deletion scenes are improved.

The application discloses a data processing method and device, equipment and a storage medium, and belongs to the computer technical field. The method comprises the following steps: acquiring occupation information of a storage space, wherein the occupation information is used for indicating the occupation of a plurality of running files of a production device on the storage space; in the case that the occupation information exceeds a first storage threshold and does not exceed a second storage threshold, retaining the running files in a first file subset and deleting the running files in a second file subset; in the case that the occupation information exceeds the second storage threshold, retaining the running files in a third file subset and deleting the running files in a fourth file subset; wherein the first file subset comprises a first number of running files with generation time belonging to a first time period, the third file subset comprises a second number of running files with the generation time belonging to the first time period, and the first number is greater than the second number.

The invention provides a database stability testing method and device, equipment, a storage medium and a program product, and relates to the technical field of computers. The method comprises the following steps: acquiring a full-quantity SQL case set, wherein the full-quantity SQL case set comprises SQL statements related to business in a production environment; filtering the full SQL case set, and removing invalid cases to generate a to-be-tested case set; the invalid case comprises at least one of a user-defined excluded SQL (Structured Query Language) statement, a grammar error SQL statement and a file deletion operation SQL statement, and the file deletion operation refers to a command related to user-defined file or system file deletion operation in the SQL statement; executing the to-be-tested case set to obtain an execution result; the execution result is used for verifying the stability of the database; and outputting a stability report according to the execution result. The method is used for achieving the effect of improving the test efficiency.