1260 results about "Object file" patented technology

Techniques are described for enabling concurrent cross-region replications and garbage collection while maintaining consistency and data integrity among file systems. In some embodiments, techniques for garbage collection fencing utilize a system-level garbage fencing key (GC fencing key) and one or more job-level GC fencing keys in a source file system that perform one or more cross-region replications with one or more target file systems, one replication and one job-level GC fencing key per target file system. In some embodiments, one job-level GC fencing key in a source file system and one job-level GC fencing key in a source file system together provide garbage fencing for a cross-region replication. In certain embodiments, the metadata information in a GC fencing key can inform, instruct, or be used to configure garbage collectors to skip garbage collection for a range of snapshots in a file system.

Techniques are described for enabling concurrent and non-blocking replication object deletion during cross-region replications. In some embodiments, in a target file system, a target replication pipeline as part of a cross-region replication, and a deletion pipeline operate in parallel. The deletion pipeline deletes processed objects reaching the last pipeline stage of the target replication pipeline after each checkpoint in the target replication pipeline. In some embodiments, after a non-recoverable failure during the cross-region replication, the cross-region replication can be restarted from the beginning (i.e., fresh restart) without waiting for its unused objects in the Object Store to be deleted by utilizing a generation number associated with each object to delete the unused objects in a background process while allowing deleting processed objects as normal for the freshly restarted cross-region replication.

Ransomware detection accuracy is improved by analyzing patterns of changes in filename extension counts, relative to each other, that occur in a file system over time. The disclosed approach is malware-agnostic and does not rely on recognizing malware extensions or on real-time monitoring of the target file system. Instead, during each successive backup job of the target file system, the disclosed technology counts different types of filename extensions and compares the counts to each other and to corresponding counts taken in earlier backup jobs. Preferably, the anomaly detection analysis uses machine learning to discern a behavior pattern of the file system, which indicates how filename extensions are distributed and how much they change between backup jobs over time.

Techniques are described for performing different types of restart operations for a file storage replication between a source file system and a target file system in different cloud infrastructure regions. In certain embodiments, the disclosed techniques perform a restart operation to terminate a current cross-region replication by synchronizing resource cleanup operations in the source file system and the target file system, respectively. In other embodiments, disclosed techniques perform a restart operation to allow a customer to reuse the source file system by identifying a restartable base snapshot in the source file system without dependency on the target file system.

The invention relates to a mirror image file processing method and device, and relates to the technical field of container mirror image generation. The method comprises the steps of obtaining target file system directory information of a target container in response to a mirror image file export request for the target container; the target file system directory information of the target container is used for representing file system directory information of a writable layer of the target container; comparing the target file system directory information of the basic mirror image with the target file system directory information of the target container to obtain a difference file of the target container relative to the basic mirror image; constructing a layer file of a new incremental layer based on the difference file; writing a layer file of the incremental layer into a mirror image layer file directory of the basic mirror image, and updating a list file and an index file of the basic mirror image to obtain a mirror image file of the target container; the manifest file comprises metadata of each mirror image layer in the basic mirror image, and the index file comprises metadata of the manifest file. By adopting the method, the export efficiency of the container mirror image file can be improved.

The invention relates to the technical field of cloud computing, and particularly provides a data cache prefetching method and device, a storage medium and a program product. According to the method, file access characteristics representing file access preferences of a user are obtained based on historical access data of the user, a target file meeting a cache prefetching strategy is determined based on the file access characteristics, and the target file is cached and prefetched. By dynamically analyzing the historical access data of the user, the system can adjust the cache content in real time, actively load the data possibly required by the user and ensure that the high-frequency access data is always available, and the mechanism not only improves the data access speed, but also remarkably reduces the influence caused by network delay.

The invention discloses a single-file concurrent read-write method and system of a distributed file system. The method comprises the steps that S1, a conservative write range lock application request of a preset interval is sent to a metadata server; the range lock takes a block as the minimum granularity; s2, segmenting to-be-written data into a plurality of data blocks according to a preset block length, and applying for a corresponding locking interval in a local memory lock table according to a starting position and an ending position of each data block in a target file; judging whether the currently applied locking interval is overlapped with the registered locking interval or not; s3, if the data block is not in the write range lock, applying for an interval for expanding the write range lock from the metadata server; s4, distributing the segmented data block write-in requests to block engines of corresponding storage nodes, so that the block engines add data block mutual exclusion locks at corresponding positions; and S5, in response to a request of closing or refreshing the target file by the user, sending a request of releasing the write range lock interval. According to the method and the device, the performance is not reduced on the premise of improving the strong consistency.

The invention discloses a batch file intelligent processing method and system in office development. The method comprises the steps of receiving and verifying parameters including a source directory, a target directory, a processing range and the like; traversing the directory based on the related path and the processing range, generating a structure, and collecting information to establish a file index; positioning the changed file by means of a file index, carrying out multi-dimensional difference comparison and recording a result; detecting codes and row separators in parallel for files in the file index and a target file provided by a user, generating a repair strategy and executing format repair; analyzing the natural language instruction based on the replacement rule to generate an executable rule set, and executing batch processing operation on the processed files; and summarizing various results to generate and store an output report. According to the method, intelligent batch processing of the files is realized, and the file processing efficiency and accuracy in office development are improved.

The embodiment of the invention discloses a virtual file management method, system and device and a storage medium. According to the technical scheme provided by the embodiment of the invention, under the condition that the file request is received, the virtual path contained in the file request is extracted, the virtual path is created when the target file is generated, path classification is performed according to the module identifier of the associated target service module, and the target file is stored in the system path mapped by the virtual path. The system path is generated by mapping based on the virtual path and a pre-constructed mapping rule; mapping the virtual path into a corresponding system path based on a mapping rule; and accessing the target file based on the system path to execute a file operation corresponding to the file request. By means of the technical means, the situation that file directory structures of different service modules are disordered can be avoided, unified file management of the different service modules in the application is achieved, the file management efficiency of the different service modules is improved, the application service effect is improved, and therefore the user experience is improved.

The invention discloses a file hiding method and system based on an ext4 file system, and the method comprises the steps: obtaining a target file and metadata information of a directory where the target file is located according to a target file path needing to be hidden, and distributing a new mapping item in an internal mapping table of the ext4 file system for recording; creating a new hard link in a directory where the target file is located, and associating the new hard link with an inode node for storing metadata information of the target file; reopening the ext4 file system, and deleting the directory entry of the target file, so that the target file cannot be found in the ext4 file system; and re-mounting the ext4 file system, refreshing the Linux kernel cache, and recording the new hard link, the original name of the target file, the inode node number of the target file and the file type into a new mapping item. According to the invention, data security can be ensured, and efficient hidden storage of files is realized.

The invention relates to the technical field of data processing, and discloses a test case file conversion method and device, computer equipment and a storage medium. The test case file conversion method comprises the steps of obtaining a to-be-converted file, and analyzing the to-be-converted file according to a file type of the to-be-converted file to obtain file analysis data; performing conversion processing on the file analysis data according to a preset intermediate conversion rule to obtain an intermediate conversion file; obtaining format selection information, and determining a target file format and a target file template corresponding to the target file format according to the format selection information; and according to the intermediate conversion file and the target file template, generating a target conversion file corresponding to the target file format. According to the embodiment, a unified intermediate file processing mechanism is established, meanwhile, automatic processing of file conversion is achieved, the file conversion efficiency and accuracy are improved, and different scene requirements can be met.

The embodiment of the invention provides a key value data processing method, a database platform, equipment, a medium and a product, and the method comprises the steps that in response to a disk refreshing instruction of a target storage unit in a target partition, a target key value pair in a memory buffer area of the target storage unit is obtained, the target key value pair is any key value pair in the memory buffer area, and the target storage unit in the target partition is stored in the memory buffer area; the target key value pair comprises a target index key and a corresponding target data value; if the target data value is greater than the set size threshold value, writing the target data value into a data file, and writing a target index key and a target file path of the target data value in the data file into a disk storage file of a target storage unit, the structure of the data file is the same as that of the disk storage file, the data file and the disk storage file are stored in the same path, the recovery mechanisms of the data file and the disk storage file are different, and the data file and the disk storage file are distinguished through the set file mark added in the metadata area. The invasion to the database is small, and the write amplification is reduced.

The invention relates to a data processing method and device and a computer program product. The method comprises the steps of determining a physical address of a target file fragment on a storage medium; determining a target file record of the target file fragment from the metadata file, and determining a physical address of the target file record on a storage medium; and moving the target file fragment and the target file record to a target position of the storage medium based on the physical address of the target file fragment and the physical address of the target file record. Therefore, the I / O operation of the storage medium does not need to search and read the file fragments and the file records back and forth at a plurality of dispersed positions, so that the track seeking time and the data transmission delay of the storage medium are greatly reduced, and the problem of low I / O efficiency of the storage medium caused by file dispersion is directly solved; the scattered distribution state of the files and the file records on the storage medium is changed, and the layout of the files and the file records on the storage medium is optimized, so that the read-write efficiency of the storage medium is improved, and the hardware performance is brought into full play.

The invention relates to a target file updating method for an automobile open system architecture. The method comprises the following steps: acquiring an extensible markup language file generated in response to modification of a target variable of a constructed attribute type and a corresponding to-be-updated first target file; obtaining address information of the target variable in the first target file based on the extensible markup language file; and updating the value of the target variable in the first target file based on the obtained address information to generate an updated second target file. The invention further relates to a target file updating device of the automobile open system architecture, computing equipment, a computer readable storage medium and a computer program product.

The invention relates to a storage test vector generation method and device, equipment and a storage medium, and is applied to the field of semiconductor testing, and the method comprises the steps: obtaining a chip manual and a chip test plan of a to-be-tested chip, and generating a chip description file according to the chip manual and the chip test plan; carrying out abstract processing according to the chip description file, and generating a chip abstract model; converting test logic in a test algorithm into a test sequence according to the chip abstract model; and obtaining a target file format requirement of a target ATE equipment platform, and converting the test sequence according to the target file format requirement to generate a storage test vector. The method has the technical effects that the reusability of cross-platform use of the test vector is improved, the test development efficiency is improved, and the time is saved.

The embodiment of the invention discloses a file fragment uploading method and device, electronic equipment, a computer program and a storage medium. According to the embodiment of the invention, a to-be-uploaded file and file information are obtained, wherein the file information at least comprises a file size; segmenting a to-be-uploaded file according to the initial network speed of the current network to obtain a plurality of initial file fragments; uploading the initial file fragments to the server in sequence, and recording uploading time consumption and uploading rate corresponding to the initial file fragments; adjusting the size of the next initial file fragment according to the uploading time consumption and the uploading rate of the uploaded initial file fragment to obtain a target file fragment; and uploading the target file fragments to the server. Therefore, in the file uploading process, the real-time network state is determined according to the uploading condition of the uploaded fragment by adopting a mode of'dynamic fragment uploading + network self-adaption ', and the size of the fragment is dynamically adjusted according to the real-time network state, so that the file uploading success rate and the user experience are improved, and the method is flexibly applied to various large file uploading scenes.

The invention discloses a de-signed binary code reverse analysis method based on library function matching. The method comprises the following steps of: obtaining de-signed binary codes and a candidate library file list thereof in the embedded equipment, and extracting a library function and information of each object file of each candidate library file; performing matching operation on each object file in sequence to establish a library function matching table; and acquiring addresses for calling other library functions in each library function, performing consistency comparison with the addresses of the successfully matched library functions, and confirming the calling relationship of the library functions, thereby determining the function of the de-signed binary code in the embedded equipment. According to the method, the library function in the de-signed binary code can be accurately identified, the calling relation is checked, and the method is suitable for component analysis and traceability of scenes such as computer programs, embedded firmware and DSP programs so as to accurately identify the function of the de-signed binary code in embedded equipment.

Techniques are provided for replicating clone files from a source file system to a destination file system in a computing system. A file system of a first storage node may be replicated to a second storage node such as for data protection and backup purposes. The file system may include clone files that were created as clones of parent files. The clone files may have been created in a storage efficient manner where a clone file refers to data of a parent file, instead physically storing duplicate instances of the parent data of the parent file. The techniques provided herein are capable of replicating the clone files to the second node while preserve the storage efficiency of the clone files.

The invention discloses a code engineering automatic compiling construction method without appointing source code file paths one by one, and belongs to the technical field of software engineering. According to the method, makefile files are created under a code project path, unified src and inc folders are created in each level of catalog of a project to store source files and header files respectively, all file paths are obtained through automatic search, compiling and linking automation is achieved through a mode rule, and automatic generation of a dependency relationship and project solution construction are supported. The invention further provides a compiling construction method of the multi-code project. According to the method, the problem that Makefile or IDE setting needs to be repeatedly modified when code files are added and deleted and paths are modified is solved; the defect that code source file retrieval paths, header file retrieval paths, header file paths depended by compiling of source files and required object file paths need to be manually specified one by one for compiling in the prior art is overcome.

The invention discloses a file pre-reading method and device, a medium and equipment, and the method comprises the steps: firstly obtaining a file type of a target file, and executing pre-reading processing through a pre-reading window only when the target file is a continuous file; and dynamically adjusting the size of the window in combination with the hit condition of the pre-reading content on the basis: increasing the window in hit to improve the sequential reading efficiency, and reducing the window in miss to reduce the invalid pre-reading proportion. Through the above self-adaptive adjustment mechanism based on hit feedback, the size of the pre-reading window can be flexibly optimized for different access modes, and excessive pre-reading caused by a fixed pre-reading window in a random access or access mode change scene is avoided, so that unnecessary memory occupation and input and output resource waste are reduced, and the stability of reading performance is kept.

The invention discloses a file access cold and hot degree calculation method and system based on a large model and a medium, and belongs to the technical field of data storage. The method comprises the following steps: a system initialization and monitoring configuration stage: initializing a cold and hot degree calculation algorithm, and loading a pre-deployed large language model; a multi-dimensional feature extraction stage: extracting a multi-dimensional feature vector of the target file in real time; in the dynamic prompt generation stage, the multi-dimensional feature vectors are dynamically arranged into structured natural language prompts, and the structured natural language prompts are input into a large language model; in the popularity generation and cache management stage, a popularity score of each file is generated, and the cache space is managed according to the popularity score; and in the adaptive learning and optimization stage, an implicit user feedback loop is established, and when feedback signals with preset numerical values are accumulated, increment fine tuning is carried out on the large language model according to the collected feedback data. According to the method, the cache hit rate is remarkably improved, and the access fluency of the key data of the user is guaranteed.

The invention discloses a method and a system for realizing compatible file hard link and S3 shallow copy based on a distributed key-value pair, a file metadata key-value pair is used as a metadata storage main body of a file or a directory, a key consists of a file system ID (Identity), a parent directory ID and a file or directory name, and a value contains metadata information; a reverse index file handle key value pair is introduced to serve as a unique invariant identifier, a key is composed of a file system ID, an initial parent directory ID, an initial file or first N characters of a directory name and a file ID, and a value contains a current file metadata key and a reference count. When files or directories are created and deleted, the files or the directories are located at the same one-key value pair node in a large probability, and one-stage submission is supported to improve performance; hard linking and S3 shallow copying are achieved at the same time, independent file metadata key-value pairs and reverse index file handle key-value pairs are created for the hard linking and the S3 shallow copying, reverse index file handle keys of the target file are recorded by file metadata values of the file metadata key-value pairs, reference counts of the reverse index file handle values of the target file are updated, and performance and compatibility are both considered.

The invention provides a file monitoring method and electronic equipment. The method comprises the steps that in the running process of a first operating system, kernel codes are changed, so that an initial inotify event processing function in a kernel is replaced with a preset inotify event processing function; obtaining a target file operation event and target context information for the target file through a preset inotify event processing function; wherein the target file operation event and the target context information are determined by a preset inotify event processing function based on a preset first configuration file, and the first configuration file is used for recording at least one target file; and recording the target file operation event and the target context information in a kernel log. According to the method, the key file operation can be ensured to be captured in time by dynamically replacing the inotify event processing function and adding the context information of the file operation. Therefore, the electronic equipment can accurately restore the whole event occurrence process in the process of problem positioning and troubleshooting, so that the maintainability of the system is greatly improved.

The invention relates to a CSS file generation method and device, computer equipment and a storage medium. The method comprises the steps of obtaining a design drawing and a target HTML file; performing visual feature extraction on the design drawing to obtain visual features; performing semantic analysis on the target HTML file to obtain semantic features; according to the visual features and the semantic features, matching the visual style and the layout structure of each visual element in the design drawing with each HTML element in the target HTML file to obtain a CSS atom class; generating a CSS file according to the CSS atom class; the CSS file is used for rendering a target page matched with the design drawing. According to the content, the CSS atom class is obtained through automatic matching, manual writing is not needed, and therefore the generation quality and the generation efficiency of the CSS file are improved.

Systems and methods obtain a translation request accompanying source code of source file(s) for conversion. Formatting of the source code of the source file(s) is verified and the source code is converted to target code that includes target file(s). The converting (i) maps programming language functions of the source code to corresponding programming language functions of the target code and (ii) utilizes, through customized prompt template(s), one or more large language models (LLMs) hosted by a cloud platform during the code conversion, where a source application that uses the source code includes TIBCO™ software. The target file(s) are distributed.

The invention relates to a file outgoing leakage prevention method and system, electronic equipment and a storage medium. The method comprises the following steps: capturing a file outgoing operation behavior in real time, and determining an outgoing target file; analyzing the outgoing target file to obtain feature information of the outgoing target file; identifying the feature information by using a pre-trained deep learning model, and determining whether the outgoing target file contains sensitive information; if yes, multi-dimensional risk assessment is carried out on the file outgoing operation behavior, the risk level of the file outgoing operation behavior is determined, and the multi-dimensional risk assessment comprises behavior abnormality, transmission channel risk degree, operation frequency abnormality and content sensitivity; and dynamically managing and controlling the outgoing target file according to the risk level. According to the method, real-time capture, accurate detection and dynamic management and control of file outgoing are realized, the accuracy and coverage range of sensitive content identification and risk identification are improved, and both information security and service efficiency are considered.

The embodiment of the invention provides a data processing method and device based on a graphics processor, equipment and a storage medium, and the method comprises the steps: responding to a data processing request of a large model application, accessing a target file system in a user mode, and obtaining an access position of target data corresponding to the data processing request in the target file system, the target file system is used for managing the storage unit, and the target data is persistent data stored in the storage unit; creating a data transmission path between the storage unit and the graphics processor based on the access position; and based on the data transmission path, calling a graphics processor to process the target data, and generating a request result corresponding to the data processing request. By accessing the target file system for uniformly managing the storage unit, the graphics processor can directly read and write data for the storage unit, and the efficiency of processing the target data corresponding to the data processing request by the graphics processor is improved.

The invention relates to the field of artificial intelligence, can be applied to business system platforms of financial science and technology, medical health and the like, and discloses an automatic mounting method, device, equipment and medium based on a cloud hard disk, comprising: in response to a cloud hard disk purchase request submitted by a user, creating a cloud hard disk of a corresponding specification and obtaining a file system path specified by the user; creating a corresponding target file system on the cloud host according to the file system path; initializing the cloud hard disk into a physical volume, creating a volume group based on the initialized physical volume, and then configuring a logical volume; and mounting the configured logical volume to the target file system, carrying out mounting verification, and outputting corresponding mounting state information according to a verification result. According to the method, the file system is automatically created based on the file system path specified when the user purchases the cloud hard disk, and the logical volume is configured and automatically mounted, so that the user does not need to perform manual configuration operation, the use process of the cloud hard disk is greatly simplified, and the configuration efficiency of the cloud hard disk is improved.

The invention relates to a file management method and device based on an enterprise think tank, equipment and a storage medium. The method comprises the following steps: in response to a detected uploading operation of a user, allocating available analysis resources for a target file according to resource load information and the priority of the target file; the uploading operation is used for indicating that the target file is uploaded to a target folder in the enterprise shared disk; based on the available analysis resources and an analysis mode corresponding to the target file, analyzing the target file to obtain text content of the target file; performing encryption processing on the text content of the target file to obtain encrypted text content; and performing vector conversion on the encrypted text content to obtain a text vector, and storing the text vector into a vector database corresponding to the target folder. By adopting the method, the performance bottleneck and the data security risk of a traditional enterprise think tank system in a limited computing power environment can be solved.

Embodiments of the present disclosure provide a file processing method and apparatus, and an electronic device. The method includes: acquiring additional data written to a file end of a target file, where data in the target file is stored based on a strip, and a data end of the additional data is located in a middle of a target strip; obtaining a corresponding redundant storage policy according to an occupancy of the additional data in the target strip, and generating a restoration record of the additional data based on the redundant storage policy; and writing the restoration record into a disk.