1744 results about "File system" patented technology

A video gateway system at a worksite is coupled to multiple cameras on a network, and backs-up video streams generated by the cameras to a backend cloud backup video storage system and a frontend (cache) video storage system. The video gateway system generates an aggregated video asset from a plurality of streams of video from the multiple cameras, and generates metadata and a backup report associated with the video asset. The video asset, metadata, and backup report are stored on the backend cloud backup video storage system in an file system, and are also stored on the frontend (cache) video storage system such that for at least a period of time, the video asset and the associated the metadata and backup report are stored on both the cloud backup video storage system, facilitating quick access and retrieval to the stored video for retrieval for streaming, activity detection, and other uses.

Techniques are described for enabling concurrent cross-region replications and garbage collection while maintaining consistency and data integrity among file systems. In some embodiments, techniques for garbage collection fencing utilize a system-level garbage fencing key (GC fencing key) and one or more job-level GC fencing keys in a source file system that perform one or more cross-region replications with one or more target file systems, one replication and one job-level GC fencing key per target file system. In some embodiments, one job-level GC fencing key in a source file system and one job-level GC fencing key in a source file system together provide garbage fencing for a cross-region replication. In certain embodiments, the metadata information in a GC fencing key can inform, instruct, or be used to configure garbage collectors to skip garbage collection for a range of snapshots in a file system.

Techniques are described for enabling concurrent and non-blocking replication object deletion during cross-region replications. In some embodiments, in a target file system, a target replication pipeline as part of a cross-region replication, and a deletion pipeline operate in parallel. The deletion pipeline deletes processed objects reaching the last pipeline stage of the target replication pipeline after each checkpoint in the target replication pipeline. In some embodiments, after a non-recoverable failure during the cross-region replication, the cross-region replication can be restarted from the beginning (i.e., fresh restart) without waiting for its unused objects in the Object Store to be deleted by utilizing a generation number associated with each object to delete the unused objects in a background process while allowing deleting processed objects as normal for the freshly restarted cross-region replication.

A snapshot of metadata of a file system on a source storage system is stored in one or more of storage devices of a target storage system. A request to access data stored in the file system is received. A portion of the metadata including identification information of the data is identified. The data stored in the file system is retrieved by providing the source storage system with the identification information of the data.

The invention discloses an intelligent resource scheduling method and system based on task characteristics and system state perception, and relates to an operating system kernel optimization technology. According to the method, resource demand types, importance labels and time sensitivity of tasks are captured in real time through an eBPF technology, system bottlenecks are recognized by combining / proc and sysfs file system data, a dynamic scheduling strategy is generated by adopting an improved Q-Learning model, and resource allocation is executed through a schemed * function and a cgroup v2 interface. The problems that a traditional scheduler is poor in self-adaptive capacity and resources are mismatched are solved, the actually-measured resource utilization rate is increased to 85%-92%, and the key task delay standard reaching rate gt is achieved; the method is suitable for edge computing, cloud servers and other high-concurrency scenes.

The invention relates to a notebook software vulnerability scanning method based on a security policy. According to the method, firstly, a security policy library of a target notebook is obtained, and the security policy library comprises access control rules, data operation limiting conditions and vulnerability detection reference requirements for different software types; collecting software running data of the target notebook computer, wherein the software running data comprises current running process information, file system operation records, network connection states and software configuration parameters; performing matching analysis on the software operation data and the security policy library to generate a preliminary scanning result; evaluating the risk level of the software vulnerability according to the preliminary scanning result; and finally, based on the risk level and the repair guide terms in the security policy library, generating software vulnerability repair guide information. Therefore, notebook software vulnerabilities can be scanned comprehensively and accurately, and effective repair guidance is provided.

Ransomware detection accuracy is improved by analyzing patterns of changes in filename extension counts, relative to each other, that occur in a file system over time. The disclosed approach is malware-agnostic and does not rely on recognizing malware extensions or on real-time monitoring of the target file system. Instead, during each successive backup job of the target file system, the disclosed technology counts different types of filename extensions and compares the counts to each other and to corresponding counts taken in earlier backup jobs. Preferably, the anomaly detection analysis uses machine learning to discern a behavior pattern of the file system, which indicates how filename extensions are distributed and how much they change between backup jobs over time.

Embodiments manage data in a file system over a network. A plurality of file system operations in the file system may be executed based on a file system client action or a file system administrative action such that the file system may be integrated with a network. Characteristics of the plurality network components in the network infrastructure that may be associated with the file system may be determined. Tests may be generated based on the characteristics of the network components such that the tests may be executed to evaluate the network components. Results of the tests may be employed to perform further actions, including determining non-compliant network components based on the results; modifying the network infrastructure based on the non-compliant network components such that one or more of file system operations are modified based on the non-compliant network devices; executing the modified file system operations on the modified network infrastructure.

Techniques are described for performing different types of restart operations for a file storage replication between a source file system and a target file system in different cloud infrastructure regions. In certain embodiments, the disclosed techniques perform a restart operation to terminate a current cross-region replication by synchronizing resource cleanup operations in the source file system and the target file system, respectively. In other embodiments, disclosed techniques perform a restart operation to allow a customer to reuse the source file system by identifying a restartable base snapshot in the source file system without dependency on the target file system.

The invention relates to a mirror image file processing method and device, and relates to the technical field of container mirror image generation. The method comprises the steps of obtaining target file system directory information of a target container in response to a mirror image file export request for the target container; the target file system directory information of the target container is used for representing file system directory information of a writable layer of the target container; comparing the target file system directory information of the basic mirror image with the target file system directory information of the target container to obtain a difference file of the target container relative to the basic mirror image; constructing a layer file of a new incremental layer based on the difference file; writing a layer file of the incremental layer into a mirror image layer file directory of the basic mirror image, and updating a list file and an index file of the basic mirror image to obtain a mirror image file of the target container; the manifest file comprises metadata of each mirror image layer in the basic mirror image, and the index file comprises metadata of the manifest file. By adopting the method, the export efficiency of the container mirror image file can be improved.

The invention provides a method, a system and equipment for improving the computing performance stability of a hardware platform and a medium, and belongs to the technical field of computer system performance optimization. The method comprises the following steps: acquiring architecture characteristic data of a bottom hardware platform through a hardware detection tool, and generating and loading a first-stage system kernel parameter configuration based on the architecture characteristic data; reading the architecture characteristic data, carrying out behavior analysis and type identification on the running process based on the architecture characteristic data, and generating a second-level process scheduling strategy according to the behavior analysis and type identification; reading cache structure information in the architecture characteristic data, and driving a file system to intelligently prefetch and reconstruct a storage layout of memory data based on the cache structure information; and continuously collecting performance index flow data when the system runs, performing real-time analysis on the performance index flow data by using a performance degradation model, generating a feedback control instruction according to an analysis result, and dynamically correcting the kernel parameter configuration of the first-stage system and the scheduling strategy of the second-stage process.

Embodiments manage data in a file system. A plurality of file system operations may be executed in the file system based on a file system client action or a file system administrative action such that the file system may be integrated with an infrastructure of the network that includes network devices. Messages associated with some of network devices may be employed to perform one or more actions, including: determining one or more file system operations of the plurality of file system operations that may be associated with the network devices based on the messages; modifying the infrastructure associated with the network devices in response to the messages or the one or more file system operations; modifying the one or more file system operations in response to the modified infrastructure; executing the one or more modified file system operations; or the like.

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

A system can include a memory device comprising a plurality of dynamic capacity devices and a processing device, operatively coupled with the memory device. The processing device is configured to perform operations including sending, to a memory device, an allocation request to allocate, for a file system, a first memory section of a plurality of memory sections of a plurality of dynamic capacity devices associated with the memory device; reserving, for the file system, a first portion of the first memory section for storing file metadata of file system data; reserving, for the file system, a second portion of the first memory section for storing file data of file system data; sending, by a first process running on the host system, to the memory device, the file metadata for storing the file metadata in the first portion of the first memory section; sending, by a second process running on the host system, to the memory device, a second request to modify the file metadata stored in the first portion of the first memory section; and receiving, from the memory device, a second response indicating an error regarding the second request.

Techniques for implementing a scalable automated training framework for anomaly and ransomware detection are disclosed. In some embodiments, a computer system performs operations comprising: instantiating a plurality of virtual machines, each one of the virtual machines being loaded with a corresponding file system; simulating user actions and ransomware on the virtual machines, the simulating of user actions and ransomware on the virtual machines causing changes to the corresponding file systems of the virtual machines; for each one of the plurality of virtual machines, generating a corresponding metadata file based on one or more corresponding snapshots of the virtual machine, the one or more corresponding snapshots indicating the changes to the corresponding file system of the virtual machine; and training a ransomware detection model using a machine learning algorithm and training data, the training data being based on the corresponding metadata files of the virtual machines.

The invention discloses a PDF (Portable Document Format) document structured extraction system based on a multi-modal language model, belongs to the technical field of document processing and optical character recognition, and aims at solving the technical problem of how to improve the existing OCR (Optical Character Recognition) technology to improve the analysis capability of a complex document structure and improve the recognition precision of handwritten forms and other non-standard fonts. According to the technical scheme, the system adopts a layered decoupling architecture and comprises an input layer, a preprocessing layer, a reasoning layer, an output layer and a monitoring and fault-tolerant module; wherein the output layer is used for multi-source data access and path management to realize a local file system or S3 cloud storage; the preprocessing layer is used for invalid document filtering and visual feature extraction; the reasoning layer is used for multi-modal model interaction and content processing; the output layer is used for outputting a content aggregation result; and the monitoring and fault-tolerant module is used for realizing real-time state monitoring, resource consumption analysis and exception handling.

Providing issue resolution in a cluster system by monitoring system operation to detect occurrence of a system error, and automatically generating, upon detection of the error condition, a core file for a user node. The core file captures a current memory state of a respective node, where the current memory state comprises system statistics, system information, and logs. An intelligent core debugger extracts information from a core file to generate a core file report that is sent to a vendor for a quick determination of whether sufficient information is in the report to allow the vendor to recommend a fix, or whether further information from is required, including the core file itself, if necessary. This prevents the need to send an entire core file to a vendor in every instance of a system fault.

The invention provides a file system client kernel mode and user mode communication method based on asynchronous communication. According to the asynchronous communication-based file system client kernel mode and user mode communication method provided by the embodiment of the invention, the context switching overhead of communication between the user mode and the kernel mode can be reduced, the data transmission throughput is improved, the resource utilization rate is optimized through dynamic queue management, and the problem of performance bottleneck in a high-concurrency scene is effectively solved.

The invention discloses a virtual desktop sandbox isolation system, method and equipment for Windows and a medium, and relates to the technical field of computers. The system comprises a virtual desktop management module, a sandbox isolation module and a resource access control module. A virtual desktop management module creates and manages a virtual desktop, a sandbox isolation module generates an independent sandbox environment for each desktop, cross-desktop process communication is prevented, and file write operation redirection and external access interception are respectively realized by means of a resource access control module and through an API hook and dynamic link library injection technology. And redirection and access control of network communication to a VPN network channel. Therefore, systematized deep isolation is realized at the desktop level. Through deep binding of the virtual desktop and the sandbox environment, desktop-level file system redirection, network channel isolation and process communication blocking are achieved, and the security requirement for reliable, seamless and deep isolation between different virtual desktops is met.

Techniques are described for maintaining data consistency when failure events occur during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, two generation numbers (or different identifications) are assigned to two groups of processed B-tree key-value pairs, one before and one after a failure event, within a key range. In some embodiments, the two generation numbers are assigned to a group of B-tree key-value pairs processed by a failed thread and another group of B-tree key-value pairs processed by a substitute thread taking over the failed thread to avoid potential data corruption.

The invention discloses a single-file concurrent read-write method and system of a distributed file system. The method comprises the steps that S1, a conservative write range lock application request of a preset interval is sent to a metadata server; the range lock takes a block as the minimum granularity; s2, segmenting to-be-written data into a plurality of data blocks according to a preset block length, and applying for a corresponding locking interval in a local memory lock table according to a starting position and an ending position of each data block in a target file; judging whether the currently applied locking interval is overlapped with the registered locking interval or not; s3, if the data block is not in the write range lock, applying for an interval for expanding the write range lock from the metadata server; s4, distributing the segmented data block write-in requests to block engines of corresponding storage nodes, so that the block engines add data block mutual exclusion locks at corresponding positions; and S5, in response to a request of closing or refreshing the target file by the user, sending a request of releasing the write range lock interval. According to the method and the device, the performance is not reduced on the premise of improving the strong consistency.

The invention relates to the technical field of data backup, and discloses an iOS device data backup and recovery method and system, and the method comprises the steps: carrying out the SSL certificate verification and EscrowBag key authentication of an iOS device, and obtaining a data path list; according to the data path list, parallel scanning of APFS file system B-Tree traversal, NAND flash memory page reading and SQLite WAL log analysis is carried out on the iOS device storage partition, and an original data set is obtained; performing integrity evaluation based on the original data set to obtain an effective data set and constructing a virtual file index; the data selection list of the user is confirmed based on the virtual file index, safety recovery is executed, and a data recovery result is returned. The SQLite page Cell reconstruction and fragment file signature matching technology is combined, intelligent repair and quality prediction can be conducted on damaged data, the user experience and operation efficiency are improved, and the user experience is improved. And the security and the reliability in the data recovery process are ensured.

A file system in a user space partition of virtual memory may be mounted by a computing device that runs a virtual machine which includes a set of storage disks. The file system in user space may then expose one or more virtual files associated with one or more storage disks that correspond to one or more loop devices configured to map files of the virtual machine to the one or more virtual files. The computing device may then receive a request to read a data block stored at the virtual machine and may identify a file and corresponding virtual file that stores the requested data block based on a set of metadata provided by the loop devices. The computing device may then determine the location of the data block stored at the virtual machine, and may read the data block from the determined location.

The invention relates to a BMC firmware mirror image recovery method and device and terminal device.The method comprises the steps that a storage area of a preset storage chip is divided into multiple areas, and the multiple areas comprise a first area and a second area; a first file in the firmware mirror image file is coded through a forward error correction algorithm, redundant recovery data is obtained, backup files of second files except the first file in the firmware mirror image file are obtained, and the first file comprises a root file system; the first file and the redundancy recovery data are stored in the first area, and the second file and a backup file of the second file are stored in the second area; when it is detected that the first file is abnormal, the first file is recovered based on the redundant recovery data through a forward error correction algorithm; and when detecting that the second file is abnormal, recovering the second file through the backup file of the second file. According to the method and the device, the problem that the reliability of recovering the firmware mirror image file through out-of-band network transmission is relatively low is solved.

The embodiment of the invention provides a process interception method and device and electronic equipment. The method comprises the following steps: a kernel space receives a process protection list sent by a user space by utilizing a virtual file system interface; wherein the process protection list comprises a process identifier of at least one to-be-protected process; the kernel space obtains a process termination request; wherein the process termination request is used for requesting to terminate a target process, and the target process is a process entity scheduled by an operating system; under the condition that the kernel space determines that the request type of the process termination request is a preset request, determining a matching relationship between the target process and a process protection list based on a target process identifier of the target process; and when the matching relationship indicates that the process identifier of the at least one to-be-protected process in the process protection list comprises the target process identifier, the kernel space intercepts the process termination request. By the adoption of the method, the important process can be effectively prevented from being terminated due to malicious or misoperation, and the safety and stability of the system are improved.

The invention discloses a data security protection method and system for large model training. The core of the method is that a data safe box trusted application (TA application) is deployed in a trusted execution environment (TEE) and cooperatively works with a user-defined virtual file system driver at a host machine side, so that an end-to-end secret state data access control link is constructed. Before encryption protection of sensitive data, a measurement value (including code hash, configuration parameters and a runtime state) of a current TEE instance is submitted to a remote verification service through a data safe box TA application, and the verification service only sends the measurement value (including code hash, configuration parameters and a runtime state) of the current TEE instance to the remote verification service after confirming that the TEE environment meets a preset security policy (such as a kernel version, a software version and configuration parameter compliance). And generating a secret key encrypted by a custom virtual file system on a host machine side through derivation. And malicious copying of a system memory and a storage medium is prevented, so that the traditional attack defense capability is effectively improved.

A system can include a memory device comprising a plurality of dynamic capacity devices and a processing device, operatively coupled with the memory device. The processing device is configured to perform operations including receiving, from a host system, a request to perform a computational operation on first file system data, wherein the request comprises an identifier of the first file system data and specifies the computational operation, wherein the first file system data is stored in a first memory section of a plurality of memory sections of a plurality of dynamic capacity devices of a memory device, wherein the first memory section is associated with a first tag; performing the computational operation on the first file system data to obtain second data; determining a second memory section of the plurality of dynamic capacity devices and associating the second memory section with a second tag; and storing the second data in the second memory section associated with the second tag.

The invention is suitable for the technical field of system fault monitoring, and provides a system fault monitoring method based on log real-time synchronization and active scanning, and the method comprises the steps: capturing a log increment in real time through a file system event monitoring trigger, analyzing a newly added log content, and synchronizing the log increment and the newly added log content to message middleware; a distributed active scanning unit is configured, the scanning period is dynamically adjusted, and node resources are expanded and shrunk based on the containerization technology; integrating the abnormal data of the user side, the interface state data of the server side and the log stream data, and constructing a multi-modal data set; a normalized error report increment is calculated based on a 30-minute sliding window, and a pre-processing instruction is generated in combination with a random forest algorithm and Bayesian optimization; executing corresponding operation according to the pre-processing instruction; according to the method, a traditional passive mode is broken through, the fault monitoring confidence coefficient is remarkably higher than that of an industry standard, sub-health perception and active blocking of a high-concurrency scene are supported, and a real-time and accurate intelligent operation and maintenance solution is provided for a complex system.

The invention discloses a process file system access optimization method and device based on an eBPF. The method comprises the following steps: collecting information of a procfs node through an eBPF program, and writing the information into eBPF annular buffer mapping mapped to address spaces of a plurality of user processes; the user process calculates a hash identifier according to the target procfs node path and searches a corresponding mapping item in a shared annular array based on the hash identifier, and the mapping item comprises an annular buffer address pointing to target procfs node information stored in eBPF annular buffer mapping; and if the searching is successful, reading the information of the target procfs node according to the address of the ring buffer. According to the method and the device, the problem of low efficiency of tools in the prior art, such as ps, when the system process information is acquired can be solved on the premise of ensuring the security.