2053results about "File system functions" patented technology

In order to manage stale data on a network of computer systems, a file harvester agent may be configured with a list of stale data files to be deleted. The file harvester agent may be deployed to the computer systems of a network. When executed in a computer system, the file harvester agent searches the file system of the computer system to locate any files or data indicated in the file list. Any located data files are deleted. Once the agent has finished processing the file list on a computer system, the agent can copy or replicate itself to other computer systems of the network in accordance with a pre-configured itinerary.

A method, system, and apparatus for verifying integrity and execution state of an untrusted computer. In one embodiment, the method includes placing a verification function in memory on the untrusted computer; invoking the verification function from a trusted computer; determining a checksum value over memory containing both the verification function and the execution state of a processor and hardware on the untrusted computer; sending the checksum value to the trusted computer; determining at the trusted computer whether the checksum value is correct; and determining at the trusted computer whether the checksum value is received within an expected time period.

File mapping and converting for dynamic disk personalization for multiple platforms are provided. A volatile file operation is detected in a first platform. The file supported by the first platform. A determination is made that the file is sharable with a second platform. The volatile operation is performed on the file in the first platform and the modified file is converted to a second file supported by the second platform. The modified file and second file are stored in a personalized disk for a user. The personalized disk is used to modify base images for VMs of the user when the user accesses the first platform or second platform. The modified file is available within the first platform and the second file is available within the second platform.

The embodiment of the invention provides a file merging method and device. The file merging method comprises the steps of carrying out partitioning on sections in the charge of nodes in a cluster system according to key value information of user data, determining that each node meets a first triggering condition, reading at least two first files from disks of the nodes to caches corresponding to the nodes, respectively determining the target partition which each key value belongs to according to the key values of the data, corresponding to users, stored in the first files, merging the data with the same key value, and storing the merged data corresponding to the key values into the corresponding target partitions. Partitioning is carried out on the sections in the nodes, the data are merged once, and the data with the same key value are stored in the same partition. In the inquiry process, the partitions where the data are located are determined according to the key values, and then the files in the partitions are scanned. As the number of the files in each partition is small, data screening only needs to be carried out on fewer files, and therefore the read performance is improved.

There are provided a file management server for ensuring security in a cloud computing environment, and a file management method thereof. The file management server includes: a file registration unit configured to store a file in a plurality of chunk servers, and to manage a security level of the file; and a file search unit configured to receive a file access request from a client module, to check a security level of a file corresponding to the file access request, to notify, if the security level of the file is equal to or higher than a predetermined security level, the file's owner that a request for accessing the file has been made.

A method of operating a file system in a host configured to store write data in a data storage device including a first region and a second region is disclosed, and includes; receiving a write data request for write data associated with a file, classifying the write data as hot data or cold data using file meta data for the file, and if the write data is classified as hot data, storing the write data in the first region, and otherwise if the write data is classified as cold data storing the write data in the second region.

The invention discloses a method for identifying and saving a file to be downloaded and quickly searching for the downloaded file through a mobile terminal. The method comprises the steps that a preset folder is set in advance; in the downloading process of the file, the file to be downloaded is identified, and format type information of the file to be downloaded is obtained; the format type information of the file to be downloaded and matching information corresponding to the preset folder are judged and correlated to generate storage path information; storage path confirmation information and file name confirmation information are displayed, and a file downloading instruction is executed after the storage path confirmation information and the file name confirmation information are confirmed by a user; after the file is downloaded, a window interface is popped up, and then voice named audio of the downloaded file and the downloaded file can be opened. A device for identifying and saving the file to be downloaded and quickly searching for the downloaded file through the mobile terminal comprises a storage unit, a file identifying unit, a file judgment unit, a file processing unit, a path display unit, a path providing unit, a voice analysis engine and a voice processing engine. The method and device can facilitate downloading of the file and search for the downloaded file by the user.

A method of identifying an event associated with consumption of a utility comprising the steps of: generating a utility consumption profile from utility consumption data, the utility consumption data comprising a plurality of utility consumption values measured at a corresponding plurality of measurement points; wherein generating the utility consumption profile comprises the step of determining a gradient of rate of change of utility consumption between consecutive measurement points; identifying measurement points at which a change in gradient exceeds a predetermined threshold; and storing in the utility consumption profile the utility consumption value at measurement points where the threshold is exceeded; and identifying an event within the utility consumption profile that matches the profile of an event stored in a database of utility consumption profiles.

The invention provides a running method of a data analysis workflow. According to the obtained configuration information of the data analysis workflow, the running mode of each workflow module of thedata analysis workflow is determined, and the association relationship among the workflow modules is determined. Finally, the data analysis workflow is run based on the determined association relationship and the running mode. The invention also provides a data analysis system and a storage medium. By determining the operation mode of each workflow module and the correlation relationship between the workflow modules, The data analysis workflow can be run in a single computer and/or distributed mode flexibly, and the fine balance between resource consumption and data analysis can be flexibly configured when the big data analysis system is used to process the big data service, so that the efficiency of the big data analysis system can be improved.

The invention discloses a log analysis method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining an input data set which is data with a unified data structure after the standardization of the obtained original log data; inputting the input data set into a preset exception analysis model to generate exception data, the exception analysis model being arecurrent neural network model which is trained to a convergence state in advance and is used for extracting the exception data in the log data; and performing association processing on the abnormaldata based on a preset abnormal historical database. According to the method, the original log data from different servers can be quickly acquired; the log data is subjected to standardization processing to have the same data structure, and then the log data is subjected to anomaly identification by adopting the recurrent neural network model, so that even if the data volume is huge, the log datacan be rapidly identified, and the abnormal data is subjected to correlation processing to accelerate the abnormal data processing speed and improve the abnormal data processing accuracy.

The invention discloses a fault root cause analysis method, device and equipment, and a storage medium. The method comprises the steps of obtaining original time sequence information of multiple to-be-analyzed indexes corresponding to a to-be-analyzed component set; determining implicit sequence mode features based on the original time sequence information; obtaining an alarm log of each componentin the to-be-analyzed component set in a first preset time range; determining an alarm log text feature corresponding to the alarm log of each component in the first preset time range; based on a root cause association probability analysis model, according to the alarm log text features and the implicit sequence mode features, carrying out fault root cause association probability analysis on thecomponents in the to-be-analyzed component set to obtain fault root cause association probabilities among the components in the to-be-analyzed component set; and determining a fault root cause association relationship between the components according to the fault root cause association probability. By utilizing the technical scheme provided by the invention, the fault root cause association relationship between the components can be efficiently and accurately determined in fault detection, and the reliability of fault root cause analysis is improved.

Systems and processes provide network clients on various platforms a customized file system experience on demand while managing files (e.g., computer animation files) across a variety of storage devices spread across a network of arbitrary size (local area networks, wide area networks, worldwide networks, the world wide web, etc.). Clients may specify a set of requirements for an instantiation of a file system interface or object for a given application. Such requirements may include storage location, file quality, capacity, scale, permanence, speed, and the like. The system may then provide to the client a customized file system interface with particular hardware resources allocated to satisfy the designated file system requirements. The file system interface may coordinate file delivery, allocation, tracking, transportation, caching, deletion, and the like. The system may manage and allocate hardware resources ranging from a local client computer to distant hard drive banks across the world.

A method is used in recovering from metadata inconsistencies in storage systems. A metadata inconsistency is detected in a portion of a file system. The file system is managed by upper-layer component. The portion of the file system is recovered. Lower-layer component recovers the portion of the file system. The portion of the file system is validated. The upper-layer component validates the portion of the file system.

Techniques for fingerprinting and aggregating a virtual private cloud (VPC) flow log stream are provided. Each VPC flow log event in the VPC flow log is first determined to be a request event or a response event. A fingerprint is then generated for each VPC flow log event. The fingerprint for a VPC flow log event is generated based on the determination whether the VPC flow log event is a request event or a response event and by concatenating and encoding data contained in a set of data fields corresponding to the VPC flow log event. Based on the fingerprint generated for each VPC flow log event, related events can be detected and aggregated to form an aggregated event. Information stored with each aggregated event can then be used to better monitor the VPC.

The invention provides a repairing method and device of a file system directory tree. Parent directory path information is added into the metadata of each directory; when metadata in the directory tree is damaged, the metadata is traversed, N sub-directory trees are constructed according to sub-directory path information in the metadata of each directory; then, according to the parent directory path information of a sub root directory of a sub directory tree, the damaged directory is determined; according to the parent directory path information of the sub root directory of the sub directory tree, the metadata of an R-level upper directory adjacent to the sub root directory is reconstructed, i.e., the metadata of the damaged directory is reconstructed; and according to the reconstructed metadata of the R-level upper directory adjacent to the sub root directory, the N sub directory trees are constructed into one directory tree. Therefore, an original file system directory tree is reduced, and influence caused by the damage of the file system directory tree is reduced.

The invention discloses a data storage method and device. The data storage method includes the steps that an encoding algorithm is selected in advance, and value taking intervals of codes are segmented; identification information of target data files are encoded by means of the encoding algorithm; according to the encoding result, multiple data files in the same segmentation of encoded values are integrated and stored. By the adoption of the technical scheme, a proper encoding mode is selected in advance, the encoded value taking intervals are segmented, and then the data files in the same segmentation are integrated and stored according to the encoding result through identification of the data files. Compared with the prior art, file fragmentations are reduced because of integration and storage of the data files, and storage efficiency and query efficiency can be obviously improved.

The present application provides a method and apparatus for cleaning a log file cache. According to the specific path to build log file storage mode, the log record cache arranged in chronological order is stored according to log type and the log ID classification, so that the number of log caches traversed and cleaned up by the system is greatly reduced, and the system cleanup process delay is reduced. In addition, the method of setting a fixed time to clean the cache file in the prior art cannot be combined with the actual system memory usage, so that the resource is often wasted in actual use. The application triggers the cache cleaning by setting a dynamic recovery cycle, and dynamically adjusts the frequency of the cache cleaning according to the memory usage status and the latest cleaning time cycle in real time, so as to ensure the normal operation of the service module.

Described are techniques for correcting at least some inconsistencies in a file system accessed by at least one client, while maintaining the file system online. A file system checking utility is executed on the file system to detect and create corrections for inconsistencies in the file system. The file system is updated to include at least some corrections. Also described is a computer system comprising a file system accessed by a client. A file system checking utility is executed on the file system to detect at least some inconsistencies in the file system, and to create a corrected version of the file system that includes corrections to correct for at least some of the detected inconsistencies. A report is created. The file system is not updated with the corrected version unless the proposed corrections are approved. The file system checking utility may be periodically scheduled for execution.