194 results about "File migration" patented technology

A read-write snapshot copy facility is constructed from a hierarchical storage management facility. The read-write snapshot copy file system initially comprises stub files pointing to the files in a read-only snapshot copy file system. When an application writes to a file in the read-write snapshot copy, the read-write snapshot copy facility migrates a copy of the file to replace the stub file, and then writes to the migrated file. Because the read-write snapshot copy facility references the files in the read-only snapshot file system in a network namespace using standard protocols such as NFS or CIFS, the read-write snapshot copy facility permits referencing of distributed read-only snapshot file systems in an open (heterogeneous) network environment, and the read-write snapshot copy is scalable by linking the read-write snapshot copy facility to multiple file servers containing read-only snapshot file systems.

A hierarchical storage system is constructed from file servers and a policy engine server by building upon a file migration service. Offline attributes are added to file system inodes in a primary file server, file system parameters are added in the primary server, an offline read access method field is added to a connection database, and the primary file server is programmed to use these attributes and parameters for selecting a particular method (such as a partial read migration or a pass through read method) for read access to an offline file. In this fashion, the primary file server is provided with flexibility for selecting a particular one of a number of migration methods depending on various conditions, in order to improve the trade-off between the cost of storage and delay in file access.

The object of the present invention is to improve an access efficiency in a distributed environment. When a user “foo” access a file “file_1a” stored in a storage node SN1 under the control of a control node CN1 from a client CLN3 via a control node CN3 as shown by the solid lien arrow in the figure, a record of the access is accumulated in an access history of the control node CN1. If the control node CN1 refers to the access history and detects the frequent accesses from the control node CN3, it replicates or migrates the file “file_1a” to a storage node SN3 controlled by the control node CN3 as shown by the bold line arrow. The replication is performed if another device has accessed the file. Otherwise the migration is performed.

Client computers, a namespace server, and file servers are linked in a data network so that the namespace server provides the clients with NFS or CIFS access to a virtual file system including files stored in the file servers, and also provides migration of files between the file servers in a fashion transparent to the client access using NFS or CIFS. The client computers and storage arrays storing the file data are also linked in a storage area network so that the clients have high speed block access to the file data using a file mapping protocol. The namespace server redirects a metadata access request in the file mapping protocol from a client to the appropriate file server when the file is not being migrated, and otherwise denies the metadata access request when the file is being migrated so that the client reverts to NFS or CIFS access.

A namespace server translates client requests for access to files referenced by pathnames in a client-server namespace into requests for access to files referenced by pathnames in a backend NAS network namespace. The namespace server also translates between different file access protocols. The namespace server may change the translation of a client-server network pathname from an old backend NAS network pathname to a new backend NAS network pathname for file migration without disruption to client access during file migration for load balancing or for a more appropriate service level. Client access can also be routed automatically and transparently to replicas in case of server or site failures. The namespace server may create the appearance of a virtual file system that contains multiple physical servers, a virtual share that contains physical shares from different servers, directories that contain files on different servers, and files that contain data from files on different servers.

System and method for partial file migration in file systems by Hierarchical Storage Management (HSM) applications. Embodiments may provide an automated mechanism for HSM applications to partially migrate files by migrating the inactive parts of the files to offline storage while leaving the active parts of the files on disk and active in the file system. In embodiments, access information including timestamps may be recorded and maintained at the subfile level to enable detection of inactivity at the subfile level and hence partial file migration by migrating only the inactive parts of files. The parts of files may be extents, blocks, or ranges. The access information may be recorded and maintained in-memory only, in a separate file on disk, or in extent descriptors for the files.

A NAS switch provides file migrations in a NAS storage network that are transparent to the clients. A source file server exports an original NAS file handles indicative of object locations on the source file server to the NAS switch. The NAS switch modifies the original NAS file handles to an internal file system and maps the original NAS file handles to a switch file handles independent of location. The NAS switch exports the switch file handles to a client. The client looks-up objects and makes NAS requests to the source file server using switch file handles. The NAS switch performs file migration by first replicating the namespace containing data to be migrated from source file server to a destination file server. Separately, the NAS replicates data which is a relatively longer process than the namespace replication. During data replication, namespace access requests for objects are directed to the replicated namespace. After data replication, file object requests for migrated objects are redirected to the destination file server in a process that is transparent to the client.

Characters of the method are that client proxy software of parallelized file system on each front-end host implements supporting VFS access; server of metadata is in charge of executing increment scaling, transporting management and rate control i.e. operations so as to realize performance guarantee of front-end application in hierarchical storage system for mass data (HSSMD). According to performance, data servers are divided into fast data servers and slow data servers. Data server processes incremental scan command sent from metadata server, returns scanned information, and meanwhile executes file transfer command sent from metadata server. Based on condition of load, the method dispatches procedure of data transfer. Based on condition of remnant space (RS) of fast device, the method carries out degradation initiatively. The invention reduces influence on application in front end from transporting procedure, raises rate of RS of fast device, and enhances self management for HSSMD.

This invention relates to a graded storing method for mass data characterizing that the customer proxy software of parallel file systems on front hosts realizes support to VFS access by system interface sub-modules and sub-modules of the VFS layer, a metadata server is responsible for organizing data files on different data servers to a unified parallel file system view, and a metadata management module provides operations of accessing metadata, a file migration deciding module gets file access information from the data server periodically and makes decision to file migration according to file system load and grade situation of equipment and an executing module of the data server executes migration.

File system independent techniques and mechanisms for replicating files on multiple devices are provided, migrating files from one device to another (for purposes of reliability, increased bandwidth, load balancing, capacity expansion, or reduced cost), and propagating updates from a master copy to remote replicas. The mechanisms involve work queues and asynchronous file migration daemons that operate independently from and in parallel with the primary client-server and network protocol to on-disk storage data paths.

The system of the present invention curbs an unnecessary inter-tier file migration and provides an inter-tier file migration that conforms to the utilization state. The hierarchical storage management system respectively migrates a frequently accessed file to the upper Tier, and an infrequently accessed file to the lower Tier. This system carries out inter-tier file migration in conformance with the utilization state. This system provides functions for anchoring a Tier for storage for a specified file, and for not permitting an inter-tier file migration.

A high availability cluster and method of storage medium management in such high availability cluster. A number k of nodes belonging to the cluster, where k≧2 and includes a master node, are provisioned with high-access-rate and low-access-rate storage media. A file is written to the high-access-rate medium of a serving node selected from among k-1 nodes excluding the master node. The file is also written to low-access-rate medium of each of k-2 nodes excluding the master node and the serving node. A distributed storage medium management protocol supervises file migration from the, low-access-rate medium of a back-up node to the high-access-rate medium of the back-up node upon disruption of file availability on the serving node. File rebalancing relies on parameters including popularity, write- and read-requests, capacity, processing load or cost.

A system and method are provided for migrating data files from a source file volume to a target file volume, wherein a target file volume is generated on a target storage device, and a target directory is created based on a directory in the source file volume. In addition, for each file stored in the source file volume, a corresponding stub file is created in the target file volume. The target file volume is mounted to enable a host to access data stored in the target file volume. Files are then copied from the source file volume to the target file volume. In one embodiment, a data processing request is received from the host specifying a stub file stored in the target file volume, a file in the source file volume is identified that corresponds to the specified stub file, and the file is copied from the source file volume to the target file volume. Requested data is retrieved from the copied file and provided to the host.

A storage system including a file migration server, a file migration client, and an LDEV migration engine. The file migration client displays on a management terminal a GUI for guiding a file migration. The file migration server, upon receipt of a file migration command to migrate a part of files stored in a source logical device to a destination logical device, migrates all of the files stored in the source logical device to the destination logical device without involving a change in directory path.

Systems and methods to customize a namespace using a synthetic namespace. A NAS switch provides file migrations in a NAS storage network that are transparent to the clients. The NAS switch file handles are used to customize a namespace. More specifically, a synthetic namespace is generated from one or more file location tables that map the switch file handles to NAS file handles. The NAS file handles are independent of a physical export containing the objects referred to by the NAS file handles. In one example, the synthetic namespace presents a home directory corresponding to a location of a user.

Provided is a technique capable of efficiently operating files and directories that are stored in storage located in a physically far place from a file server, without causing a network latency. An index creation program is also loaded in a cloud computing environment, and a flag, which indicates whether or not to execute batch processing to a directory that has been migrated to the cloud side, is provided, whereby it becomes possible to collectively execute index creation processing for the migrated directory on the cloud side. More specifically, upon completion of migration of all files under a given directory to the cloud side, a flag, which indicates whether or not to perform batch processing on the cloud side, is validated for the metadata of the directory. Such a batch processing flag can be held for each application such as applications of the index creation processing and the virus check processing.

A data migration system is provided for migrating data between an existing file server apparatus and a new file server apparatus in a computer system that includes a plurality of host computers and a plurality of file server apparatuses that are mutually connected to one another. The data migration system on the new file server apparatus copies file attributes unique to the network attached storage (NFS) and file attributes unique to the common internet file system (CIFS) from the existing file server apparatus, and stores the file attributes without changing the file attributes in the new file server apparatus. Then actual data is moved from the existing file server to the new file server. When a file access to data is made from a host computer during the file migration process, and if the data has not been migrated from the existing file server to the new file server, the data is read out from the existing file server onto the new file server, and the file access is processed by the new file server as if the existing file server were processing the file access.

A non-distruptive migration of a native volume from a source server to a destination server performed by a file switch involves converting the source native volume to a native with metadata volume. The native with metadata volume is converted to a mirrored native with metadata volume including the source server and the destination server. The destination server includes a mirror copy of the native with metadata volume. The source server is removed from the mirrored native with metadata volume. The mirror copy of the native with metadata volume on the destination server is converted to a destination native volume on the destination server.

On a distributed data processing system, a history of file migration is maintained. When access to a file is requested and the file is not found, the migration history is consulted to determine the current location of the file, and to update links contained in other files that point to the request file.

A read-write snapshot copy facility is constructed from a hierarchical storage management facility. The read-write snapshot copy file system initially comprises stub files pointing to the files in a read-only snapshot copy file system. When an application writes to a file in the read-write snapshot copy, the read-write snapshot copy facility migrates a copy of the file to replace the stub file, and then writes to the migrated file. Because the read-write snapshot copy facility references the files in the read-only snapshot file system in a network namespace using standard protocols such as NFS or CIFS, the read-write snapshot copy facility permits referencing of distributed read-only snapshot file systems in an open (heterogeneous) network environment, and the read-write snapshot copy is scalable by linking the read-write snapshot copy facility to multiple file servers containing read-only snapshot file systems.

A NAS switch provides file migrations in a NAS storage network that are transparent to the clients. A source file server exports an original NAS file handles indicative of object locations on the source file server to the NAS switch. The NAS switch modifies the original NAS file handles to an internal file system and maps the original NAS file handles to a switch file handles independent of location. The NAS switch exports the switch file handles to a client. The client looks-up objects and makes NAS requests to the source file server using switch file handles. The NAS switch performs file migration by first replicating the namespace containing data to be migrated from source file server to a destination file server. Separately, the NAS replicates data which is a relatively longer process than the namespace replication. During data replication, namespace access requests for objects are directed to the replicated namespace. After data replication, file object requests for migrated objects are redirected to the destination file server in a process that is transparent to the client.

When receiving a file access from the client, the file access program refers to the mapping table, and processes an access to files of on volumes of RAID groups. The file server analyzes the file access states, and groups the files depending on the access time period, defines the file migration pattern based on the grouping, migrates the files, and then carries out a power management operation like a spin-down / -up operation on the RAID groups based on the migration pattern.

A power-saving control apparatus and method capable of power-saving and prevention of decrease in the speed of accessing files of a high level of importance is suggested.First file migration processing is executed for detecting a user access pattern for each file stored in a storage apparatus, grouping files of similar access patterns based on the detected access patterns, migrating each of the grouped files, by group, to memory media individually capable of power-saving control, and setting a power-saving control schedule for each group based on the access pattern for each file; and power-saving control of each memory medium is executed in accordance with the schedule set for each group; wherein the power-saving control schedule for each group is set based on the access pattern of the file whose level of importance is set to the highest level, from among the files belonging to that group.

The present invention extends to methods, systems, and computer program products for extending non-volatile storage at a computer system. In some embodiments, a file operation is performed on at least one shadow copy of a file that is perceived by an application to be stored on a single volume. A plurality of shadow copies of a file can be accessed using durable file identifiers that are durable across changes to other file characteristics. It is indicated back to the application that the file operation was performed on the file perceived to be stored on the single volume. Storage capabilities are enhanced through migration and / or replication of files to newly added volumes.

A method of managing use of resources in data center comprises: determining whether first storage subsystem includes a virtual volume or a storage pool that uses a physical volume of second storage subsystem and, if yes, migrating the physical volume to first storage subsystem; determining whether any storage subsystem includes a virtual volume created directly from a physical volume and, if yes, migrating the virtual volume to another virtual volume provisioned from the storage pool of the storage subsystem; and determining whether all virtual volumes satisfy a preset service level objective and, if no, then selecting a virtual machine which has a smallest virtual machine disk file and selecting a storage pool having a largest free space, and then selecting a virtual volume of the storage subsystem which has the selected storage pool and migrating the virtual machine disk file of the selected virtual machine to the selected virtual volume.

The present invention relates to a migration of a file from a path denotative NAS server to an ID denotative NAS server. In a file management device according to one embodiment, a migration-use path denotative NAS access section obtains a file deposit location from the path denotative NAS server, selects a migration target file based on the deposit location, and sends a read request with the deposit location of the migration target file to the path denotative NAS server, so as to obtain the migration target file. A migration-use denotative NAS access section 44 generates a write request with the migration target file, sends it to the ID denotative NAS servers, and writes the file therein. In addition, the migration-use ID denotative NAS access section registers a GUID received from the ID denotative NAS servers in a file name / GUID management table, together with the file name of the migration target file.

A plurality of geographically diffuse network attached file servers are configured store a file migration control table, each table to including an entry designating a root device and at least one time-decaying access control parameter for a file stored locally to each server. Upon receipt by a first server of a request from a second, geographically remote server for access to an authoritative copy of a file stored by the first server, the said first server updates a time-decaying access control parameter to reflect remote server's request, and computes an access ratio comparing requests from remote users to recent requests from local. If the ratio exceeds a threshold indicating more often or more common usage of the files by remote users than local users, the authoritative file copy is migrated automatically from the first server to the second, remote server.

The embodiment of the invention discloses a data searching method and device. The method comprises the following steps that a data searching request is received; two data sheets needing splitting in a hashing mode are determined; information of the data sheets is sent to each slave node; corresponding relations, between hashed values and sheet fragmentation files, sent by the slave nodes are received; fragmentation is conducted on the hashed values to acquire hashed value fragments, and the slave nodes corresponding to the hashed value fragments are respectively determined; according to the relations between the hashed values and the sheet fragmentation files, all the nodes are controlled to transfer the sheet fragmentation files; connecting results, corresponding to each hashed value, sent by each slave node are received, and the data search request result is determined according to the connecting result. The data searching method and device can be used for acquiring the correct left outer join or right outer join result and further acquiring the correct data searching result when left outer join or right outer join is used for achieving data searching processing in an MPP distributed type data base system.

When automatic device for converting file formats determines that current file to be reproduced is needed to carry out format conversion, the method obtains information related to file formats of file migration target device (FMTD) as well as determines file formats possible supported by FMTD based on the obtained information. The automatic device determines whether the file to be reproduced is accorded with file formats possible supported by FMTD; if yes, the file is reproduced to FMTD directly; otherwise, the file is converted to format supported by FMTD, and is reproduced to FMTD. The invention also discloses the automatic device for converting file formats. The invention implements automatic conversion for file formats so as to solve issue of format conversion existed in current technique when file to be reproduced to storage device.