58 results about "File migration" patented technology

The invention relates to a data platform file migration method, a computer program product and a data platform, and the data platform file migration method comprises the steps: scanning a to-be-migrated source end data file, and obtaining the type of the source end data file; if the type of the source end data file is in the state set of the target reinforcement learning model, taking the type of the source end data file as the current state of the target reinforcement learning model, and obtaining the current action of the target reinforcement learning model in response to the current state; using the current action of the target reinforcement learning model to block the source end data file; constructing a Merkel tree of the source end data file based on the blocking result of the source end data file; comparing Merkel trees of the source end data file with Merkel trees of the target end data file through layer-by-layer hash to locate difference data blocks; and migrating the difference data block to the target end. The problem that in an existing data platform file migration method, a data partitioning strategy is not reasonable, and consequently difference positioning is prone to failure is solved.

The embodiment of the invention provides a file migration method, a storage medium and an electronic device, and the method comprises the steps that a target table is created according to basic information of a source table, and the source table and the target table support different stored file formats; under the condition that the file in the source table is migrated to the target table, a target conversion parameter value is determined in a target mapping relation according to the data size of the file to be migrated, and the corresponding relation between the data size of the file migrated within the historical time range and the conversion parameter value is recorded in the target mapping relation; and performing format conversion on a to-be-migrated file through the target conversion parameter value, and migrating the to-be-migrated file after format conversion to the target table. Therefore, the problem that the file cannot be automatically migrated due to different parameter settings required by file migration of each table in the related technology is solved, and the effect of improving the file migration efficiency is achieved.

The invention discloses a distributed medical image retrieval and hierarchical storage management system and method. The system comprises an interface processing module, a distributed image storage cluster, a routing forwarding module, a metadata management module and a storage management module. The interface processing module receives the image retrieval request, generates a routing identifier for positioning the storage position of a target medical image file and sends the routing identifier to the routing forwarding module; and the routing forwarding module queries a mapping relationship between the medical image file and the storage node and / or the storage hierarchy based on the routing identifier, determines a first storage node and forwards the request, so that the first storage node returns a target medical image file. And the storage management module obtains the access statistical information, determines a target storage level and / or a target storage node, migrates the medical image file, and triggers updating of the mapping relation after migration is completed. Therefore, cross-node accurate positioning and unified retrieval are realized, positioning consistency is kept after file migration, and hierarchical storage management based on access conditions is supported.

This invention discloses a method and apparatus for hierarchical file data storage, comprising recursively traversing the size and type attributes of all files, and prioritizing the migration of files to the target layer of the file system based on the file attribute type. This hierarchical file data storage method calculates the migration score for each file by comprehensively considering file access frequency, the previous migration score, and an adjustment coefficient. The adjustment system adjusts the file based on its size and type attributes. This method of calculating migration scores has a wider range of applications, resulting in more reasonable and accurate file migration, while also improving the access performance of the hierarchical file system storage system. When migrating across file system layers, this method maintains a unified business IO access path for files, eliminating the need to create linked inodes to redirect to the migrated file path, thereby reducing resource consumption, minimizing IO amplification during file read / write operations, and reducing system complexity.

The invention discloses a migration task execution method and device, equipment, a storage medium and a computer program product, and relates to the technical field of data migration, the method comprises the following steps: when it is detected that a user sends a migration task to a current resource space, obtaining an old instance and a state file of the old instance from the current resource space according to the migration task; creating a new instance corresponding to the old instance in the target resource space, and migrating the state file to the new instance; and verifying the state file in the new instance, if the verification is passed, judging that the migration task is executed successfully, and if the verification is not passed, judging that the migration task is executed unsuccessfully. By automatically detecting the migration task sent by the user and obtaining the old instance and the state file of the old instance, automatic triggering and execution of the migration process are achieved, and therefore the migration efficiency is improved; and meanwhile, a new instance is created in the target resource space, the state file is migrated, and whether the migration task is successful or not is automatically judged according to a verification result, so that the migration quality is improved.

The application relates to the technical field of data processing, and discloses a service data migration method, device, equipment and storage medium, the method comprising the following steps: when receiving a service migration requirement of a user, generating to-be-migrated service data according to the service migration requirement; performing migration allocation on the to-be-migrated service data according to system overhead conditions, obtaining a migration detail file corresponding to the to-be-migrated service data and a to-be-migrated temporary file; migrating the to-be-migrated temporary file to a target system, so that the target system writes the to-be-migrated temporary file into a database file when a check result of the to-be-migrated temporary file meets data uniqueness. According to the application, the migration detail file and the to-be-migrated temporary file are allocated, data is automatically uploaded and partition processing is performed, the to-be-migrated temporary file is written into the database file only after data uniqueness is verified when the target system receives the to-be-migrated temporary file, data safety and integrity are ensured, migration data in a shutdown state is avoided, and the data migration efficiency is improved.

A computer implemented method includes receiving, by the processor, a request to initiate a migration of data. The method also includes receiving, by the processor, data identified in the request to initiate a migration. The method also includes generating, by the processor, a file-out of the data by converting the data from a proprietary schema into a commonly understood schema. The method also includes migrating, by the processor, at least a portion of the file-out to a cloud provider. The method also includes validating, by the processor, the migration of the file-out to determine whether the migration is successful, and in response to validating the migration, generating, by the processor, a migration response indicating whether the migration was successful.

The invention provides a migration method and system for encrypted design data. The migration method comprises the steps of design data analysis, encrypted file decryption, data association, file migration protocol, file dictionary management and dynamic monitoring and synchronization. The migration system comprises a data analysis module, a decryption module, a data association module, a file migration module, a monitoring and synchronization module, a file storage module, a file preview module and a folder online packaging module. According to the method, efficient migration of design data can be realized, and the delay and error rate of data transmission are reduced; a decryption function of an encrypted design file is provided, data security is ensured, and meanwhile, the requirement of the industry for confidentiality is met; the association between the project and the business data is realized, so that a user can conveniently manage and query the design data by taking the project as an operation unit; and the change of the design file is dynamically monitored, timely synchronization is realized, and the real-time performance and consistency of data are ensured.

The invention relates to a service gateway-based adaptive file migration method, which comprises the following steps that: a service gateway receives an access request for a target file, and queries a migration state of the target file in a file path mapping table; if the migration state is a non-migration state, accessing a source storage service through a service gateway to obtain a target file, and identifying one or more associated files having access correlation with the target file based on a preset association rule; adding the unique identifier of the target file and the unique identifier of the associated file into a high-priority migration queue, and executing a corresponding high-priority migration task; and executing the low-priority migration task based on the self-adaptive migration rate, and migrating full files in the source storage service to the target storage service. According to the invention, the service non-inductive migration of heterogeneous storage is realized through the service gateway, and the access delay is eliminated while the stability of the system is ensured by using the load self-adaption and association prefetching strategy, so that the user experience is remarkably improved.

The application discloses a kind of mine field's cross-platform file transfer's method, comprising the following steps: S1: mine file source identification and fluidization: interface industrial internet platform, read the original file generated in specific business scenario, and convert it into file stream;S2: intelligent unified transcoding for mine terminal: the file stream is uniformly transcoded by intelligent transcoding engine;S3: encryption based on mine data security level: the file after transcoding is encrypted;S4: mine business driven safe transfer: receiving encrypted transcoding file, decryption and decoding are carried out in target mine terminal or mine designated storage node.The application realizes safe and efficient cross-platform transmission between mine multi-business systems, completely solves the file compatibility problem of mine terminal, significantly improves the file transmission and access efficiency in mine weak network environment, and builds mine-level data security protection system.

The present invention relates to the field of server technology and discloses an image file migration system and an image file migration method, comprising: upon receiving a mode switching instruction sent by a client, a first baseboard management controller connects a communication link between a target hard disk and a target object corresponding to the mode switching instruction; upon receiving an installation instruction for a target operating system and detecting an in-place signal of the target hard disk, a processing device selects a target image file corresponding to the target operating system from at least one image file and transmits data corresponding to the target image file to a second conversion device, where the in-place signal is detected when the communication link between the target hard disk and the first conversion device is connected; the second conversion device converts the data corresponding to the target image file into an electrical signal and transmits the signal to the first conversion device via a power line; and the first conversion device converts the electrical signal into data and transmits the data to the target hard disk. The present invention can improve the installation efficiency of a server operating system.

The invention relates to a data migration method and related equipment, and the method comprises the steps: determining the task type of a file according to the file size information of the file recorded by a data platform, calling a MapReduce task, and migrating the file to a cloud server according to the task type of the file, so that the file can be migrated to the cloud server according to the file size. According to the method, the file migration task is divided into the large task and the small task, and the file is migrated to the cloud server according to the large task and the small task, so that low data migration efficiency caused by an overlarge file is avoided, and the data migration efficiency is improved.

The application provides a file migration method, device, equipment, storage medium and program product, and relates to the technical field of financial technology or the technical field of file migration. The method comprises the following steps: mounting a storage volume of a distributed storage system to a target server and a batch processing node; configuring a dynamic routing rule in the target server, and mapping a file access path requested by a user to a storage path of the storage volume, wherein a bottom path is set in the dynamic routing rule, and when the storage path of the storage volume is unavailable, the file access path requested by the user is mapped to the bottom path; and migrating bulk files and incremental files from an original server to the storage volume. The method provided in the application is suitable for mass file migration, and can improve the file migration efficiency.

In an aspect, a method for migrating data records to a federated database system includes obtaining data records from a data source in a first federated database system; generating a data snapshot file based on the obtained data records and data indicative of a characteristic associated with the obtained data records; generating a hash of the data snapshot file to prevent modification of the data snapshot file; storing the data snapshot file and the generated hash in a data storage; migrating the obtained data records from the data snapshot file to a data target in a second federated database system, the migrating including: retrieving the data records from the data snapshot file stored in the data storage; providing the retrieved data records to the data target according to a mapping between a characteristic of the data source and a characteristic of the data target.

The embodiment of the invention provides a data storage method and device, a processor and a storage medium. The method comprises the following steps: putting a Checkpoint file generated in a model training process into a corresponding computing node for storage; based on the working state of each computing node, determining whether to perform data migration storage for the computing node, if so, determining a first target Checkpoint file stored in the computing node, and migrating the first target Checkpoint file to a first shared storage system for storage; based on the working state of each computing node and the storage condition of the Checkpoint file in the first shared storage system, whether data migration storage aiming at the first shared storage system is carried out or not is determined, if yes, a second target Checkpoint file stored in the first shared storage system is determined, and if not, the second target Checkpoint file is stored in the second shared storage system; and migrating the second target Checkpoint file to a second shared storage system for storage. Whether data migration storage is carried out or not is determined based on the working state of the computing node, and the problem that the construction cost of a storage medium is high can be avoided.

The invention relates to a heterogeneous state directory and DPDK ring buffer real-time file processing method, which comprises the following steps of: in the running process of a file production unit, correspondingly migrating produced files to different state directories in a heterogeneous state directory set according to different file production states; in the operation process of the file collection unit, files meeting preset conditions in the production completion state catalog are migrated to a processing state catalog; and in the running process of the file processing unit, processing is carried out in the processing state catalog through the DPDK lockless annular buffer queue. According to the method and the device, the heterogeneous state directory is introduced to isolate the files in different states, the problem of repeated scanning of the same file is effectively solved, a lock-free file task transmission and processing mechanism is constructed in combination with DPDK buffering, resource competition and synchronization overhead in the concurrent processing process are reduced, and the file processing efficiency is improved. The problem of how to carry out efficient and reliable data processing on large-scale files is solved.

The invention discloses a file migration method, which relates to the technical field of computers, and comprises the following steps: obtaining metadata of a plurality of files in a source file list of a source end, and constructing a first file system diagram according to the metadata; classifying the plurality of files according to the sizes of the plurality of files, and fragmenting the plurality of files according to the classification to obtain a plurality of file fragments; transmitting the plurality of file fragments to a target end in sequence, verifying and repairing the file fragments, and determining that the file fragments are transmitted correctly; in response to completion of file fragment transmission of the plurality of files, constructing a second file system diagram corresponding to the plurality of files after transmission is completed; and comparing the first file system diagram with the second file system diagram, and in response to the fact that the first file system diagram and the second file system diagram are the same, completing file migration, so that the technical problems of resource waste, insufficient real-time performance and weak automatic repair capability are solved, and migration and consistency verification of mass files are efficiently processed.

The invention provides a configuration file migration method and related device.The method comprises the steps that first equipment displays a first interface, the first interface comprises a first phone number of second equipment, first input of a user for migrating the first phone number to the first equipment is received, and then a first request is sent to a cloud server, the first request is used for requesting to migrate the first phone number to the first device; the cloud server sends the verification code to the first device; and the first device downloads the configuration file corresponding to the first telephone number from the operator server by using the verification code. According to the method and the device, the user can complete the migration operation on the migrated target device (namely the first device) without depending on the migrated source device (namely the second device), so that the migration limitation and the user operation are greatly reduced.

An embodiment of the present application provides a file migration method, apparatus, computer device, medium, and program product. It relates to the technical field of data processing. The method includes: obtaining a DAG file to be migrated, where the DAG file runs in a first scheduling system; using a large language model to convert the target function and target syntax in the DAG file to obtain the corresponding function and syntax; parsing the DAG file processed by the large language model conversion to generate a syntax tree; traversing the syntax tree to obtain the DAG parameters and Operator parameters in the DAG file; converting the DAG parameters and Operator parameters into a first parameter and a second parameter respectively that are adapted to the second scheduling system; calling a preset interface of the second scheduling system to create a corresponding scheduling task based on the first parameter and the second parameter, and sending the created scheduling task to the second scheduling system to achieve migration. The technical solution of the embodiment of the present application can improve the efficiency and convenience of file migration.

The invention discloses a data migration platform, a data migration method, equipment and a storage medium, and relates to the technical field of data migration, and the data migration platform comprises a data source module used for obtaining to-be-migrated data and obtaining a migration configuration information base corresponding to the to-be-migrated data; the data migration module is used for dividing the to-be-migrated data into a plurality of to-be-migrated files based on migration configuration information in the migration configuration information base and generating migration tasks corresponding to the to-be-migrated files so as to migrate the to-be-migrated files to a target database through multi-instance scheduling processing; and the data verification module is used for carrying out data verification on the migration data in the target database to obtain a data migration verification result. According to the method, multiple migration tasks are divided, and multi-instance scheduling processing is combined, so that migration of multiple files can be processed in parallel at the same time, the migration time under a large data volume scene is greatly shortened, and the problems that a traditional method is long in backup time and insufficient in concurrency capability are solved.

The invention relates to the technical field of integrity verification, in particular to a video and audio file migration integrity verification method, which comprises the following steps: acquiring a synchronous frame extraction pixel sequence, establishing mapping to generate feature data, extracting time, marking a stable section, extracting brightness residual error, judging the direction to be consistent, and analyzing chromaticity variance to generate the stable section. According to the method and the device, the brightness and chroma pixel value sequences are extracted from the synchronous frames in the program packaging file and the broadcast rendering frame, and the mapping relation is established, so that frame-by-frame accurate comparison can be realized, the synchronous state is identified in combination with the time sequence difference trend, the inter-frame comparison precision is improved, and the accuracy of the inter-frame comparison is improved. Through the conjoint analysis of the brightness channel residual direction and the chrominance channel variance distribution, the image anomaly recognition capability is enhanced, and the frame-level consistency result is extracted based on the multi-dimensional residual feature intersection, so that the video and audio integrity verification without depending on a unified decoder is realized, and the real-time performance and fine granularity of quality assurance are enhanced.

Techniques for migrating a file involve determining, at a source storage device, a file to be migrated in response to receiving a request for migrating a file, where multiple disks in the source storage device are divided into first multiple tiers based on types of the disks. Such techniques further involve acquiring data of the file and a first identifier of a first tier for storing the data among the first multiple tiers. Such techniques further involve sending the data and the first identifier to a destination storage device, to store the file in a second tier corresponding to the first tier among second multiple tiers of the destination storage device, where multiple disks in the destination storage device are divided into second multiple tiers based on types of the disks. Such techniques may ensure the service quality for user data and reducing the abrasion of disk devices.

The application discloses a file migration system, method, device and storage medium. The application relates to the field of file management. The system comprises a query thread management module, a download thread management module, an upload thread management module and an update thread management module. The query thread management module is used for assigning attribute information of a file to be migrated to a text object and transmitting the file to a waiting download queue; the download thread management module is used for assigning a file stream to the current text object and transmitting the file to a waiting upload queue; the upload thread management module is used for uploading the file stream to a migration database and transmitting the text object after the migration text identification is assigned to a waiting update queue; and the update thread management module is used for updating a migration file index table in the migration database. The technical scheme of the embodiment of the application splits the migration process of the file to be migrated into multiple stages such as query, download, upload and data table update, and different function threads are concurrently executed, so that the concurrent mechanism of the multithreading is fully utilized, and the file migration efficiency between databases is improved as a whole.

The present application provides a profile migration method and a related apparatus. The method comprises: a first device displaying a first interface, the first interface comprising a first phone number of a second device, receiving a first input of a user to migrate the first phone number to the first device, and then sending a first request to a cloud server, the first request being used for requesting migration of the first phone number to the first device; the cloud server sending a verification code to the first device; and the first device using the verification code to download from an operator server a profile corresponding to the first phone number. The present application allows a user to complete a migration operation on a migration target device (i.e., the first device) without relying on a migration source device (i.e., the second device), thereby greatly reducing migration restrictions and user operations.

The invention provides a containerized edge service real-time migration method, device and system, and the method comprises the steps: issuing a file migration request when detecting that a user is leaving a communication range of a source node, so as to obtain a to-be-migrated hierarchical file in the source node, a hierarchical file in a warehouse of a target server, and a hierarchical file in a target node; a file migration strategy is generated through file comparison, so that the source server completes file and data migration to the target server, and the target server completes file and data migration to the target node; the source node is controlled to send container related data to the target node, so that the target node completes the Docker daemon process reloading and migration container recovery process according to the container related data and migrated files and data; the migration efficiency is improved by minimizing the container FS data volume needing to be transmitted, and the dynamic and delay-sensitive edge network requirements are met.

Systems and methods for a file migration process for moving a plurality of files from a first group of servers to a second group of servers in near real-time are provided. The file migration process automatically and dynamically identifies each file on the first group of servers at the appropriate time and location and moves each file to a corresponding file at the second group of servers. The file migration process is initiated by obtaining several input parameters and is able to adjust to environmental changes, where the process can handle different possible scenarios. The file migration process may be partitioned into a dynamic file identification engine (module) and one or more near real-time file transfer modules that may be executed on one of the servers in the first group of servers.

This invention provides a data processing method, apparatus, and system for a distributed database system. The method is applied to a management server in the distributed database system. The management server obtains file information from each shard node. The file information of each shard node at least indicates associated sub-files within the sub-files stored by that shard node. These associated sub-files are multiple sub-files belonging to different files but with a relational relationship. Based on the obtained file information and according to a predetermined file selection rule, a file to be migrated is selected from the sub-files included in at least one shard node. The file selection rule includes: for the associated sub-file, using all sub-files contained in the associated sub-file as the selection granularity. The file to be migrated is then migrated to the expansion node. This solution can improve the execution efficiency of access commands in the expanded distributed database system.

A computerized-method for prioritizing migration sequence of data files of an application from a source-storage in a source-system to a target-storage in a target-system in a contact center. The computerized-method includes a) for each data file with customers interactions data in the source-storage that has been marked for migration: (i) retrieving metadata of the file; (ii) retrieving agents details; (iii) identifying attributes related to customers interactions operations in the metadata of the file; (iv) receiving a configuration of weights and rules files. The configuration of weights and rules files includes attribute-type associated to each attribute, (v) normalizing value of each attribute based on a preconfigured formula that is related to the associated attribute-type; and (vi) operating a file-priority-score module to score priority of the file based on the normalized value of each attribute in the attributes; and b) migrating files to the target-storage based on their score of priority.

The invention discloses a cloud disk database migration method and device, equipment, a storage medium and a product, relates to the technical field of computers, and discloses a cloud disk database migration method which comprises the steps that in response to a migration instruction of a cloud disk database, a migration source and a target database of a cloud disk are determined; exporting a structured query file corresponding to the source data from the migration source, and converting the structured query file through a file conversion rule corresponding to the target database to obtain a target query file; and migrating the target query file to the target database through an import command corresponding to the target database. Through the mode, the structured query file can be exported from the source database of the cloud disk and migrated to the target database, so that on the premise of not influencing the existing structure of the cloud disk, the data of the cloud disk database can be smoothly, stably and correctly migrated, the bottom layer main database can be smoothly and traceless switched, and the switching efficiency is improved. And meanwhile, stable operation of the migrated service can be ensured.

The application relates to a mirroring method and device for mirror files in a magnetic tape, computer equipment, a storage medium and a computer program product, and relates to the technical field of big data. The method comprises the following steps: acquiring a set of mirror files to be migrated; if, in the set of mirror files, a first mirror file to be migrated is associated with a file identifier of a second mirror file to be migrated, acquiring a second initial magnetic tape band corresponding to the second mirror file to be migrated according to the file identifier; acquiring a first initial magnetic tape band corresponding to the first mirror file to be migrated; in the set of mirror files to be migrated, dividing the mirror files to be migrated corresponding to the first initial magnetic tape band and the mirror files to be migrated corresponding to the second initial magnetic tape band into one virtual magnetic tape in a virtual magnetic tape set, to obtain mirror files to be migrated contained in each virtual magnetic tape; and migrating the mirror files to be migrated contained in each virtual magnetic tape into a target physical magnetic tape. In this way, the stability of mirror file migration is improved.