33 results about "File migration" patented technology

The invention discloses a distributed medical image retrieval and hierarchical storage management system and method. The system comprises an interface processing module, a distributed image storage cluster, a routing forwarding module, a metadata management module and a storage management module. The interface processing module receives the image retrieval request, generates a routing identifier for positioning the storage position of a target medical image file and sends the routing identifier to the routing forwarding module; and the routing forwarding module queries a mapping relationship between the medical image file and the storage node and / or the storage hierarchy based on the routing identifier, determines a first storage node and forwards the request, so that the first storage node returns a target medical image file. And the storage management module obtains the access statistical information, determines a target storage level and / or a target storage node, migrates the medical image file, and triggers updating of the mapping relation after migration is completed. Therefore, cross-node accurate positioning and unified retrieval are realized, positioning consistency is kept after file migration, and hierarchical storage management based on access conditions is supported.

The invention discloses a migration task execution method and device, equipment, a storage medium and a computer program product, and relates to the technical field of data migration, the method comprises the following steps: when it is detected that a user sends a migration task to a current resource space, obtaining an old instance and a state file of the old instance from the current resource space according to the migration task; creating a new instance corresponding to the old instance in the target resource space, and migrating the state file to the new instance; and verifying the state file in the new instance, if the verification is passed, judging that the migration task is executed successfully, and if the verification is not passed, judging that the migration task is executed unsuccessfully. By automatically detecting the migration task sent by the user and obtaining the old instance and the state file of the old instance, automatic triggering and execution of the migration process are achieved, and therefore the migration efficiency is improved; and meanwhile, a new instance is created in the target resource space, the state file is migrated, and whether the migration task is successful or not is automatically judged according to a verification result, so that the migration quality is improved.

The application relates to the technical field of data processing, and discloses a service data migration method, device, equipment and storage medium, the method comprising the following steps: when receiving a service migration requirement of a user, generating to-be-migrated service data according to the service migration requirement; performing migration allocation on the to-be-migrated service data according to system overhead conditions, obtaining a migration detail file corresponding to the to-be-migrated service data and a to-be-migrated temporary file; migrating the to-be-migrated temporary file to a target system, so that the target system writes the to-be-migrated temporary file into a database file when a check result of the to-be-migrated temporary file meets data uniqueness. According to the application, the migration detail file and the to-be-migrated temporary file are allocated, data is automatically uploaded and partition processing is performed, the to-be-migrated temporary file is written into the database file only after data uniqueness is verified when the target system receives the to-be-migrated temporary file, data safety and integrity are ensured, migration data in a shutdown state is avoided, and the data migration efficiency is improved.

A computer implemented method includes receiving, by the processor, a request to initiate a migration of data. The method also includes receiving, by the processor, data identified in the request to initiate a migration. The method also includes generating, by the processor, a file-out of the data by converting the data from a proprietary schema into a commonly understood schema. The method also includes migrating, by the processor, at least a portion of the file-out to a cloud provider. The method also includes validating, by the processor, the migration of the file-out to determine whether the migration is successful, and in response to validating the migration, generating, by the processor, a migration response indicating whether the migration was successful.

The invention relates to a service gateway-based adaptive file migration method, which comprises the following steps that: a service gateway receives an access request for a target file, and queries a migration state of the target file in a file path mapping table; if the migration state is a non-migration state, accessing a source storage service through a service gateway to obtain a target file, and identifying one or more associated files having access correlation with the target file based on a preset association rule; adding the unique identifier of the target file and the unique identifier of the associated file into a high-priority migration queue, and executing a corresponding high-priority migration task; and executing the low-priority migration task based on the self-adaptive migration rate, and migrating full files in the source storage service to the target storage service. According to the invention, the service non-inductive migration of heterogeneous storage is realized through the service gateway, and the access delay is eliminated while the stability of the system is ensured by using the load self-adaption and association prefetching strategy, so that the user experience is remarkably improved.

The application discloses a kind of mine field's cross-platform file transfer's method, comprising the following steps: S1: mine file source identification and fluidization: interface industrial internet platform, read the original file generated in specific business scenario, and convert it into file stream;S2: intelligent unified transcoding for mine terminal: the file stream is uniformly transcoded by intelligent transcoding engine;S3: encryption based on mine data security level: the file after transcoding is encrypted;S4: mine business driven safe transfer: receiving encrypted transcoding file, decryption and decoding are carried out in target mine terminal or mine designated storage node.The application realizes safe and efficient cross-platform transmission between mine multi-business systems, completely solves the file compatibility problem of mine terminal, significantly improves the file transmission and access efficiency in mine weak network environment, and builds mine-level data security protection system.

The embodiment of the invention provides a data storage method and device, a processor and a storage medium. The method comprises the following steps: putting a Checkpoint file generated in a model training process into a corresponding computing node for storage; based on the working state of each computing node, determining whether to perform data migration storage for the computing node, if so, determining a first target Checkpoint file stored in the computing node, and migrating the first target Checkpoint file to a first shared storage system for storage; based on the working state of each computing node and the storage condition of the Checkpoint file in the first shared storage system, whether data migration storage aiming at the first shared storage system is carried out or not is determined, if yes, a second target Checkpoint file stored in the first shared storage system is determined, and if not, the second target Checkpoint file is stored in the second shared storage system; and migrating the second target Checkpoint file to a second shared storage system for storage. Whether data migration storage is carried out or not is determined based on the working state of the computing node, and the problem that the construction cost of a storage medium is high can be avoided.

The invention relates to a heterogeneous state directory and DPDK ring buffer real-time file processing method, which comprises the following steps of: in the running process of a file production unit, correspondingly migrating produced files to different state directories in a heterogeneous state directory set according to different file production states; in the operation process of the file collection unit, files meeting preset conditions in the production completion state catalog are migrated to a processing state catalog; and in the running process of the file processing unit, processing is carried out in the processing state catalog through the DPDK lockless annular buffer queue. According to the method and the device, the heterogeneous state directory is introduced to isolate the files in different states, the problem of repeated scanning of the same file is effectively solved, a lock-free file task transmission and processing mechanism is constructed in combination with DPDK buffering, resource competition and synchronization overhead in the concurrent processing process are reduced, and the file processing efficiency is improved. The problem of how to carry out efficient and reliable data processing on large-scale files is solved.

The invention provides a configuration file migration method and related device.The method comprises the steps that first equipment displays a first interface, the first interface comprises a first phone number of second equipment, first input of a user for migrating the first phone number to the first equipment is received, and then a first request is sent to a cloud server, the first request is used for requesting to migrate the first phone number to the first device; the cloud server sends the verification code to the first device; and the first device downloads the configuration file corresponding to the first telephone number from the operator server by using the verification code. According to the method and the device, the user can complete the migration operation on the migrated target device (namely the first device) without depending on the migrated source device (namely the second device), so that the migration limitation and the user operation are greatly reduced.

The invention discloses a data migration platform, a data migration method, equipment and a storage medium, and relates to the technical field of data migration, and the data migration platform comprises a data source module used for obtaining to-be-migrated data and obtaining a migration configuration information base corresponding to the to-be-migrated data; the data migration module is used for dividing the to-be-migrated data into a plurality of to-be-migrated files based on migration configuration information in the migration configuration information base and generating migration tasks corresponding to the to-be-migrated files so as to migrate the to-be-migrated files to a target database through multi-instance scheduling processing; and the data verification module is used for carrying out data verification on the migration data in the target database to obtain a data migration verification result. According to the method, multiple migration tasks are divided, and multi-instance scheduling processing is combined, so that migration of multiple files can be processed in parallel at the same time, the migration time under a large data volume scene is greatly shortened, and the problems that a traditional method is long in backup time and insufficient in concurrency capability are solved.

The invention relates to the technical field of integrity verification, in particular to a video and audio file migration integrity verification method, which comprises the following steps: acquiring a synchronous frame extraction pixel sequence, establishing mapping to generate feature data, extracting time, marking a stable section, extracting brightness residual error, judging the direction to be consistent, and analyzing chromaticity variance to generate the stable section. According to the method and the device, the brightness and chroma pixel value sequences are extracted from the synchronous frames in the program packaging file and the broadcast rendering frame, and the mapping relation is established, so that frame-by-frame accurate comparison can be realized, the synchronous state is identified in combination with the time sequence difference trend, the inter-frame comparison precision is improved, and the accuracy of the inter-frame comparison is improved. Through the conjoint analysis of the brightness channel residual direction and the chrominance channel variance distribution, the image anomaly recognition capability is enhanced, and the frame-level consistency result is extracted based on the multi-dimensional residual feature intersection, so that the video and audio integrity verification without depending on a unified decoder is realized, and the real-time performance and fine granularity of quality assurance are enhanced.

The application discloses a file migration system, method, device and storage medium. The application relates to the field of file management. The system comprises a query thread management module, a download thread management module, an upload thread management module and an update thread management module. The query thread management module is used for assigning attribute information of a file to be migrated to a text object and transmitting the file to a waiting download queue; the download thread management module is used for assigning a file stream to the current text object and transmitting the file to a waiting upload queue; the upload thread management module is used for uploading the file stream to a migration database and transmitting the text object after the migration text identification is assigned to a waiting update queue; and the update thread management module is used for updating a migration file index table in the migration database. The technical scheme of the embodiment of the application splits the migration process of the file to be migrated into multiple stages such as query, download, upload and data table update, and different function threads are concurrently executed, so that the concurrent mechanism of the multithreading is fully utilized, and the file migration efficiency between databases is improved as a whole.

The present application provides a profile migration method and a related apparatus. The method comprises: a first device displaying a first interface, the first interface comprising a first phone number of a second device, receiving a first input of a user to migrate the first phone number to the first device, and then sending a first request to a cloud server, the first request being used for requesting migration of the first phone number to the first device; the cloud server sending a verification code to the first device; and the first device using the verification code to download from an operator server a profile corresponding to the first phone number. The present application allows a user to complete a migration operation on a migration target device (i.e., the first device) without relying on a migration source device (i.e., the second device), thereby greatly reducing migration restrictions and user operations.

The invention provides a containerized edge service real-time migration method, device and system, and the method comprises the steps: issuing a file migration request when detecting that a user is leaving a communication range of a source node, so as to obtain a to-be-migrated hierarchical file in the source node, a hierarchical file in a warehouse of a target server, and a hierarchical file in a target node; a file migration strategy is generated through file comparison, so that the source server completes file and data migration to the target server, and the target server completes file and data migration to the target node; the source node is controlled to send container related data to the target node, so that the target node completes the Docker daemon process reloading and migration container recovery process according to the container related data and migrated files and data; the migration efficiency is improved by minimizing the container FS data volume needing to be transmitted, and the dynamic and delay-sensitive edge network requirements are met.

This invention provides a data processing method, apparatus, and system for a distributed database system. The method is applied to a management server in the distributed database system. The management server obtains file information from each shard node. The file information of each shard node at least indicates associated sub-files within the sub-files stored by that shard node. These associated sub-files are multiple sub-files belonging to different files but with a relational relationship. Based on the obtained file information and according to a predetermined file selection rule, a file to be migrated is selected from the sub-files included in at least one shard node. The file selection rule includes: for the associated sub-file, using all sub-files contained in the associated sub-file as the selection granularity. The file to be migrated is then migrated to the expansion node. This solution can improve the execution efficiency of access commands in the expanded distributed database system.

A computerized-method for prioritizing migration sequence of data files of an application from a source-storage in a source-system to a target-storage in a target-system in a contact center. The computerized-method includes a) for each data file with customers interactions data in the source-storage that has been marked for migration: (i) retrieving metadata of the file; (ii) retrieving agents details; (iii) identifying attributes related to customers interactions operations in the metadata of the file; (iv) receiving a configuration of weights and rules files. The configuration of weights and rules files includes attribute-type associated to each attribute, (v) normalizing value of each attribute based on a preconfigured formula that is related to the associated attribute-type; and (vi) operating a file-priority-score module to score priority of the file based on the normalized value of each attribute in the attributes; and b) migrating files to the target-storage based on their score of priority.

The invention discloses a cloud disk database migration method and device, equipment, a storage medium and a product, relates to the technical field of computers, and discloses a cloud disk database migration method which comprises the steps that in response to a migration instruction of a cloud disk database, a migration source and a target database of a cloud disk are determined; exporting a structured query file corresponding to the source data from the migration source, and converting the structured query file through a file conversion rule corresponding to the target database to obtain a target query file; and migrating the target query file to the target database through an import command corresponding to the target database. Through the mode, the structured query file can be exported from the source database of the cloud disk and migrated to the target database, so that on the premise of not influencing the existing structure of the cloud disk, the data of the cloud disk database can be smoothly, stably and correctly migrated, the bottom layer main database can be smoothly and traceless switched, and the switching efficiency is improved. And meanwhile, stable operation of the migrated service can be ensured.

The invention discloses a business data migration method and device, a program product and electronic equipment, and relates to the field of financial science and technology or other related fields, and the migration method comprises the steps: receiving a to-be-migrated file transmitted by a to-be-migrated financial institution through a transmission channel, checking the to-be-migrated file, and transmitting the to-be-migrated file to a server; checking the to-be-migrated files, adding the to-be-migrated files passing the checking into a job queue in a preset data platform, checking each to-be-migrated file in the job queue based on a preset checking rule table, taking the target to-be-migrated file passing the checking as a to-be-migrated file, and migrating the to-be-migrated file to a to-be-migrated financial institution through a transmission channel. The technical problem that the accuracy of the migrated business data cannot be ensured and the business development of the to-be-migrated financial institution is influenced in the related technology is solved.

1. The name of the design product: data migration graphical user interface for electronic device. 2. The use of the design product: for an electronic device. 3. The design points of the design product: the protected part of the graphical user interface in the electronic device. 4. The picture or photo that best shows the design points: change state figure 3. 5. The use of the graphical user interface: the graphical user interface is used for data migration. The protected part of the graphical user interface is used for data migration. The graphical user interface can be interacted by the user's click on the graphical user interface or by operating the mouse. By clicking the icon of "this is the old computer" in the main view, the graphical user interface changes from the main view to change state figure 1, showing that "this is the old computer" is selected, then jumps to change state figure 2, showing the selectable new computer; by selecting the target new computer and clicking the "continue" button, the graphical user interface changes from change state figure 2 to change state figure 3, showing the multi-level folders in the old computer; by selecting the folder to be migrated and clicking the "start migration" button, the graphical user interface changes from change state figure 3 to change state figure 4, showing the start of data migration and real-time reminding of the migration progress; after a period of time, the graphical user interface changes from change state figure 4 to change state figure 5, showing that the migration is completed, and showing the migration record of this time, including the migration time, the migrated files, the migration size, etc. 6. Other circumstances that need to be explained: the part of the graphical user interface shown by the dashed line in each view does not constitute the protected part of the design.

Embodiments of the present application disclose a file migration method, a client and a computer readable storage medium, which are used for automatically migrating files. The method of the embodiments of the present application comprises the following steps: obtaining a current date and a client disk usage space corresponding to the current date; inputting the current date into a pre-trained client disk usage rate regression model and a cloud disk usage rate regression model respectively to obtain a client disk usage rate corresponding to the current date and a cloud disk usage rate corresponding to the current date; if the client disk usage space, the client disk usage rate corresponding to the current date and the cloud disk usage rate corresponding to the current date satisfy a preset condition, obtaining basic information of each file to be migrated in the client disk and basic operation behavior information of a user on the current date; determining a target migration file in the client disk according to the basic information of each file to be migrated and the basic operation behavior information of the user; and migrating the target migration file to a cloud disk.

The embodiment of the invention provides a file migration method and device, computing equipment and a storage medium, at least one initial logic disk in which files meeting file migration conditions are stored is determined, the files stored in the initial logic disk can be read, then a target logic disk is applied in a target disk, and the file migration conditions are determined. According to the method, the files stored in the initial logic disk can be migrated to the target logic disk, the files with the same storage attribute are stored in the same initial logic disk, and due to the fact that the file migration conditions corresponding to the files with the same storage attribute are the same, data migration with the logic disk as the granularity is achieved in the mode, and data migration efficiency is improved. Compared with data migration with files as granularity, the data migration method and device have the advantages that the number of times of read-write operation can be effectively reduced, and the data size of single read-write operation is larger, so that larger bandwidth can be obtained in the data migration process, the data migration speed is increased, and the data migration efficiency is improved.

The application provides a cross-cloud storage platform data migration method and device based on a distributed cluster, the method comprising: through a single distributed file collection cluster, performing concurrent data scanning on a source end cloud storage platform, and writing scanned metadata records into an intermediate database subtable; according to a preset routing rule, encapsulating file information of the metadata records in the intermediate database subtable into a to-be-migrated task message through a plurality of distributed file migration clusters, and placing the to-be-migrated task message into a preset Redis task pool, comparing metadata features according to the file information, matching a corresponding target migration mode, and performing data migration to a target end cloud storage platform according to the target migration mode, thereby greatly saving bandwidth resources and guaranteeing data consistency; and adopting an asymmetric cluster architecture of 'one collection and multiple migration' to realize decoupling of collection and migration, supporting independent horizontal expansion of migration capacity, and efficiently supporting concurrent processing of massive files.

The embodiment of the invention provides a file migration method and a related device, which are used for improving the migration rate of mirror image data when the mirror image data in a disk is migrated. The method comprises the steps that a source file is read from a source address in a mirror image format, so that the source file in the mirror image format is obtained, the source file in the mirror image format at least comprises metadata information of the source file, the use state of each data block in the source file is recorded in the metadata information, and the use state comprises unused state and used state; traversing the metadata information to obtain a use state of the target data block; and if the use state of the target data block is unused, in the process of migrating the source file in the mirror image format to the target address, abandoning to read the data in the target data block from the source address, and abandoning to write the data of the target data block in the target address.

The present application belongs to the technical field of computers, and discloses a file migration method and apparatus, a device, and a storage medium. The method comprises: on the basis of a data query request, updating a first correspondence and a second correspondence of one storage module among a plurality of storage modules, the first correspondence comprising a hit count of each file in the storage module, and the second correspondence comprising the number of files in the storage module of which hit counts are within each of a plurality of preset hit count intervals; on the basis of a first correspondence and a second correspondence of a second storage module, determining a file migration list for the second storage module every preset duration; and migrating files indicated by the file migration list from the second storage module to a third storage module. According to the present application, cold and hot data separation is implemented while distributed file storage is implemented, so that hot data is retained in a storage module having high read / write performance as much as possible. Thus, the read / write efficiency of the hot data is improved, and the read / write delay of the hot data is reduced.

The invention discloses a file migration method and device and electronic equipment, and relates to the technical field of big data or the field of financial science and technology, and the method comprises the steps: determining the file type of each small file based on the file access records of L small files in a financial system; combining the small files with the same file type in the L small files to obtain a large file and a file mapping table corresponding to the M small files of the cold data type, and a virtual unit and a unit descriptor corresponding to the N small files of the hot data type; and based on the target concurrency and priority mechanism, carrying out file migration on the M small files through the large file and the file mapping table, and carrying out file migration on the N small files through the virtual unit and the unit descriptor. According to the file migration method and device, the technical problem that in the prior art, the file migration efficiency is low due to the fact that the TCP connection overhead proportion is high during file migration is solved.

The application discloses a Linux file safe deletion system based on time slice rotation and belongs to the technical field of file management. The technical problem to be solved is that the Linux system native deletion command directly deletes files, and no security buffer mechanism leads to the basic security problem that it is difficult to recover the misdeleted files. The technical solution points are as follows: a system setting command interception module, a time slice management module and a storage optimization module are arranged, an rm command is redirected through alias to migrate the to-be-deleted files to a time slice storage directory created by day, the whole directory cleaning is performed on the super-capacity recycle bin based on an LRU algorithm, a daemon process architecture is not adopted, and the implementation is completely based on Linux native tools, and no additional dependence is needed.

The invention discloses a cross-center task processing method and device, and the method comprises the steps: verifying a local processing center data source of each piece of subtask information, and determining a remote processing center data source of the subtask information according to a preset mapping relation when the verification of the local processing center data source of the subtask information is not passed; when the remote processing center data source of the sub-task information passes verification, replacing the local processing center data source of the sub-task information according to the remote processing center data source of the sub-task information; when the to-be-executed task is executed and the sub-task information comprises a data source of the remote processing center, calling an interface of the remote processing center to enable the remote processing center to process the sub-task information; and when the sub-task state is updated to the third task state, the file relocation interface of the remote processing center is adopted to pull the result of execution completion of the sub-task information in the remote processing center, and cross-center execution of the output result and synchronous disaster recovery when the data is abnormal are achieved.

The invention relates to the field of data storage, and provides a silent user data access method and system using an ice pool. The method comprises the steps of performing activeness analysis on user operation records according to user behavior logs, performing screening to obtain a silent user set, and generating a frozen user library; performing hierarchical storage on the user accounts in the frozen user library according to freezing duration to obtain a multi-level account library; target users meeting migration conditions are extracted from the multi-level account library, file information of the multiple target users is summarized, and a user file migration list is generated; and migrating file data in the user file migration list from a hot storage pool to an ice storage pool.

A computer implemented method includes receiving, by the processor, a request to initiate a migration of data. The method also includes receiving, by the processor, data identified in the request to initiate a migration. The method also includes generating, by the processor, a file-out of the data by converting the data from a proprietary schema into a commonly understood schema. The method also includes migrating, by the processor, at least a portion of the file-out to a cloud provider. The method also includes validating, by the processor, the migration of the file-out to determine whether the migration is successful, and in response to validating the migration, generating, by the processor, a migration response indicating whether the migration was successful.

The invention discloses a file migration verification method and device, terminal equipment and a storage medium. The method comprises the steps that a to-be-verified migration file and a first checksum value, stored in a database, of the to-be-verified migration file are obtained; calculating a checksum value of the to-be-checked migration file to obtain a second checksum value; performing operating system text file format conversion on the to-be-verified migration file to generate a plurality of to-be-verified migration files after the operating system text file format conversion; respectively calculating the checksum value of the to-be-checked migration file after the text file format conversion of each operating system to obtain a plurality of third checksum values; comparing each third checksum value and the second checksum value with the first checksum value, and when any third checksum value is consistent with the first checksum value or the second checksum value is consistent with the first checksum value, passing the check; and modifying the to-be-verified migration file according to the matched verification sum value, and applying the modified to-be-verified migration file to software upgrading.