File synchronization operation method, terminal equipment and storage medium

A file synchronization and operation method technology, applied in file/folder operations, file systems, instruments, etc., can solve problems such as low decoupling, increased development workload and work cycle, copy tasks are not universal, etc., to improve execution efficiency effect

Pending Publication Date: 2021-03-19
XIAMEN MEIYA PICO INFORMATION
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 3. In the process of file copying, there are complex requirements for file encryption, file decryption, file name filtering, file size filtering, or some custom file processing, etc.
[0006] For the above complex operations such as copying between different components or the same component, file processing, file filtering, etc., the traditional method needs to tailor the development of each file

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File synchronization operation method, terminal equipment and storage medium
  • File synchronization operation method, terminal equipment and storage medium
  • File synchronization operation method, terminal equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] The embodiment of the present invention provides a file synchronization operation method, the specific method is as follows:

[0032] (1) Unify the abstraction of the file.

[0033] In this embodiment, it is represented by the file component abstract class BasicFile, which includes subclasses of ftp file component FtpFile, local file component LocalFile, hdfs file component HdfsFile and other types of file components OtherFile, wherein the definition of OtherFile is not necessarily practical and operable The file can be the encapsulation of some tables in the database to realize the reading and writing of data. Specific inheritance such as figure 1 shown.

[0034] The configuration items of the file component abstract class BasicFile include file scan scan, file upload storeToRemote, file download storeToLocal, file rename rename, file delete delete and other operations. The specific unified operation method is as follows: figure 2 shown.

[0035] (2) Build task c...

Embodiment 2

[0071] The present invention also provides a file synchronization operation terminal device, including a memory, a processor, and a computer program stored in the memory and operable on the processor, and the present invention is realized when the processor executes the computer program Steps in the above method embodiment of Embodiment 1.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a file synchronization operation method, terminal equipment and a storage medium. The method comprises the steps that a file synchronization operation is achieved through a built universal task execution engine, wherein the task execution engine comprises a connection address configuration and more than one task component, each task component comprises a scanning componentand more than one responsibility chain component, the scanning component is used for scanning all files under a file directory, distributing the files scanned by the scanning component to each responsibility chain component in sequence, and configuring the thread number of all responsibility chain components under one task component during execution through a configurable variable, each responsibility chain component is composed of a plurality of sub-task components, the plurality of sub-task components are executed from top to bottom in sequence, and the sub-task components are used for executing file operation. According to the method, a multi-thread execution mode can be configured for each task, so that each task and each file can be processed in parallel, and the execution efficiencyis greatly improved.

Description

technical field [0001] The invention relates to the field of file operation, in particular to a file synchronization operation method, a terminal device and a storage medium. Background technique [0002] With the development of information technology, there are more and more demands for synchronization between files, including copying, filtering, and some common operations between local files, FTP service files, and HDFS files. There are mainly the following scenarios : [0003] 1. During the actual file synchronization process, it is often necessary to scan the files under a certain directory A, and copy them to multiple directories such as directory B, directory C, and directory D at the same time, and all directories A, B, C, Directory D may be a directory copy between different components such as local files, FTP directories, and HDFS. [0004] 2. When copying from data source directory A to directory B, directory C, and directory D, the actual requirements will also ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/178G06F16/16G06F21/62
CPCG06F16/178G06F16/16G06F21/6218G06F2221/2107
Inventor 吴金汉陈云曾超
Owner XIAMEN MEIYA PICO INFORMATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap