Method and system for uploading duplicated files

A technology for duplicating files and files, applied in the field of data processing, can solve the problems that the overall consistency of the files to be uploaded cannot be guaranteed, the calculation time is shortened, and the calculation process is obviously time-consuming, etc., and the network bandwidth is limited and the overall consistency is guaranteed. performance, speeding up the verification process

Active Publication Date: 2015-03-11
EISOO SOFTWARE
View PDF5 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the file is large, the calculation process takes a lot of time
Individual improvement plans propose to extract part of the contents of the file to calculate the verification value to shorten the calculation time, but it cannot guarantee the overall consistency of the file to be uploaded and the file searched by the server

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for uploading duplicated files
  • Method and system for uploading duplicated files
  • Method and system for uploading duplicated files

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0065] figure 1 The flow of the first embodiment of the file upload method of the present invention is given, which includes:

[0066] Step 101: The client side judges whether the size of the file to be uploaded is not smaller than the first threshold. If the size of the file to be uploaded is not smaller than the first threshold, go to step 102; otherwise, go to step 111.

[0067] The first threshold is the file size predefined by the client that requires repeated verification. The first threshold can be at the MB level, such as 10M. It can be estimated and adjusted according to the network conditions in actual applications, or it can be obtained by other methods. The threshold size suitable for improving the efficiency of repeated file uploads.

[0068] Step 102: the client extracts the verification segment from the file to be uploaded, calculates the verification value of the verification segment, and uploads the verification value and file size of the verification segmen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and a system for uploading duplicated files. The method comprises the steps: a client end calculates a calibration section calibration value of a file with the file size which is greater than or equal to a first threshold value, and a server end quickly matches the calibration section calibration value with the file size; if quick matching is successful, the client end calculates a calibration value of the whole file, and the server end precisely matches file calibration information; if precise matching is successful, the server end establishes a file to be uploaded to a map recorded in an existing grandfather, otherwise, stores the file calibration information and generates a grandfather record after the file is uploaded. If no matching item exists during quick matching, calculation of the calibration information of the whole file to be uploaded can be avoided; meanwhile, consistency of the file to be uploaded and a file matched by the server end is guaranteed; by pre-storage of the file calibration information during precise matching, repeated calculation of the file calibration information by the server end is avoided.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method and system for repeated file uploading. Background technique [0002] With the popularization of Internet technology and mobile devices, the amount of information created and shared by people is increasing day by day. Network storage, such as network disks and cloud disks, can provide users with an efficient information processing method that allows users to access data at any time on a variety of terminals with only one upload. However, in the mass data stored on the network, there must be a large amount of duplicate data, which is mainly reflected in the public resources uploaded by different users. The existence of these duplicate data, on the one hand, occupies a large amount of network bandwidth during its upload process, and on the other hand, causes unnecessary pressure on the network storage server. [0003] In order to reduce the waste caused by duplic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/06
Inventor 蓝夏军张玮
Owner EISOO SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products