A duplicate file detection method, terminal and server

Abstract

An embodiment of the present invention provides a duplicate file detection method, a terminal and a server. The method includes: when sending a file to be processed that a user needs to upload to the server to the server, the terminal obtains the size of the file to be processed, and detects that the size of the file to be processed belongs to According to the target value range of the target value range, calculate the hash value of the file to be processed according to the calculation method of the file hash value corresponding to the target value range, and send a message containing the hash value of the file to be processed to the server, and the server determines whether the file to be processed is based on the sent message to repeat the file, and send a response result to the terminal, the response result includes information that the file to be processed is a duplicate file or information that the file to be processed is a non-repeat file. Based on the above processing, the server can obtain the hash value of the file to be processed without waiting for the transmission of all the files to be processed to be completed. Furthermore, the server can determine whether the file to be processed is a duplicate file earlier.

Description

technical field [0001] The invention relates to the technical field of computer networks, in particular to a method for detecting duplicate files, a terminal and a server. Background technique [0002] With the rapid development of computer network technology, users can not only easily watch their favorite videos online through video terminals, but also upload the videos they shoot or obtain through other channels to the video server, so as to share the videos they upload. for other users to watch. As the server receives more and more files such as videos uploaded by users, these files will inevitably be duplicated. In order to avoid storing duplicate files, the server needs to check the files uploaded by the user one by one to determine whether they are duplicate files. [0003] Therefore, in order to avoid storing duplicate files, the existing technology judges the uploaded file by calculating the hash (hash) value of the uploaded file after the file upload is completed,...

AI Technical Summary

Problems solved by technology

[0004] However, the inventor found in the process of implementing the present invention that at least the following problems exist in the prior art: the prior art judges whether it is a duplicate file by calculating the hash value of the uploaded file, and cannot detect whether the file uploaded by the user in time for duplicate files

Images