Hadoop-based file uploading method

A file uploading and file technology, applied in electrical components, transmission systems, digital transmission systems, etc., can solve problems affecting efficiency, redundancy, storage space waste, etc., to improve efficiency, ensure correctness and security, and avoid duplication The effect of the transmission

Inactive Publication Date: 2016-08-10
G CLOUD TECH
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the development of storage technology and network technology, the electronic files we use and transfer daily are getting bigger and bigger. At the same time, with the popularity of smart phones and the rapid development of multimedia technology, the frequency of our file transfer is getting higher and higher. If we follow the conventional Store files in this way, especially large files; it will bring a lot of redundancy and waste storage space. If large files are transferred by traditional methods, each transfer will take hours and affect efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hadoop-based file uploading method
  • Hadoop-based file uploading method
  • Hadoop-based file uploading method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] Such as figure 1 , 2 As shown, when the present invention uploads or transmits a large file through the network, the client program obtains the MD5 encrypted string of the large file content, sends a request to the server, and the server receives the request, and queries the large file information table according to the MD5 encrypted string. Obtain the hadoop storage path of the file, and directly obtain the file stream of the file from the hadoop distributed file system through the storage path, so as to achieve the effect of instant transmission. If there is no file record of the MD5 encrypted string, upload the physical file and store it in the hadoop distributed file system, obtain the storage path of the file in hadoop, save the MD5 encrypted string of the file and other related information to the large file information table, When someone uploads or transfers the same physical file again, it can be transferred in seconds by querying and copying the hadoop storage...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of software development, in particular to a hadoop-based file uploading method. The method comprises the following steps: transmitting an MD5 encryption string between a client and a server side when a file is uploaded or transmitted through a network in order that the server side acquires a hadoop storage path of the file according to the MD5 encryption string; and directly acquiring document flow of the file through the storage path. According to a network large file transmission method provided by the invention, large files are stored at one time in a distributed way through hadoop, so that the network storage space is saved. The correctness and security of files are ensured through an MD5 encryption technology. The aims of uploading files by a person at one position and using the files by a plurality of persons at a plurality of positions are fulfilled through the network; uploading or transmitting time is shortened; and the efficiency is increased.

Description

technical field [0001] The invention relates to the technical field of software development, in particular to a hadoop-based file upload method. Background technique [0002] With the development of storage technology and network technology, the electronic files we use and transfer daily are getting bigger and bigger. At the same time, with the popularity of smart phones and the rapid development of multimedia technology, the frequency of our file transfer is getting higher and higher. If we follow the conventional Store files in this way, especially large files; it will bring a lot of redundancy and waste storage space. If large files are transferred by traditional methods, each transfer will take hours and affect efficiency. Contents of the invention [0003] The technical problem solved by the present invention is to provide a hadoop-based file upload method to realize fast transmission of large files. [0004] The technical scheme that the present invention solves the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L29/06H04L9/06
CPCH04L9/0643H04L63/0442H04L67/06
Inventor 张远世季统凯
Owner G CLOUD TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap