File and picture quick reading method and system, medium and electronic terminal

Abstract

The invention provides a file and picture quick reading method, which comprises the following steps of: setting one or more cluster nodes, and creating different databases corresponding to the clusternodes according to the different cluster nodes; storing the data information stored in the data node into a database corresponding to the data node, and creating different data information tables corresponding to the data node according to different data nodes; acquiring database information of corresponding data according to the data information table. The file (picture) is recorded in the external storage space. On one hand, system loading failure caused by file system damage is avoided. Data reading fails, so that the robustness of the system is improved. On the other hand, frequent accessto the file system is reduced, the reading speed of the file (picture) is increased, the query speed is further increased according to the library and table division strategy designed by the clusterand the DN node, and the reading speed of the file (picture) is further increased.

Description

technical field [0001] The invention relates to the field of computer applications, in particular to a method, system, medium and electronic terminal for quickly reading files and pictures. Background technique [0002] Distributed file system is an open source high-performance distributed file system, the main functions include: file storage, file synchronization and file access, as well as high capacity and load balancing. Among them, the distributed video monitoring file system is a file system specially for monitoring video files. When there are many system resource nodes, in the face of massive files and pictures, fast access is a key factor in determining the performance of the system. [0003] At present, for the problem of fast access to massive files and pictures, there are generally few researches in the academic circles and there are also few related academic documents or materials. The commonly used methods in the prior art all have shortcomings, for example, NoS...

AI Technical Summary

Problems solved by technology

[0003] At present, for the problem of fast access to massive files and pictures, there are generally few researches in the academic circles and there are also few related academic documents or materials. The commonly used methods in the prior art all have shortcomings, for example, NoSQL-based Distributed multi-level storage method for massive aviation logistics and small files, but this method ignores that when the NoSQL work fails, the system will not work normally, and the reading performance needs to be further improved

For another example, a memory-based file system can significantly improve file access speed, but it needs to store the entire file system in memory, which puts forward higher requirements on server performance.

However, based on the fast small file access optimization algorithm, it needs to rely on the small file access log, and the file hit rate needs to be further improved.

And some methods based on quick access to query pictures, but such methods only record the MD5 value of the picture, and still traverse some pictures, affecting the speed of picture reading

Images