System and method for big data file analysis and processing in cloud computing environment
A cloud computing environment, analysis and processing technology, applied in the direction of file system, file system function, file system management, etc., can solve problems such as file storage failure, file security risk, and impact on file analysis and processing, so as to avoid waste and improve security sexual effect
Active Publication Date: 2022-06-17
浙江汇鼎华链科技有限公司
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] Through cloud computing technology, people can realize rapid analysis and processing of big data files. The existing big data file analysis and processing system under the cloud computing environment only focuses on the identification of file types. According to the identified file types, select the corresponding The file analysis and processing software is used to process the files; however, there are big defects in the management of the files. First, the memory cannot be planned according to the files. When the file memory is large and the remaining storage memory is small, it may This will lead to the failure of file storage, which will affect the analysis and processing of files, and at the same time, the security of files is also at great risk
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0082] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
[0083] see Figure 1-Figure 4 , the present invention provides a technical solution: a big data file analysis and processing system in a cloud computing environment, comprising:
[0084] a file acquisition module, which is used to acquire files in a cloud computing environment;
[0085] a file cloud backup module, the file cloud backup module performs distributed classification and storage of the file according to the file content; ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a system and method for analyzing and processing large data files in a cloud computing environment. The storage category calibration module performs file analysis according to the relationship between the corresponding secondary keywords of the file fragments corresponding to the same primary keywords. The storage class corresponding to the fragment is calibrated, and each file fragment is stored in a distributed manner according to the calibrated storage class corresponding to each file fragment. The present invention can plan the memory according to the files. When the file memory is large and the remaining storage memory is small, the storage space is allocated reasonably, the files are effectively stored, the storage space is avoided, and the files are divided at the same time. Save them separately, which effectively improves the security of file storage. At the same time, after the file analysis or query is completed, the files will be automatically cleaned up, ensuring that the files will not cause adverse effects on storage resources while ensuring that the database content is not affected.
Description
technical field [0001] The invention relates to the technical field of data analysis and processing, in particular to a big data file analysis and processing system and method in a cloud computing environment. Background technique [0002] With the rapid development of computer technology, people use computer technology more and more widely, especially cloud computing technology, which brings great convenience to people's production and life. [0003] Through cloud computing technology, people can realize rapid analysis and processing of big data files. The existing big data file analysis and processing systems in cloud computing environment only focus on the identification of file types. The file analysis and processing software is used to process files; however, there are major defects in the management of files. First, the memory cannot be planned according to the file. When the file memory is large and the remaining storage memory is small, it may be As a result, the fi...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/11G06F16/17G06F16/172G06F16/16G06F16/14
Inventor 姜义凡
Owner 浙江汇鼎华链科技有限公司