Compressed file processing method and device

Abstract

The invention provides a compressed file processing method and device which are applied to the technical field of big data, and the method comprises the steps: obtaining a compressed file of a data provider, and putting the compressed file in a working directory corresponding to the data provider; analyzing to obtain a path of a data file in the compressed file; configuring a path conversion condition set under a working directory corresponding to the data provider; decompressing the compressed file; each source file analysis condition in the path conversion condition set is polled, and for each data file, when it is determined that the current source file analysis condition is suitable for the data file, the value of each conversion parameter of the data file is obtained based on the source file analysis condition; and based on a target file generation condition, according to the value of each conversion parameter of the data file, obtaining a target file corresponding to the data file. According to the method, the compressed file path provided by each data provider can be standardized according to the form which can be identified by the data demander, so that the efficiency, the accuracy and the safety are high.

Description

technical field [0001] The present invention relates to the technical field of big data, and in particular, to a compressed file processing method and device. Background technique [0002] During development, the data demander needs to connect with multiple data providers in order to better analyze the data, but some data providers only provide data in the form of compressed data files, and the compressed files contain the uploaded data compression with multi-directory file levels. The file and the system to be processed are not on the same server. Since the systems of the data providers have their own characteristics, there is no unified standard for the data files provided by each data provider, resulting in the data demander needing to spend a lot of manpower to provide data for each company. The data compression file path provided by the party is standardized according to the form that the system can recognize, such as figure 1 As shown, this not only causes waste of hu...

AI Technical Summary

Problems solved by technology

[0002] In development, the data demander needs to connect with multiple data providers in order to better analyze the data, but some data providers only provide them in the form of data compression files, which contain multi-directory file levels and uploaded data compression The file and the system to be processed are not on the same server. Since the systems of the data provider have their own characteristics, the data files provided by each data provider do not have a unified standard, and the data demander needs to spend a lot of manpower on each data provider. The path of the data compression file provided by the party is standardized in a form that the system can recognize, such as figure 1 As shown, this not only causes a waste of human resources but also greatly reduces the timeliness and accuracy of data processing

Images