文件清理方法、装置、计算机设备以及存储介质
By updating and deleting target snapshots and the files they reference in the data lake, the problem of reducing the number of files on computer devices is solved, achieving the effect of preserving historical data while improving file query performance.
CN116150086BActive Publication Date: 2026-07-17SANGFOR TECH INC
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SANGFOR TECH INC
- Filing Date
- 2022-12-15
- Publication Date
- 2026-07-17
AI Technical Summary
Technical Problem
Computer devices struggle to effectively reduce the number of snapshots and files in a data lake while retaining the historical data expected by users, leading to a decline in file query performance.
Method used
By acquiring the first and second snapshots to be retained in the data lake, updating the manifest file and data file referenced by the second snapshot based on the manifest file referenced by multiple target snapshots, deleting multiple target snapshots and their referenced files, and merging historical data into the file referenced by the second snapshot, interval deletion is achieved.
Benefits of technology
While retaining historical data, the number of files is reduced, file query performance is improved, and the computer's operating load is reduced.
✦ Generated by Eureka AI based on patent content.
Smart Images
Figure CN116150086B_ABST
Abstract
本申请公开了一种文件清理方法、装置、计算机设备以及存储介质。该方法通过获取数据湖中待保留的第一快照以及第二快照；基于所述多个目标快照中至少一个目标快照引用的清单文件，对所述第二快照引用的清单文件以及所述第二快照引用的清单文件所引用的数据文件进行更新；删除所述多个目标快照、所述多个目标快照引用的目标清单文件、所述目标清单文件引用的数据文件。在基于待删除的目标快照及其引用的清单文件和清单文件引用的数据文件，对第二快照进行更新后，删除位于第一快照与第二快照之间的目标快照以及目标快照引用的清单文件和清单文件引用的数据文件，实现了减少文件数量提高文件查询性能的同时，自定义保留部分历史数据的效果。
Need to check novelty before this filing date? Find Prior Art