Multi-level concurrency control method and system based on file lock and state file

By using a multi-level concurrency control method involving file locks and status files, the problems of high database pressure and task interruption in traditional data synchronization schemes are solved, achieving efficient data processing and rapid recovery.

CN122086856AActive Publication Date: 2026-05-26JIANGXI PUHUI CREDIT INFORMATION CO LTD
5 Cites 0 Cited by

Patent Information

Application Number
CN202610550578.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-04-24
Publication Date
2026-05-26
Estimated Expiration
2046-04-24

AI Technical Summary

Technical Problem

Traditional data synchronization solutions rely on database locking mechanisms, which puts a lot of pressure on the database, makes collaborative processing difficult in a distributed environment, and makes it impossible to recover quickly after a task is interrupted.

Method used

It adopts a multi-level concurrency control method based on file locks and status files. Data files are stored through a multi-level directory structure, exclusive processing rights are achieved using table-level lock files, and processing status and error information are recorded through status files. It supports breakpoint resume and circuit breaker isolation mechanisms.

Benefits of technology

It reduces resource consumption, increases overall throughput, supports distributed deployment, is easy to monitor and troubleshoot, reduces system complexity, and enables task traceability and rapid recovery.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention provides a multi-level concurrency control method and system based on a file lock and a state file. The method comprises the following steps: traversing a directory of a data file to be processed; creating a table-level lock file corresponding to the target source data file; the processing node obtains the exclusive processing right of the target source data file and stores the state file set in a directory where the target source data file is located; whether abnormity exists in the state file set or not is judged, if yes, it is judged that the target source data file does not need to be processed so as to release the corresponding table-level lock file, and local isolation is conducted on a source data text file corresponding to the table-level lock file; and all the processing nodes identify the processed files or the local isolation files according to the state files existing in the catalog where each target source data file is located. The method can prevent the single file problem from affecting the overall task execution, multiple nodes can work cooperatively through the shared file system, and the method is easy to integrate with an existing big data ecosystem.
Need to check novelty before this filing date? Find Prior Art