Dynamic Block Sizing for Parallel File System Metadata Reduction

The patent segments the shared file writing process into distinct phases: a serialization phase for metadata updates and a parallel phase for data writing. This segmentation allows multiple processes to write data simultaneously while metadata is updated in a controlled manner, reducing the total metadata overhead while maintaining high writing speeds.

The patent performs preliminary actions by pre-allocation of metadata structures and pre-synchronization of block boundaries before the actual parallel writing operation. This preparation ensures that during the parallel write phase, processes can write directly without generating excessive metadata, thus improving speed while controlling metadata overhead.

The patent dynamically adjusts block boundaries during the parallel writing process based on actual data distribution and process completion status. Instead of enforcing rigid fixed block boundaries, the system adapts block sizes and boundaries in real-time, maintaining data integrity through controlled serialization only when necessary, thus preserving parallel writing speed.

The patent maintains continuous parallel writing action by allowing processes to write data continuously across block boundaries with deferred integrity checks. Data integrity is ensured through post-write verification and atomic commit operations, rather than interrupting the parallel writing flow with frequent boundary checks, thus maintaining high writing speed while ensuring reliability.