Simulated File System for Deduplication Testing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional testing systems for deduplication repositories require significant time, storage space, and bandwidth, limiting their ability to efficiently test performance and deduplication efficiency, especially when dealing with large data sets like multi-terabyte backups.

Innovation Solution

A system and method for testing deduplication repositories using a simulated test file system that dynamically generates data values based on request parameters and configuration parameters, such as compression ratio and deduplication rate, allowing for deterministic and on-the-fly data generation, thereby reducing the need for extensive storage and bandwidth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional testing systems use real file systems with actual data for testing deduplication repositories, then the testing results are more accurate and reliable, but the storage space required, bandwidth consumption, and time for data population increase significantly

Engineering Contradiction:
Improvetesting accuracyVSAvoidstorage space
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent creates a simulated file system that generates synthetic data copies instead of using real data. The simulation layer replicates the structural and behavioral characteristics of real file systems while using generated data patterns, allowing tests to be performed on copies rather than originals, thus reducing storage requirements while maintaining testing validity

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms the testing approach by changing data parameters from real-world data to synthetically generated data with controllable characteristics. By adjusting generation parameters (data size, duplication rates, file structures), the system maintains statistical properties similar to real data while reducing actual storage consumption and enabling repeatable test conditions

Inventive Principle:
Principle #35Parameter changes

2Reliability

If conventional testing systems populate large data sets for comprehensive testing, then the deduplication efficiency can be properly evaluated, but the time and bandwidth required for data population and transfer increase significantly

Engineering Contradiction:
Improvededuplication evaluation accuracyVSAvoiddata population time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-generating data patterns and structures that simulate real-world data characteristics before actual testing begins. The simulated file system prepares test data with predetermined duplication patterns, file hierarchies, and access patterns, so that when testing commences, the data is already in the required state, eliminating time-consuming data population during test execution

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamic data generation capabilities where the simulated file system can adaptively create and modify test data on-demand during testing. Rather than statically populating all test data beforehand, the system dynamically generates data patterns as needed, allowing flexible adjustment of test scenarios without requiring extensive pre-population time

Inventive Principle:
Principle #15Dynamics

3Quantity of substance

If a simulated file system dynamically generates data values on-the-fly, then storage space and bandwidth requirements are reduced, but the complexity of the data generation system increases

Engineering Contradiction:
Improvestorage spaceVSAvoidsystem complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The simulated file system implements multi-functionality by combining data generation, file system simulation, and test orchestration capabilities within a single system component. This universal approach eliminates the need for separate data generation tools, file system emulators, and test management systems, reducing overall system complexity despite the sophisticated data generation algorithms employed

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The simulated file system performs self-service by automatically generating appropriate test data patterns based on predefined parameters without requiring external data sources or manual setup. The system self-configures test scenarios, manages data generation state, and adapts to different test requirements autonomously, reducing the operational complexity of managing complex test environments

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10783118B2Read-only file system for testing de-duplication
Publication Date: 2020.09.22 QUEST SOFTWARE INC
  • US10783118B2 patent drawing
  • US10783118B2 patent drawing
  • US10783118B2 patent drawing

AI summary

Disclosed herein are systems, methods, and devices for testing deduplication repositories. Methods may include identifying a storage location based on a request for one or more data values associated with a read-only file system, where the read-only file system is a simulated file system, and where the storage location is identified based on a plurality of request parameters included in the request. The methods may also include generating, using a processor and responsive to the request, the one or more data values based on the plurality of request parameters and a plurality of configuration parameters, where the plurality of configuration parameters enable deterministic generation of all data values stored in the tile system. The methods may further include returning the one or more data values as a result of the request.