Test Framework Customization via Configuration Folders

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional database systems face difficulties in adjusting and customizing test frameworks to suit the needs of specific applications in multi-tenant database environments, making it challenging to effectively test modules within these systems.

Innovation Solution

The approach involves accessing the source code of a test framework configured for a multi-tenant database system, creating a configuration folder with property overrides for a test suite, determining the source root folder, and adding custom tests to customize the test suite, allowing for flexible and isolated testing within the framework.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a conventional test framework is used in a multi-tenant database system, then the system can maintain a standardized testing approach, but it becomes difficult to adjust and customize the test framework to suit the needs of particular applications

Engineering Contradiction:
Improvecustomizability of test frameworkVSAvoidcomplexity of test framework configuration
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The test framework is segmented into modular components including test suites, test cases, and configuration files. Each module can be independently customized through property overrides in configuration folders, allowing specific applications to adjust testing behavior without affecting the entire framework. This segmentation enables granular customization while maintaining overall system manageability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements local quality by allowing different configuration folders to contain property overrides specific to particular applications or modules. Each application can have its own customized test configuration without affecting other applications, enabling tailored testing approaches for different needs while using the same underlying test framework infrastructure.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If the test framework is highly customizable for different applications, then it can meet specific testing needs, but the time required for test preparation and configuration increases

Engineering Contradiction:
Improvecustomizability of test suitesVSAvoidtime for test preparation
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary action by providing pre-configured test suites with default properties and configuration templates. These pre-established structures can be quickly adapted to specific applications by simply overriding necessary properties in configuration files, significantly reducing the time required for test preparation compared to building test frameworks from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses copying by allowing test suites to be replicated across different applications with minimal modification. Configuration folders can contain property overrides that are copied and adapted from existing successful test configurations, enabling rapid deployment of customized test suites without extensive manual configuration work.

Inventive Principle:
Principle #26Copying

3Ease of manufacture

If the test framework structure is fixed and standardized, then it is easier to maintain and refactor, but it becomes difficult to add custom tests and customize test suites for specific modules

Engineering Contradiction:
Improveease of framework maintenanceVSAvoidability to add custom tests
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The test framework implements dynamics by combining a fixed standardized structure with dynamic customization capabilities. The core framework maintains a stable, refactorable architecture while configuration folders and property overrides provide dynamic adaptability. This allows the system to maintain ease of maintenance through standardized refactoring while simultaneously enabling custom tests and suites through configurable extensions.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8499286B2Module testing adjustment and configuration
Publication Date: 2013.07.30 SALESFORCE INC
  • US8499286B2 patent drawing
  • US8499286B2 patent drawing
  • US8499286B2 patent drawing

AI summary

In one embodiment, a method for testing adjustment and configuration is disclosed. The method can include accessing source code of a test framework that is configured for testing a module, creating a configuration folder having a property override for a test suite for the module testing, determining a source root folder for the test suite, starting the test framework by passing in an identifier for the test suite, and adding a custom test to the source root folder using the configuration folder to customize the test suite. The method can further include compiling the test framework with each of the plurality of test folders enabled. The method also may use a refactoring tool to make changes in a file within the test framework.