Unified Test Framework Integrating Plug-ins for Multi-Layer Software Testing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current testing approaches for software products require multiple tools for different layers, leading to increased costs and time to market due to disparate scheduling and control requirements, making comprehensive testing cumbersome and inefficient.

Innovation Solution

A unified test framework that integrates various testing tools through plug-ins, allowing for on-demand testing of multiple layers such as UI, API, and database layers within a single platform, with execution control and result reporting, enabling simultaneous testing across different environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple testing tools from different vendors are used for different layers, then comprehensive test coverage is achieved, but test costs and time to market increase

Engineering Contradiction:
Improvetest coverageVSAvoidtime to market
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent merges multiple testing tools from different vendors into a single unified testing platform. The core platform provides common functionality for scheduling, control, and coordination, while integrating specific testing tools (e.g., Selenium for web UI, JUnit for Java code, DBUnit for databases) as plug-ins. This consolidation eliminates the need to manage separate tools for different layers, reducing time to market while maintaining comprehensive test coverage.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The testing framework implements universality by designing a core platform that can execute multiple types of tests through a common interface. The platform provides universal scheduling capabilities, control mechanisms, and result aggregation functions that work across all testing layers (UI, API, database, code). This multi-functional approach allows a single platform to replace multiple specialized tools, reducing overall testing time and costs.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If multiple testing tools from different vendors are used for different layers, then comprehensive test coverage is achieved, but device complexity increases

Engineering Contradiction:
Improvetest coverageVSAvoidtesting platform complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the testing system into a core platform and separate plug-in modules for different testing layers. Each plug-in (e.g., web UI testing, database testing, code testing) is an independent unit that can be added or removed without affecting the core functionality. This segmentation reduces overall system complexity by allowing modular organization of testing capabilities, making the platform easier to manage and extend.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The core platform acts as an intermediary layer between the user and various testing tools. It provides a unified interface for scheduling, control, and result aggregation, translating high-level test commands into tool-specific operations. This intermediary abstraction hides the complexity of underlying tools from the user, presenting a simplified, consistent interface while maintaining access to comprehensive testing capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If different scheduling requirements and control methods are used for various test operations, then layer-specific testing precision is maintained, but ease of operation decreases

Engineering Contradiction:
Improvelayer-specific testing precisionVSAvoidtesting control convenience
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The core platform implements universal scheduling and control mechanisms that work consistently across all testing layers. A single scheduler handles UI tests, database tests, and code tests uniformly, providing predictable timing and coordination. The control interface remains consistent regardless of which plug-in is active, making operation easier while maintaining layer-specific testing precision through standardized control protocols.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8868981B2On-demand services environment testing framework
Publication Date: 2014.10.21 SALESFORCE INC
  • US8868981B2 patent drawing
  • US8868981B2 patent drawing
  • US8868981B2 patent drawing

AI summary

In one embodiment, a method of providing a test framework in an on-demand services environment can include: accessing a plurality of tests via plug-ins to a core platform of the test framework; receiving, by a user interface, a selection of tests for execution from the plurality of tests, where the selected tests are configured to test a plurality of layers of a product; executing, by an execution engine coupled to the core platform, the selected tests; storing test results for the executed selected tests on a configurable repository; and reporting the stored test results in a summarized form on the user interface.