Multi-Mode Testing Framework for Multi-Tenant Database

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In multi-tenant database systems, testing across various operational modes such as user interfaces, remote APIs, and local APIs is inefficient due to the need for replicating test scenarios across multiple test suites, leading to increased effort and redundant test code.

Innovation Solution

A multi-mode testing framework that abstracts and separates operational functions from test scenarios, allowing the same test code to be used across different interfaces, with defined test operations and scenarios that can be executed for each interface, thereby eliminating the need for redundant test code.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If test scenarios are replicated across multiple test suites for different operational modes, then testing coverage is improved, but test automation effort and code redundancy increase

Engineering Contradiction:
Improvetesting coverageVSAvoidtest code redundancy
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent creates a universal test scenario template that can be executed across multiple operational modes (UI, Remote API, Local API) without replication. The test scenario is designed to be mode-agnostic, accepting the operational mode as a parameter, thereby achieving multi-functionality where a single test scenario serves all testing purposes across different interfaces.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges previously separate test scenarios for different operational modes into a single unified test scenario. By combining the test logic and eliminating duplicates, the system achieves comprehensive testing coverage while reducing the overall volume of test code required.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If separate test automation is created for each operational mode, then mode-specific testing is improved, but test automation effort increases

Engineering Contradiction:
Improvemode-specific testingVSAvoidtest automation effort
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The test scenario is designed with universal applicability across all operational modes. It accepts parameters such as operational mode, interface type, and endpoint URL, allowing the same test logic to function universally while maintaining mode-specific testing capabilities through parameterization rather than code duplication.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent utilizes parameter changes to adapt a single test scenario to different operational modes. By varying parameters such as the operational mode identifier, interface configuration, and endpoint details, the same test scenario can be executed across UI, Remote API, and Local API modes without modifying the core test logic.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If redundant test code is used across multiple test suites, then testing completeness is improved, but deployment complexity increases

Engineering Contradiction:
Improvetesting completenessVSAvoiddeployment complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges redundant test code into a single shared test scenario that is referenced by all operational mode test suites. This consolidation maintains testing completeness through comprehensive parameter coverage while significantly reducing deployment complexity by eliminating the need to deploy and maintain duplicate test code across multiple locations.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9529698B2Method and system for multi-mode testing through operation interface and scenario abstraction in a multi-tenant database environment
Publication Date: 2016.12.27 SALESFORCE INC
  • US9529698B2 patent drawing
  • US9529698B2 patent drawing
  • US9529698B2 patent drawing

AI summary

Embodiments are described for a system and method for testing a hosted application through a test framework that uses the same operational test code for any one of a plurality of application interfaces. A method under embodiments defines a set of test operations comprising a test for the hosted application, each test operation interacting with the application through an interface of a plurality of interfaces; defines a set of test scenarios, with each test scenario including a number of generic test steps and test operations, and wherein each test scenario includes a function call to the test operation corresponding to the interface to be tested; and executes one or more of the test scenarios to implement a test on the interface to be tested for the hosted application.