Product Test Orchestration via Virtual Device Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Testing of complex computer applications across diverse ecosystems is time-consuming and expensive, as existing methods struggle to accurately simulate the numerous interactions and configurations, making it difficult to ensure comprehensive testing across different components and conditions.
Innovation Solution
A product test orchestration apparatus and method that dynamically selects automation testing tools, devices, and simulators to orchestrate end-to-end testing across multiple industry ecosystems, using user-defined information to identify the most relevant devices and protocols, and executing test operations with robotic manipulators to mimic human interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If comprehensive testing across all device configurations is performed, then testing coverage is improved, but testing time and cost increase significantly
Solution Approach 1:
The patent applies partial action by selecting and testing only a representative subset of device configurations rather than exhaustively testing all possible combinations. The system identifies key devices based on market share and compatibility importance, performing testing on these critical configurations while skipping less important ones, thus achieving acceptable coverage with reduced time and cost.
Solution Approach 2:
The patent uses virtualization and emulation technologies to create copies of physical devices and their operating environments. Instead of requiring actual hardware for every test configuration, the system generates virtual instances that replicate device behavior, enabling comprehensive testing of software compatibility across multiple device types without the time and cost of physical device proliferation.
2Reliability
If comprehensive testing across all device configurations is performed, then testing coverage is improved, but testing cost increases significantly
Solution Approach 1:
The patent implements a universal testing platform that can accommodate multiple device types, operating systems, and configurations through virtualization. A single testing infrastructure can dynamically provision different virtual device environments, eliminating the need for separate physical testing labs for each device configuration, thereby significantly reducing overall testing costs while maintaining comprehensive coverage.
Solution Approach 2:
By using virtual copies and emulations of device environments rather than physical hardware for every test case, the system reduces costs associated with purchasing, maintaining, and managing large numbers of physical test devices. The virtualized environments can be rapidly provisioned and disposed of without hardware costs.
3Productivity
If automated testing tools are used to reduce testing time, then productivity is improved, but device complexity increases
Solution Approach 1:
The patent introduces an intermediary layer of virtualization and abstraction between the automated testing tools and the physical devices. This intermediary manages the complexity by handling device provisioning, configuration, and teardown automatically, allowing simple automated scripts to interact with complex device environments without requiring the testing tools themselves to become increasingly complex.
Data Source
AI summary
According to an example, product test orchestration may include accessing user-defined information of a product to be tested and identifying, based upon the accessed user-defined information, a set of devices on which the product is to be tested and a set of testing tools to be implemented on the identified set of devices to test the product. Product test orchestration may further include generating test operations for the identified set of testing tools to be implemented on the identified set of devices, executing the generated test operations on the identified set of devices, tracking results of the executed test operations, and generating a report of the tracked results.


