Cloud Validation Service Automating Certification Test Execution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current cloud validation methods are manual, prone to errors, and costly, requiring parties to manually locate, download, and upload tools and test results, which can lead to delays and inefficiencies in ensuring cloud compliance with operational or performance goals.
Innovation Solution
The implementation of a cloud validation service that automates the delivery of certification tests, execution, and result uploading, using validation servers outside the candidate cloud to monitor and analyze test results, and providing a certification test execution infrastructure that can run within or outside the candidate cloud, ensuring thorough and efficient validation without relying on internet-exposed endpoints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If manual cloud validation methods are used, then parties can perform validation testing, but the process is prone to errors, costly, and requires significant human intervention to locate, download, and upload tools and test results
Solution Approach 1:
The system enables self-service automation where the validation service automatically performs test execution, result collection, and analysis without requiring manual human intervention. The validation service provider's system autonomously manages the entire validation workflow, eliminating the need for parties to manually locate, download, and upload tools and test results.
Solution Approach 2:
A validation service acts as an intermediary between the cloud service provider and the validation testing infrastructure. This intermediary automates the coordination of test execution, result collection, and analysis, replacing manual operations with automated service-mediated processes that reduce both time and error rates.
2Productivity
If manual validation processes are used, then validation can be performed, but delays and inefficiencies occur in ensuring cloud compliance with operational or performance goals
Solution Approach 1:
The system performs preliminary actions by pre-configuring validation test suites and automating their deployment to the cloud environment before actual validation is needed. Test scripts, validation tools, and execution environments are prepared in advance, enabling immediate execution when validation is required, thus eliminating setup delays.
Solution Approach 2:
The validation process operates continuously through automated scheduling and execution of test suites. The system maintains continuous validation capability by automatically re-running tests, updating test results, and providing real-time compliance status, eliminating the interruptions and delays inherent in manual validation processes.
3Reliability
If cloud validation is performed with manual processes, then testing can occur, but cost-effectiveness is reduced due to manual labor requirements
Solution Approach 1:
Manual mechanical operations (human operators performing validation tasks) are replaced with automated computational systems. The validation service uses automated scripts, algorithms, and software agents to execute tests and analyze results, eliminating the need for manual labor while improving both accuracy and cost-effectiveness through systematic automation.
Solution Approach 2:
The system uses standardized test templates and validation scripts that can be copied and reused across multiple validation scenarios. Instead of manually creating custom validation procedures for each case, pre-defined test suites are replicated and adapted automatically, reducing both the cost and time of validation while maintaining consistent accuracy standards.
Data Source
AI summary
Described technologies facilitate cloud validation using validation as a service (VaaS). A cloud validation service provider acquires and securely stores certification tests developed by cloud component providers, integrated solution providers, and others. Each test's executable portion tests hardware or software of a candidate cloud. The candidate may be on the premises of an enterprise, or instead be a hosted cloud on the premises of a hoster off the premises of the entity that pays for the hosting. Monitored testing is done using an infrastructure in the candidate cloud or in a public cloud. Results are uploaded to the VaaS provider, which provides an analysis of test results for use in determining whether to validate the candidate cloud. Test execution agents may be VaaS-cloud-resident or candidate-cloud-resident, and may use a mutex to prevent simultaneous execution of tests. Testing may be accomplished even when the candidate cloud has no internet-exposed communication endpoint.


