Automated IVR Testing System for VoiceXML Quality Assurance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Manual testing and quality assurance of Interactive Voice Response (IVR) applications are time-consuming, tedious, and expensive, as they require human testers to rigorously test speech applications against VoiceXML specifications.
Innovation Solution
An automated system that allows users to input conditions for testing IVR applications, including call flow diagrams and dialog states, which can automatically perform testing and generate logs of issues, reducing the need for manual intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual testing by human QA testers is used to rigorously test IVR applications against VoiceXML specifications, then testing thoroughness and reliability are improved, but time consumption and cost increase significantly
Solution Approach 1:
The system enables automated self-testing of IVR applications by having the testing system automatically generate test calls, execute test scenarios, and generate reports without requiring continuous human intervention. The system can autonomously navigate through dialog states and test VXML elements, allowing the testing process to serve itself rather than relying on manual QA testers for every execution.
Solution Approach 2:
The patent replaces the mechanical system of manual human testing with an automated electronic testing system. The testing system uses software-based test call generation and automatic scenario execution to substitute for human testers, thereby maintaining testing thoroughness while dramatically reducing time consumption and eliminating the need for manual mechanical operations.
2Reliability
If manual testing by human QA testers is used to rigorously test IVR applications, then testing quality is improved, but cost increases significantly
Solution Approach 1:
The automated testing system performs self-service by automatically executing test scenarios and generating reports without requiring continuous human resource allocation. This eliminates recurring labor costs while maintaining high testing quality through systematic coverage of all dialog states and VXML elements, thereby reducing energy expenditure in the form of financial cost.
Solution Approach 2:
The patent substitutes expensive manual human testing operations with an automated electronic testing system. This mechanical substitution eliminates the need to pay human testers for each testing session, thereby significantly reducing cost while maintaining testing quality through consistent and repeatable automated test execution.
3Productivity
If automated testing system is implemented to reduce manual intervention, then productivity and efficiency are improved, but system complexity increases
Solution Approach 1:
The testing system is designed with multi-functionality to handle various testing scenarios uniformly. It can automatically generate test calls, execute different types of test scenarios (including normal flow and error conditions), navigate through multiple dialog states, and generate comprehensive reports. This universal capability allows a single system to perform multiple testing functions, improving productivity without proportionally increasing complexity.
Solution Approach 2:
The system introduces an intermediary testing framework that sits between the IVR application and the testing execution. This framework automatically manages the complexity of test scenario generation, test call coordination, and result aggregation, thereby shielding users from the underlying system complexity while delivering high productivity through automated testing.
4Loss of time
If automated testing system is implemented, then time consumption is reduced, but device complexity increases
Solution Approach 1:
The system performs preliminary actions by pre-defining test scenarios and organizing them into structured formats before actual testing execution. Test scenarios are prepared in advance with all necessary parameters and expected outcomes configured, allowing the automated system to execute tests rapidly without requiring complex real-time decision-making, thereby reducing testing time while managing complexity through upfront preparation.
Solution Approach 2:
The testing system introduces an intermediary automation layer that manages the complexity of coordinating test calls, navigating dialog states, and collecting results. This intermediary framework handles the time-consuming coordination tasks automatically, reducing overall testing time while containing system complexity within the automated framework rather than requiring complex manual coordination procedures.
Data Source
AI summary
A system receives a condition for an interactive voice response (IVR) application, automatically tests the IVR application based on the received condition, and generates a test result based on the automatic testing of the IVR application.