Dynamic Application Testing and Scoring System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current digital distribution platforms lack a comprehensive and unified testing procedure for applications, which fails to provide a holistic assessment of an application's performance across multiple tenets such as security, compliance, and compatibility, leading to inadequate evaluation of overall application quality and potential vulnerabilities.
Innovation Solution
A dynamic application testing and scoring system that categorizes applications into trust categories by assigning importance to different tenets, using a 360-degree scoring approach that weighs criteria and rulesets based on severity levels and priority, allowing for automatic determination of publication eligibility and dynamic adjustment of trust thresholds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a comprehensive testing system is implemented to evaluate applications across multiple tenets (security, compliance, compatibility), then the measurement precision of application quality is improved, but the device complexity and testing time increase
Solution Approach 1:
The testing system is segmented into multiple independent tenets (security, compliance, compatibility, performance), each evaluated separately with dedicated criteria and rulesets. This allows comprehensive evaluation while managing complexity through modular organization of testing components.
Solution Approach 2:
The patent introduces a multi-dimensional evaluation framework where applications are assessed across four distinct tenets, each with multiple criteria and rulesets. This dimensional approach enables holistic quality assessment by evaluating applications from multiple perspectives simultaneously rather than through a single complex metric.
2Reliability
If multiple criteria and rulesets are applied to evaluate different tenets, then the reliability of application evaluation is improved, but the productivity of the testing process decreases
Solution Approach 1:
The system dynamically assigns weights to different tenets, criteria, and rulesets based on their relative importance and the specific application context. This dynamic weighting mechanism allows the system to prioritize critical evaluation aspects while maintaining comprehensive coverage, balancing reliability with testing efficiency.
Solution Approach 2:
The patent employs parameter changes by adjusting the weightage assigned to different tenets, criteria priorities, and ruleset severities. This allows the testing system to adapt its evaluation stringency and focus based on application categories and risk levels, improving productivity by reducing unnecessary testing depth for lower-risk applications while maintaining high reliability for critical ones.
3Measurement precision
If a 360-degree scoring system with weighted tenets and criteria is implemented, then the measurement precision of trust assessment is improved, but the difficulty of detecting and measuring increases
Solution Approach 1:
The system incorporates feedback mechanisms where test results from each tenet and criterion feed into the overall trust score calculation. The weighted aggregation of results provides continuous feedback on application quality across different dimensions, enabling precise trust assessment while managing measurement complexity through structured information flow.
Solution Approach 2:
The patent uses parameter changes by systematically varying the weightage parameters of different tenets, criteria priorities, and ruleset severities in the scoring calculation. This structured parameter approach simplifies the measurement process by providing clear, adjustable weights for each evaluation component rather than requiring complex subjective judgments.
4Adaptability or versatility
If dynamic adjustment of trust thresholds is implemented based on feedback, then the adaptability of the testing system is improved, but the loss of time for system calibration increases
Solution Approach 1:
The system uses feedback from manual reviewer validations and testing results to automatically adjust trust thresholds and weightage parameters. This feedback-driven calibration reduces the time required for system adaptation by automating the learning process from historical data and expert judgments, minimizing manual intervention time while improving adaptability.
Solution Approach 2:
The testing system performs self-calibration by automatically adjusting its own parameters based on accumulated feedback from testing results and manual validations. This self-service capability reduces calibration time by eliminating the need for extensive manual reconfiguration, allowing the system to adapt to new application types and security landscapes autonomously.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A dynamic application testing and scoring system that tests applications under various tenets and categorizes the applications to be published, to be further reviewed or rejected. The results from administering a plurality of tests to an application are analyzed by applying rulesets that pertain to criteria under each of the tenets. An application score is determined from the analysis using weights associated with the tenets, priority levels of the criteria and the severity levels of the rulesets. The application score identifies a position for the application on a scoring scale relative to two trust threshold values. The application is categorized based on the position. Feedback regarding the categorization is received and the trust threshold values on the scoring scale can be adjusted if the categorization in the feedback is different from the categorization produced by the scoring system.