Automated Application Change Success Rating System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Application development teams face challenges in defining measurable goals for application changes and tracking their achievement, due to limited access to production monitors and a focus on user perspectives rather than technical aspects.
Innovation Solution
A system and method for determining application change success ratings in an automated manner, where user-defined success criteria are received and evaluated through evaluation code executed upon production deployment, providing a dashboard interface or email notifications for development teams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If automated evaluation systems are implemented, then productivity and measurement precision improve, but device complexity increases
Solution Approach 1:
The patent introduces an automated evaluation system that acts as an intermediary between production deployment and success criterion verification. This system includes evaluation code that automatically collects data from production monitors, compares results against success criteria, and generates success ratings without requiring manual intervention from development teams.
Solution Approach 2:
The evaluation system is designed to autonomously perform goal tracking by automatically executing evaluation code, collecting performance data from production environments, comparing results against predefined success criteria, and generating success ratings. This self-service capability eliminates the need for manual monitoring while maintaining comprehensive tracking.
2Loss of time
If manual goal tracking is used, then system complexity remains low, but loss of time and productivity decrease
Solution Approach 1:
The system requires development teams to pre-define success criteria and provide evaluation code before production deployment. This preliminary action enables automated tracking to begin immediately upon deployment, eliminating the time lag associated with manual goal definition and tracking setup.
Solution Approach 2:
The automated evaluation system continuously monitors production performance against success criteria and provides immediate feedback through success ratings. This real-time feedback loop enables development teams to quickly assess whether application changes are meeting their goals, significantly reducing the time loss associated with manual tracking.
3Ease of operation
If development teams focus on user perspective rather than technical aspects, then ease of operation improves, but measurement precision may worsen
Solution Approach 1:
The automated evaluation system serves as an intermediary that translates user-centric success criteria into precise technical measurements. Development teams can define goals in user-friendly terms while the system automatically handles the technical implementation of data collection and comparison against predefined criteria.
Solution Approach 2:
The evaluation system is designed to handle both user perspective goals and technical measurements universally. It can process diverse success criteria types (performance metrics, user satisfaction indicators, business goals) through a unified automated framework, maintaining both ease of operation and measurement precision across different goal types.
Data Source
AI summary
In one example of the disclosure, a user-defined success criterion for an application change is received. The criterion is provided to a computing system associated with a developer-user of the application. Evaluation code, for evaluating implementation of the change according to the criterion, is received from the computing system. The evaluation code is caused to execute responsive to receipt of a notice of production deployment of the change. A success rating for the change is determined based upon application performance data attained via execution of the evaluation code.