Virtual Reader Automates Application Scoring Consistency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Charitable organizations face challenges in processing and scoring applications due to limited human resources and variability in reader scores, leading to delays and confusion in determining deserving applicants for funding.
Innovation Solution
An automated system processes applications, assigns them to reader resources, calculates delta values and standard deviations of scores, adjusts scores as necessary, and recruits additional readers to ensure scores are within predetermined limits, ultimately ranking applications for funding decisions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual processing by human readers is used, then scoring can be performed, but limited human resources cause delays and bottlenecks in processing applications
Solution Approach 1:
The patent introduces a virtual reader system that acts as an intermediary between applications and human readers. The virtual reader automatically processes applications, performs preliminary scoring, and manages the workflow, thereby eliminating the bottleneck of manual processing while maintaining the ultimate authority of human readers for final decisions.
Solution Approach 2:
The system performs preliminary actions by automatically processing applications before they reach human readers. This includes initial scoring, categorization, and preparation of materials, so that when human readers do review applications, they can do so more efficiently with pre-analyzed information already prepared.
2Reliability
If multiple human readers score applications, then scoring can be performed, but variability in reader scores leads to confusion and disagreement
Solution Approach 1:
The patent changes the parameters of scoring by introducing standardized criteria and automated calculation methods. The virtual reader applies consistent scoring parameters across all applications, reducing variability caused by different human readers' subjective interpretations while maintaining the ability to handle complex scoring scenarios.
3Productivity
If automated processing is implemented, then processing speed increases, but determining appropriate reader assignment presents challenges
Solution Approach 1:
The virtual reader system performs self-service by automatically determining reader assignments based on application characteristics and reader availability. The system independently manages the complex matching process without requiring manual intervention, thereby maintaining high processing efficiency while simplifying the operational aspect of reader assignment.
Data Source
AI summary
A system, method, and computer-readable medium are disclosed for the automated processing and scoring of applications. Application reader resources are selected to read and score individual categories of the application. The difference between the respective reader scores and an average delta value for each category of each application that the selected readers have previously score is calculated. The standard deviation of the average delta value for each category is calculated. If the selected reader's score for that category is not within one standard deviation of the average delta value, then the selected reader's score is adjusted the least amount necessary to be so. An additional application reader is selected to read and score the application. Reading and scoring operations are continued until at least two reader scores are within one standard deviation of the average of the adjusted scores. Final scoring of all applications is performed and the scored applications are ranked in descending order.