Automated Essay Scoring with Genre-Specific Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Standardized essay evaluation and scoring systems are labor-intensive and provide limited feedback, especially for instructional purposes, as they rely heavily on human scorers and offer generalized feedback that does not address micro-level mechanics and organization of essays.
Innovation Solution
A software-implemented, on-line system that provides real-time, automated scoring and feedback on essay mechanics and organization, allowing for genre-specific, individualized instruction and feedback, and the ability to factor open-ended responses into multiple conceptual areas, while accommodating different languages and proficiency levels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If human scorers are used to evaluate essays, then scoring accuracy and nuance are improved, but labor intensity and cost increase significantly
Solution Approach 1:
The patent replaces the mechanical human scoring process with an automated computer-based evaluation system that uses algorithms to assess essay responses. The system automatically scores essays based on predefined criteria and rubrics, eliminating the need for human scorers while maintaining scoring consistency and reducing labor intensity.
Solution Approach 2:
The evaluation system performs self-assessment by automatically analyzing essay responses against predefined scoring criteria. The system independently completes the scoring process without requiring external human intervention, enabling the system to serve itself in the evaluation function.
2Productivity
If automated scoring systems are implemented, then labor intensity is reduced, but feedback specificity and instructional value deteriorate
Solution Approach 1:
The patent segments the essay evaluation process into multiple distinct dimensional criteria (e.g., content, organization, language use, mechanics). Each dimension is scored separately using predefined rubrics, allowing the system to provide specific feedback on individual aspects of writing while maintaining automated operation. This segmentation enables detailed feedback without increasing labor intensity.
Solution Approach 2:
The system changes the parameters of feedback delivery by providing automated, specific feedback on multiple writing dimensions simultaneously. Instead of general feedback, the system delivers targeted parameter-specific feedback (content relevance, organizational structure, language quality, mechanical accuracy) based on automated analysis of essay responses.
3Ease of operation
If general feedback comments are provided, then overall characterization is improved, but micro-level mechanics and organization feedback is lost
Solution Approach 1:
The patent divides the feedback into multiple segmented categories corresponding to different writing dimensions. The system provides both overall characterization feedback and specific micro-level feedback on individual dimensions such as content development, organizational structure, language use, and mechanical accuracy. This segmentation allows detailed feedback on specific writing elements while maintaining ease of access to overall evaluation.
Solution Approach 2:
The system adds dimensional depth to feedback by transitioning from single-dimensional general comments to multi-dimensional specific feedback. The feedback structure includes multiple levels: overall essay characterization, dimensional breakdown (content, organization, language, mechanics), and specific item-level observations. This dimensional expansion provides micro-level precision while maintaining operational ease through structured presentation.
4Loss of time
If essay evaluation is conducted in real-time, then student learning and feedback utilization are improved, but system complexity and processing requirements increase
Solution Approach 1:
The patent implements preliminary action by pre-configuring the evaluation system with predefined scoring rubrics, criteria, and algorithms before student essays are submitted. The system is pre-programmed with the necessary evaluation logic and dimensional frameworks, enabling real-time automated scoring without requiring complex on-the-fly processing or sophisticated real-time analysis algorithms.
Data Source
AI summary
An on-line, computerized, software-driven system provides writing assessment of submitted essays with instructional feedback. The feedback incorporates comments and prompts provided to the user which are generated in response to the assessment evaluation of written text. Skill level and developmental level comments, remarks and prompts on various genre specific domain areas are provided in a real-time mode or in a request response mode, as elected by the user. Assessment and scores are provided by machine methods driven by a software engine. All appropriate comments and prompts are generated to the user by analysis logic software operating on a database of genre specific, educationally acceptable comments and prompts.