Machine Learning Scoring for Figure Drawing Visuospatial Tests
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Visuospatial tests like the Rey-Osterrieth Complex Figure Test (ROCFT) face challenges in remote and large-scale scoring due to the need for human grading, which is time-consuming and limited by the availability of trained professionals, especially with the rise of telehealth and blood-based biomarkers.
Innovation Solution
A web-based analytical pipeline using machine learning algorithms to automate the scoring of hand-drawn figure tests by receiving and processing image data through a machine learning algorithm trained on labeled reference subject data sets, enabling the generation of neuropsychological functioning scores.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If human grading is used for figure drawing tests, then scoring accuracy is maintained, but time consumption increases and scalability is limited
Solution Approach 1:
The patent creates a digital copy of the human grading process through a machine learning model. The model is trained on extensively annotated datasets of figure drawing test responses, capturing the grading criteria and patterns. When new test responses are submitted, the trained model generates scores automatically, replicating the expert human grading process without requiring actual human graders for each new case.
Solution Approach 2:
The patent replaces the mechanical human grading system with an automated computational system. Instead of human neuropsychologists manually evaluating each drawing, the system uses machine learning algorithms that process digital images of drawings, extract relevant features, and generate scores based on trained patterns and criteria, thereby eliminating the time-consuming manual process.
2Reliability
If human grading is used for figure drawing tests, then scoring reliability is maintained, but availability of trained professionals is limited
Solution Approach 1:
The patent captures the expertise of trained professionals by training machine learning models on extensively annotated datasets that encode grading criteria and patterns. The trained model replicates the scoring behavior of qualified professionals, making the scoring capability available anywhere without requiring physical presence or specialized training of human graders.
Solution Approach 2:
The patent transforms the scoring system from a human-dependent parameter (availability of trained professionals) to a system-independent parameter (availability of computing resources and trained models). This allows the scoring service to be deployed remotely and scaled without being constrained by the limited pool of qualified human graders.
3Ease of operation
If remote scoring is implemented, then accessibility is improved, but technical complexity increases
Solution Approach 1:
The patent introduces a centralized machine learning scoring service as an intermediary between the test administration system and the scoring process. This intermediary handles all the technical complexity of image processing, feature extraction, and score generation, while presenting a simple interface to users for submitting and receiving scores, thereby isolating complexity from the user-facing system.
Data Source
AI summary
Provided herein are methods of generating neuropsychological functioning scores from test subject data. The methods include receiving a set of images produced by a test subject in which at least a first of the images comprises a rendition of a target image produced by the test subject at a first time point, and in which at least a second of the images comprises a rendition of the target image produced by the test subject at a second time point that differs from the first time point to produce the test subject data. The methods further include passing the test subject data through a trained machine learning algorithm and outputting from the trained machine learning algorithm a neuropsychological functioning score indicated by the test subject data. Additional methods as well as related systems and computer readable media are also provided.


