Machine Learning Scoring for Figure Drawing Visuospatial Tests

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Visuospatial tests like the Rey-Osterrieth Complex Figure Test (ROCFT) face challenges in remote and large-scale scoring due to the need for human grading, which is time-consuming and limited by the availability of trained professionals, especially with the rise of telehealth and blood-based biomarkers.

Innovation Solution

A web-based analytical pipeline using machine learning algorithms to automate the scoring of hand-drawn figure tests by receiving and processing image data through a machine learning algorithm trained on labeled reference subject data sets, enabling the generation of neuropsychological functioning scores.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If human grading is used for figure drawing tests, then scoring accuracy is maintained, but time consumption increases and scalability is limited

Engineering Contradiction:
Improvescoring accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent creates a digital copy of the human grading process through a machine learning model. The model is trained on extensively annotated datasets of figure drawing test responses, capturing the grading criteria and patterns. When new test responses are submitted, the trained model generates scores automatically, replicating the expert human grading process without requiring actual human graders for each new case.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical human grading system with an automated computational system. Instead of human neuropsychologists manually evaluating each drawing, the system uses machine learning algorithms that process digital images of drawings, extract relevant features, and generate scores based on trained patterns and criteria, thereby eliminating the time-consuming manual process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If human grading is used for figure drawing tests, then scoring reliability is maintained, but availability of trained professionals is limited

Engineering Contradiction:
Improvescoring reliabilityVSAvoidavailability of trained professionals
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent captures the expertise of trained professionals by training machine learning models on extensively annotated datasets that encode grading criteria and patterns. The trained model replicates the scoring behavior of qualified professionals, making the scoring capability available anywhere without requiring physical presence or specialized training of human graders.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms the scoring system from a human-dependent parameter (availability of trained professionals) to a system-independent parameter (availability of computing resources and trained models). This allows the scoring service to be deployed remotely and scaled without being constrained by the limited pool of qualified human graders.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If remote scoring is implemented, then accessibility is improved, but technical complexity increases

Engineering Contradiction:
Improveremote accessibilityVSAvoidtechnical complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a centralized machine learning scoring service as an intermediary between the test administration system and the scoring process. This intermediary handles all the technical complexity of image processing, feature extraction, and score generation, while presenting a simple interface to users for submitting and receiving scores, thereby isolating complexity from the user-facing system.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20230260644A1Methods, systems, and computer readable media for grading figure drawing visuospatial tests
Publication Date: 2023.08.17 THE ARIZONA BOARD OF REGENTS ON BEHALF OF THE UNIV OF ARIZONA
  • US20230260644A1 patent drawing
  • US20230260644A1 patent drawing
  • US20230260644A1 patent drawing

AI summary

Provided herein are methods of generating neuropsychological functioning scores from test subject data. The methods include receiving a set of images produced by a test subject in which at least a first of the images comprises a rendition of a target image produced by the test subject at a first time point, and in which at least a second of the images comprises a rendition of the target image produced by the test subject at a second time point that differs from the first time point to produce the test subject data. The methods further include passing the test subject data through a trained machine learning algorithm and outputting from the trained machine learning algorithm a neuropsychological functioning score indicated by the test subject data. Additional methods as well as related systems and computer readable media are also provided.