Automated Non-Technical Skill Assessment Using Odd-Scale Questionnaires
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for determining non-technical skills, such as multiple-choice questionnaires, are prone to bias and do not accurately capture the interdependencies between skills, leading to unreliable and incomplete results.
Innovation Solution
A computer-implemented method using a multiple-choice questionnaire with odd scales that allows for neutral responses, coupled with automated determination of skill values and correction mechanisms based on value thresholds and conditions, to provide reliable and precise assessments of non-technical skills without expert intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If multiple-choice questionnaires are used to determine non-technical skills, then the process can be automated, but the results are prone to bias and do not accurately capture interdependencies between skills
Solution Approach 1:
The patent transforms the assessment from simple multiple-choice responses to a structured questionnaire with specific response formats (odd scales with neutral options). This parameter change in the measurement scale allows for more nuanced data collection that captures interdependencies between skills while remaining suitable for automated processing.
Solution Approach 2:
The patent implements automated feedback mechanisms where the system processes questionnaire responses and generates skill assessments without human intervention. This feedback loop maintains automation while improving precision through systematic analysis of responses against predefined criteria and interdependency rules.
2Measurement precision
If expert intervention is used to correct biases and account for interdependencies, then measurement precision improves, but the extent of automation decreases
Solution Approach 1:
The patent enables the assessment system to self-correct biases and account for interdependencies through automated algorithms. The system independently processes questionnaire data, applies correction rules for interdependencies, and generates final assessments without requiring expert intervention, thus maintaining full automation while improving precision.
Solution Approach 2:
The patent introduces an automated intermediary processing layer between the questionnaire and final results. This intermediary systematically applies correction rules and accounts for skill interdependencies through algorithmic processing, replacing the need for human experts while maintaining measurement precision.
3Ease of operation
If standard multiple-choice questionnaires are used, then ease of operation is high, but reliability of results deteriorates due to bias and inability to capture skill interdependencies
Solution Approach 1:
The patent modifies the questionnaire parameters to use odd scales with neutral response options instead of standard even-scale multiple-choice. This parameter change maintains ease of operation while significantly improving reliability by reducing response bias and enabling capture of nuanced skill interdependencies.
Solution Approach 2:
The patent implements dynamic processing of questionnaire responses where the system automatically adjusts for interdependencies between skills based on response patterns. This dynamic approach maintains operational simplicity while improving reliability through systematic correction of biases and accounting for skill relationships.
Data Source
Figure 1~2
AI summary
The invention relates to a computer-implemented method for determining non-technical skills of a subject, said technical skills being able to be qualified from values of characteristics of the subject. The determination method comprising the following steps: submitting the subject to a multiple-choice questionnaire comprising a plurality of questions each relating to at least one of the characteristics of the subject, and automated determination, from answers given by the subject to the questions, of the values of the characteristics of the subject. The multiple choices of each question are based on odd scales, and during the automated determination step, a value threshold and a condition relating to said value threshold are provided for at least one characteristic of the subject, such that when said characteristic of the subject meets the condition relating to said threshold, a correction is applied to at least one other characteristic of the subject.