Survey Qualification Filter for Response Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Surveys often suffer from inaccurate responses from participants, either for compensation or due to time considerations, which undermines the reliability and usefulness of the results.
Innovation Solution
A software and hardware facility is developed to identify accurate responders by posing qualification questions, including 'unlikely' and 'fabrication gauge' questions, which helps to filter out unreliable responses by discarding participants who answer inappropriately, thereby isolating those likely to provide accurate answers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If survey participants are allowed to respond freely without qualification filtering, then survey completion rate and response quantity are improved, but response accuracy and data reliability deteriorate
Solution Approach 1:
The patent applies preliminary action by implementing qualification questions and fabrication gauge questions before the main survey to pre-filter respondents. This preliminary screening process identifies and excludes likely inaccurate responders (such as bots and malicious participants) before they can contaminate the survey data, thereby maintaining high completion rates among genuine participants while ensuring response accuracy through pre-qualification.
Solution Approach 2:
The patent employs feedback mechanisms by using fabrication gauge questions with known answer distributions to monitor and detect response patterns. The system compares actual survey responses against expected patterns, providing feedback that helps identify and filter out inaccurate respondents. This feedback loop enables continuous quality control throughout the survey process.
2Reliability
If qualification questions and fabrication gauge questions are added to filter respondents, then response accuracy is improved, but survey complexity and administration time increase
Solution Approach 1:
The patent applies parameter changes by utilizing fabrication gauge questions with known statistical parameters (expected answer distributions). By comparing actual survey responses against these predetermined parameters, the system can automatically identify outliers and filter inaccurate respondents. This statistical approach adds minimal structural complexity while effectively improving response accuracy through objective, data-driven filtering.
3Measurement precision
If fabrication gauge questions are used to detect lying respondents, then identification of accurate responders is improved, but survey time and respondent burden increase
Solution Approach 1:
The patent applies partial action by using a limited number of fabrication gauge questions (typically 1-3 questions) rather than extensive qualification batteries. This partial approach is sufficient to detect lying respondents and filter inaccurate data without imposing excessive time burdens. The system uses these minimal questions strategically to achieve the desired measurement precision in identifying accurate responders.
Data Source
AI summary
A survey data structure is described that specifies how to administer a survey to each of a group of people. The data structure contains an entry that specifies text that poses a fabrication gauge question for which a percentage of the population who can accurately answer the fabrication gauge question affirmatively is known. The data structure further contains a plurality of entries that each specify text posing an unlikely question for which the percentage of the population who can accurately answer the unlikely question affirmatively is small. The data structure specifies how to conduct a survey that serves as a basis for determining which people to whom the survey is administered are responding truthfully to the survey.