Automated Video Playback for Cognitive Data Collection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for collecting data on affective, behavioral, and cognitive processes in educational research are labor-intensive, expensive, and difficult to replicate, requiring significant expertise in both cognition and computer engineering, making them inefficient and time-consuming.

Innovation Solution

Processor-implemented methods for designing and administering experiments that involve recording participants' tasks, playback of recorded videos with accompanying questions, and data collection, allowing for automated setup and analysis of affective, behavioral, and cognitive data without interrupting the task performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If self-evaluation is asked during task performance, then affective, behavioral, and cognitive data can be collected, but task performance is distracted and evaluation results are skewed

Engineering Contradiction:
Improvedata collection completenessVSAvoidevaluation accuracy
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system records video data during task performance without interruption, then presents the recorded video with evaluation questions afterward. This preliminary recording action allows participants to provide accurate retrospective evaluations without being distracted during the actual task, resolving the contradiction between data collection completeness and evaluation accuracy.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If video playback with questions is used after task completion, then evaluation accuracy improves, but experiment setup becomes labor intensive and time consuming

Engineering Contradiction:
Improveevaluation accuracyVSAvoidexperiment setup time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system provides automated tools that enable researchers without extensive expertise in cognition or computer engineering to set up video playback experiments. The platform handles technical complexities automatically, allowing researchers to focus on designing meaningful evaluations, thus reducing setup time while maintaining evaluation accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

An automated experimental platform serves as an intermediary between researchers and the complex video playback experiment setup process. This intermediary provides pre-built templates and automated workflows that simplify the creation of video playback experiments with evaluation questions, reducing the labor intensity and time required while preserving evaluation accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If expert knowledge in cognition and computer engineering is required, then experiment quality improves, but accessibility and replicability decrease

Engineering Contradiction:
Improveexperiment qualityVSAvoidresearcher accessibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The platform enables researchers to conduct high-quality video playback experiments without requiring expert knowledge in cognition or computer engineering. By providing automated tools and templates, the system allows researchers to focus on their domain expertise while the platform handles technical implementation, thereby improving accessibility and replicability while maintaining experiment quality.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11568757B1Affective, behavioral, and cognitive processes data collection
Publication Date: 2023.01.31 EDUCATIONAL TESTING SERVICE
  • US11568757B1 patent drawing
  • US11568757B1 patent drawing
  • US11568757B1 patent drawing

AI summary

Systems and methods are provided for the design and implementation of experiments that facilitate the investigation of process data. The experiments involve recording the completion of a task by participants and then playing back the video of task completion to automatically probe participants about their affective, behavioral, and cognitive experiences. As a result of this system, information about affective, behavioral, and cognitive processes can be more easily investigated by researchers without computer programming knowledge. Corresponding apparatuses, systems, and methods are also discussed.