Automated Teaching Assessment System Using Speech Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current assessment methods for teacher performance are subjective, inefficient, and lack objectivity, making it difficult to provide consistent and constructive feedback for improving instructional practices.

Innovation Solution

The implementation of automatic speech recognition (ASR) and natural language understanding (NLU) technologies in the 'Teaching Buddy' system, which captures and analyzes classroom interactions to provide objective and meaningful measurements, leveraging existing assessment frameworks for deeper analytical insights.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual observation-based assessment is used, then ease of operation is maintained, but measurement precision and objectivity deteriorate

Engineering Contradiction:
Improveassessment accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an automated video analysis system as an intermediary between the teacher's instructional actions and the assessment process. The system captures classroom video, automatically transcribes speech, and analyzes instructional behaviors without requiring direct human observation, thereby improving objectivity while managing complexity through automated processing

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces manual observation and subjective judgment with automated computational analysis. Video recording and speech transcription technologies substitute for human observers, while algorithmic analysis replaces subjective assessment, transforming a manual process into an automated system that delivers more precise and objective measurements

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated speech recognition and analysis are implemented, then measurement precision and objectivity improve, but device complexity increases

Engineering Contradiction:
Improveassessment efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by automatically capturing and transcribing all classroom speech during instruction before analysis begins. Video recording and speech-to-text conversion occur in real-time or near-real-time, preparing structured data that can be rapidly analyzed, thereby improving assessment efficiency without proportionally increasing operational complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates digital copies of classroom interactions through video recording and speech transcription. These copies serve as analyzable data representations that can be processed automatically, allowing multiple analyses without requiring repeated observations, thus improving productivity while keeping the physical system relatively simple

Inventive Principle:
Principle #26Copying

Data Source

PatentUS8682241B2Method and system for improving the quality of teaching through analysis using a virtual teaching device
Publication Date: 2014.03.25 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US8682241B2 patent drawing
  • US8682241B2 patent drawing
  • US8682241B2 patent drawing

AI summary

A learning support method and system for a classroom includes a monitoring device configured to capture real-time participant events and stimuli in a learning environment. The participant events include classroom and collaboration-oriented input. A database is configured to store and organize a-priori skills of a typical student and a-priori knowledge a participating student. A set of cognitive model profiles are stored in system memory representing typical student behaviors and participant student behaviors with access to the captured participant events, the stimuli and the a-priori knowledge and skills. An interaction manager is configured to be responsive to the participant events and stimuli to perform interactive tasks during a class session. The interactive tasks may include posing a question, supplementing a lecture, tracking progress and rating teacher performance.