Electronic Debriefing System for Objective Flight Crew Competency Assessment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for evaluating flight crew performance during evidence-based training sessions are subjective and unreliable, relying on instructors' memory and paper-based recordings, which hinder the integration of video and data recordings, leading to inconsistent and inaccurate competency assessments.

Innovation Solution

A system comprising a communications module, real-time data acquisition module, input unit, real-time instructor rating module, storing module, and debriefing module, along with an artificial intelligence system, that acquires, timestamps, and integrates training session data and instructor ratings, providing real-time feedback and objective assessments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If paper-based recording methods are used for instructor ratings, then the system complexity is reduced, but the reliability and consistency of competency assessments deteriorate

Engineering Contradiction:
Improvereliability of competency assessmentsVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical paper-based recording system with an electronic digital system that automatically captures instructor ratings, video data, and training device data. This substitution eliminates the need for manual note-taking and paper forms, enabling reliable digital storage and processing of assessment data while maintaining system functionality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates digital copies of instructor ratings, video recordings, and training data that can be stored, retrieved, and analyzed consistently. The system captures and stores electronic versions of all training data, allowing for reliable retrieval and analysis without the limitations of paper-based systems, thereby improving assessment reliability while managing complexity through standardized digital formats.

Inventive Principle:
Principle #26Copying

2Measurement precision

If video and data recordings are integrated into debriefing, then the measurement precision of competency evaluation is improved, but the device complexity increases

Engineering Contradiction:
Improveprecision of competency evaluationVSAvoiddebriefing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple data sources including video recordings, training device data, and instructor ratings into a single integrated debriefing system. The system combines these data types in a unified interface that allows simultaneous access and analysis, improving measurement precision by providing comprehensive viewing options while managing complexity through integrated architecture rather than separate systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a universal debriefing system that handles multiple functions: displaying video data, presenting training device information, capturing instructor ratings, and providing competency assessment tools. This multi-functional approach improves measurement precision by consolidating all evaluation capabilities in one system while avoiding the complexity of multiple separate systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If real-time data acquisition and processing is implemented, then the productivity of training evaluation is improved, but the device complexity increases

Engineering Contradiction:
Improveproductivity of training evaluationVSAvoiddata processing system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements preliminary data acquisition and processing during the training session itself, capturing video data, training device information, and instructor ratings in real-time. This preliminary action eliminates the need for post-session data collection and manual processing, improving productivity by preparing all evaluation data upfront while managing complexity through automated real-time capture rather than manual post-processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system performs self-service data collection and processing automatically during training sessions. The real-time data acquisition module captures and processes training data without requiring manual intervention, and the system automatically timestamps and stores all data. This automation improves productivity by eliminating manual data collection steps while managing complexity through standardized automated processes.

Inventive Principle:
Principle #25Self-service

4Reliability

If automated real-time instructor rating generation is implemented, then the reliability of ratings is improved, but the device complexity increases

Engineering Contradiction:
Improvereliability of instructor ratingsVSAvoidrating system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements real-time feedback mechanisms where the system automatically generates and displays instructor ratings based on captured data, providing immediate feedback during the training session. This feedback loop improves reliability by ensuring consistent, objective rating generation while managing complexity through automated feedback processes rather than manual evaluation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces manual instructor rating generation with an automated electronic system that processes training data and generates ratings in real-time. This substitution improves reliability by eliminating human error and inconsistency in rating generation while managing complexity through standardized automated algorithms and electronic processing rather than manual procedures.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10755591B2Electronic device and method for debriefing evidence-based training sessions
Publication Date: 2020.08.25 THE BOEING CO
  • US10755591B2 patent drawing
  • US10755591B2 patent drawing
  • US10755591B2 patent drawing

AI summary

An electronic device for collecting evidence during training sessions. The electronic device comprises a communications module for acquiring real-time training session data during a training session; a real-time data acquisition module for generating time-stamped training session data; an input unit for acquiring instructor rating data input by an instructor during the training session; a real-time instructor rating module for generating time-stamped instructor rating data; a storing module for storing real-time data of the training session in a data repository, including the time-stamped training session data and the time-stamped instructor rating data; a debriefing module for retrieving real-time data of a training session from the data repository, replay the real-time data on a display, and update the instructor rating data in the data repository with updated instructor rating data received from an instructor during the replay.