Video-Based Communication Assessment Using Crowd-Sourced Raters

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for assessing communication skills in professionals, particularly healthcare providers, are inadequate as they lack convenience, efficiency, and cost-effectiveness, providing few opportunities for practice and constructive feedback.

Innovation Solution

A video-based communication assessment method that uses brief audiovisual vignettes, where participants respond orally, and their responses are rated by crowd-sourced raters, providing detailed feedback and ratings for improvement and training targeting.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional communication skills assessment methods are used, then assessment can be conducted, but the process is time-consuming, costly, and provides limited feedback opportunities

Engineering Contradiction:
Improveassessment efficiencyVSAvoidtime for practice and feedback
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent uses video recordings of patient encounters as substitutes for live observation. These video copies allow multiple raters to assess the same encounter without requiring the physician's time, enabling efficient assessment while providing detailed feedback on communication skills

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces a structured rating form and multiple raters as intermediaries between the physician's communication and the assessment outcome. This intermediary system enables systematic evaluation and provides comprehensive feedback that would be difficult to obtain through direct observation alone

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If more opportunities for communication practice and feedback are provided, then communication skills improve, but the cost and time requirements increase significantly

Engineering Contradiction:
Improvecommunication skills competencyVSAvoidcomplexity of assessment system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides the assessment into discrete components using a structured rating form that evaluates specific communication behaviors separately. This segmentation allows for targeted feedback on particular skills while maintaining overall assessment efficiency

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The video-based assessment system serves multiple functions: it assesses communication skills, provides feedback, identifies training needs, and documents competency. This multi-functionality reduces the need for separate assessment tools and processes

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If detailed feedback on communication skills is provided, then skill improvement is enabled, but the assessment process becomes more complex and resource-intensive

Engineering Contradiction:
Improvefeedback specificityVSAvoidassessment system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality by providing specific feedback on particular communication behaviors rather than general assessments. The rating form focuses on specific observable actions, allowing targeted improvement while maintaining systematic assessment

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10860963B2Methods and systems for video-based communication assessment
Publication Date: 2020.12.08 NAT BOARD OF MEDICAL EXAMINERS
  • US10860963B2 patent drawing
  • US10860963B2 patent drawing

AI summary

Methods and systems for assessing communication skills of a professional are described. The professional may be a healthcare provider or any other professional having a position in which communication skills are highly valued. The communication skills of the professional are assessed using crowd-sourced raters to increase reliability of results. Feedback reports may also be created for use by the professional to improve communication skills.