Social Competency Assessment in Immersive Virtual Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems face challenges in objectively assessing interactions between practitioners and patients, particularly in generating accurate data for evaluating social skills and progress in therapy.

Innovation Solution

A system that utilizes a speech-to-text conversion, dialog management, and response verification to generate objective assessment criteria for social skills, incorporating strategic attention scores and user feedback to adjust social competency scores.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a system is designed to objectively assess practitioner-patient interactions, then measurement precision of social skills is improved, but device complexity increases due to multiple processing systems

Engineering Contradiction:
Improveobjective assessment precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the assessment process into distinct functional modules: audio data collection, speech-to-text conversion, dialog management, strategic attention scoring, and response verification. Each module handles a specific aspect of the interaction analysis, making the overall complex system manageable and maintainable while achieving comprehensive objective assessment

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system integrates multiple functions into a unified platform that simultaneously performs transcription, dialog analysis, attention scoring, and competency evaluation. This multi-functional approach consolidates what would otherwise require separate systems, reducing overall complexity while maintaining measurement precision

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If automated dialog management and scoring systems are implemented, then productivity of assessment is improved, but ease of operation decreases due to complex feedback mechanisms

Engineering Contradiction:
Improveassessment efficiencyVSAvoidsystem usability
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system incorporates automated feedback loops where response verification data from practitioners is used to adjust and refine strategic attention scores. This feedback mechanism maintains ease of operation by automatically handling complex adjustments while improving productivity through continuous system learning and adaptation

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The dialog management system automatically performs speech-to-text conversion, generates initial scores, and processes verification feedback without requiring manual intervention for each interaction. This automation significantly improves assessment productivity while keeping the practitioner's role simple and focused on verification

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20250157625A1System and method for evaluating and coaching social competencies in immersive virtual environments
Publication Date: 2025.05.15 BOARD OF RGT THE UNIV OF TEXAS SYST
  • US20250157625A1 patent drawing
  • US20250157625A1 patent drawing
  • US20250157625A1 patent drawing

AI summary

A system for generating objective assessment criteria of social skills, comprising a speech to text system receiving audio data and converting the audio data into text data for a first speaker and a second speaker, a dialog management system processing text data for the first speaker and text data for the second speaker generating a strategic attention score for the first speaker based on responsiveness of the text data of the first speaker to text data of the second speaker, and a response verification system generating a user control for the strategic attention score and receiving feedback data from the second speaker to accept or modify the strategic attention score.