Biosignal Avatar Control via Multi-Source Signal Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies lack integrated systems that effectively measure and analyze biosignals like EEG, EMG, and EOG to control avatars in virtual reality environments for real-time feedback and evaluation/training protocols, focusing primarily on EEG signals and not utilizing a comprehensive biosignal approach.

Innovation Solution

A biosignal-based avatar control system that includes an avatar generating unit, biosignal measuring unit, command determining unit, avatar control unit, output unit, and protocol generating unit, processing biosignals through frequency filtering, spatial filtering, feature selection, and classification to control avatars in virtual reality environments for real-time feedback and task evaluation/training.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If only EEG signals are used for avatar control, then the system complexity is reduced, but the control precision and reliability are insufficient

Engineering Contradiction:
Improvesystem complexityVSAvoidcontrol precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent combines multiple biosignal types (EEG, EMG, EOG) into a unified avatar control system. The EEG signal processing unit, EMG signal processing unit, and EOG signal processing unit work together to provide comprehensive control signals, thereby improving control precision and reliability while maintaining manageable system complexity through modular architecture.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system is designed to process multiple types of biosignals (brainwaves, muscle signals, eye movement signals) through a universal control framework. This multi-functional approach allows the same system to handle diverse signal types and control various avatar actions, enhancing both precision and versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If comprehensive biosignal analysis is implemented, then the control reliability is improved, but the processing time and computational load increase

Engineering Contradiction:
Improvecontrol reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent divides the biosignal processing into separate modular units: EEG signal processing unit, EMG signal processing unit, and EOG signal processing unit. Each unit independently processes its specific signal type, reducing computational bottlenecks and enabling parallel processing, thereby maintaining high reliability while minimizing processing time.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary processing of biosignals through dedicated processing units that prepare control signals in advance. By pre-processing signals and maintaining ready-state control information, the system reduces real-time processing delays while ensuring reliable control responses.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If real-time feedback is provided through avatar control, then the training effectiveness is enhanced, but the system complexity and computational requirements increase

Engineering Contradiction:
Improvetraining effectivenessVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the controlled avatar's actions are displayed back to the user in real-time. This visual feedback loop allows users to see the direct result of their biosignal-based commands, enhancing training effectiveness and enabling neurofeedback applications while using standardized display technologies to manage complexity.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11609632B2Biosignal-based avatar control system and method
Publication Date: 2023.03.21 KOREA INST OF SCI & TECH
  • US11609632B2 patent drawing
  • US11609632B2 patent drawing
  • US11609632B2 patent drawing

AI summary

A biosignal-based avatar control system according to an embodiment of the present disclosure includes an avatar generating unit that generates a user's avatar in a virtual reality environment, a biosignal measuring unit that measures the user's biosignal using a sensor, a command determining unit that determines the user's command based on the measured biosignal, an avatar control unit that controls the avatar to perform the command, an output unit that outputs an image of the avatar in real-time, and a protocol generating unit for generating a protocol that provides predetermined tasks, and determines if the avatar performed the predetermined tasks. According to an embodiment of the present disclosure, it is possible to provide feedback in real-time by understanding the user's intention through analysis of biosignals and controlling the user's avatar in a virtual reality environment, thereby improving the user's brain function and motor function.