Virtual Gesture Detection via Avatar Collision Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual environments, such as virtual reality and augmented reality, face challenges in determining the successful completion of group behaviors and providing realistic interactions among users, as systems struggle to mimic human-like understanding of gestures and orientations of avatars without formal descriptions.

Innovation Solution

An endpoint system identifies collaborative gestures in a shared virtual environment by tracking user input, motion, and collisions between avatars, using gesture states and proximity to define and recognize gestures like handshakes and high-fives, and executes corresponding functions such as visual effects or game advancements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If formal descriptions and tracking of avatar motions are used, then the system can manage virtual environment interactions, but the system cannot determine successful completion of group behaviors like humans do

Engineering Contradiction:
Improvedetermination of successful completionVSAvoidformal description and tracking system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system creates virtual copies of physical gestures through avatar representations. By tracking the formal descriptions of avatar motions and collisions, the system copies the essence of physical interactions to determine successful completion of group behaviors, enabling human-like understanding in virtual environments

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces complex human-like gesture interpretation with a formalized tracking system that monitors avatar positions, motions, and collisions. This substitution of mechanical tracking for human judgment enables reliable determination of behavior completion without requiring complex cognitive processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If gesture states and collisions between avatars are tracked, then collaborative gestures can be identified, but the system complexity increases

Engineering Contradiction:
Improverecognition of collaborative gesturesVSAvoidtracking and detection system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments avatar interactions into distinct gesture states and collision events. By dividing complex social interactions into manageable components (gesture states, collisions, proximities), the system can track and recognize collaborative gestures through systematic analysis of individual elements

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The tracking system serves multiple functions: monitoring avatar positions, detecting collisions, identifying gesture states, and recognizing collaborative behaviors. This multi-functionality allows the system to handle diverse interaction types through a unified approach, increasing adaptability without proportionally increasing complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11146661B2Systems and methods for detecting collaborative virtual gestures
Publication Date: 2021.10.12 SPECS INC
  • US11146661B2 patent drawing
  • US11146661B2 patent drawing
  • US11146661B2 patent drawing

AI summary

An endpoint system including one or more computing devices receives user input associated with an avatar in a shared virtual environment; calculates, based on the user input, motion for a portion of the first avatar, such as a hand; determines, based on the user input, a first gesture state for first avatar; transmits first location change notifications and a representation of the first gesture state for the first avatar; receives second location change notifications and a representation of a second gesture state for a second avatar; detects a collision between the first avatar and the second avatar based on the first location change notifications and the second location change notifications; and identifies a collaborative gesture based on the detected collision, the first gesture state, and the second gesture state.