Motion Capture Virtual Control Panel for Independent Actor Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional virtual reality environments require external operator control, limiting the ability of actors within the environment to independently interact and control the virtual space.

Innovation Solution

A motion capture environment with tracker-sensors and a virtual control panel allows actors to physically manipulate virtual objects and controls within the virtual reality environment, enabling independent control through tracked objects like gloves and headsets, which interpret motion to simulate hand interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If external operators control the virtual reality environment, then the virtual environment can be operated and controlled, but the actor cannot control the virtual reality environment independently

Engineering Contradiction:
Improveindependent control capabilityVSAvoidcontrol accessibility
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The system enables self-service by allowing the actor within the virtual environment to control it independently through motion capture technology. The actor's physical movements are tracked and translated into virtual environment controls, eliminating the need for external operators and achieving autonomous control of the virtual space.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The motion capture system serves as an intermediary between the actor's physical movements and the virtual environment controls. Tracker-sensors detect the actor's movements, and this data is processed to translate physical actions into corresponding virtual environment manipulations, enabling indirect but independent control.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If standard input devices are used for interaction, then the actor can interact with the virtual environment, but the interaction is limited and not immersive

Engineering Contradiction:
Improveinteraction capabilityVSAvoidcontrol system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system replaces traditional mechanical input devices (keyboard, mouse) with a motion capture system that tracks the actor's full-body movements. This substitution allows for more natural and versatile interaction by capturing complex physical gestures and translating them into virtual environment commands, significantly enhancing interaction capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The motion capture system provides multi-functionality by enabling various types of interactions simultaneously - hand gestures, body movements, facial expressions - all controlled through a single integrated system. This universal control mechanism replaces multiple specialized input devices with one comprehensive system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If multimodal devices like wired gloves are used, then interaction capability is enhanced, but the actor still cannot independently control the environment without external operators

Engineering Contradiction:
Improveinteraction capabilityVSAvoidindependent control capability
Core Design Contradiction:
Adaptability or versatilityVSExtent of automation

Solution Approach 1:

The system achieves self-service by processing the actor's movements autonomously through motion capture technology. The tracker-sensors detect movements, and the system automatically translates these into virtual environment controls without requiring external operator intervention, enabling true independent control while maintaining enhanced interaction capability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The motion capture system acts as an intermediary that directly connects the actor's physical movements to virtual environment controls, eliminating the need for external operators. This intermediary process automatically translates tracked movements into meaningful control actions, granting the actor independent control authority.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9013396B2System and method for controlling a virtual reality environment by an actor in the virtual reality environment
Publication Date: 2015.04.21 TEXTRON INNOVATIONS INC
  • US9013396B2 patent drawing
  • US9013396B2 patent drawing
  • US9013396B2 patent drawing

AI summary

A motion capture environment includes at least one sensor-tracker for tracking a location of a tracked object within the motion capture environment and one or more computers collectively operable to generate a virtual reality environment including a virtual control panel having a virtual control that, when actuated, effects a predetermined result in the virtual reality environment; determine a virtual location of the tracked object within the virtual reality environment; and determine when the virtual location of the tracked object coincides with the location of the virtual control to actuate the virtual control. The motion capture environment further includes a display device for displaying the virtual reality environment to an actor within the motion capture environment.