Gesture Input Configuration for Video Game Command Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing input device configurations for software applications are often pre-defined and not intuitive, limiting user customization and efficiency, leading to input errors and reduced user experience.

Innovation Solution

Configuring user input using physical gestures, where users can perform any desired movement to associate with software application commands, allowing for user-specific and intuitive input methods via physical gesture input devices like depth cameras or motion sensing devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If pre-defined input device configurations are used, then setup time is reduced, but user customization capability deteriorates

Engineering Contradiction:
Improvesetup timeVSAvoiduser customization capability
Core Design Contradiction:
Loss of timeVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary action by automatically detecting the user's hand gesture in advance of the actual input need. The configuration process is initiated automatically when the application launches or when configuration is needed, with the system prepared to capture and process the gesture immediately, eliminating the need for users to manually navigate through configuration menus and reducing setup time while maintaining full customization capability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service by allowing the user's own body (hand) to serve as the input device for configuration. The user performs a natural hand gesture, and the system automatically captures, processes, and configures the input mapping without requiring manual configuration interfaces, tools, or intermediate steps. This self-service approach simultaneously reduces setup time and provides complete customization since the user directly defines their preferred gesture.

Inventive Principle:
Principle #25Self-service

2Device complexity

If traditional keyboard and mouse inputs are used, then device complexity is low, but ease of operation deteriorates

Engineering Contradiction:
Improveinput device structureVSAvoidinput intuitiveness
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system replaces the mechanical input system (keyboard keys and mouse buttons) with a gesture recognition system that captures natural hand movements. Instead of requiring users to learn and remember specific key combinations or mouse click sequences, the system uses computer vision or motion sensing to detect and interpret natural hand gestures, making the input method more intuitive while maintaining relatively simple device requirements through software-based gesture recognition.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system transitions from two-dimensional input (keyboard keys arranged in rows and columns, or mouse buttons on a flat surface) to three-dimensional input by capturing hand gestures in 3D space. This dimensional change allows users to express commands through natural spatial movements, improving intuitiveness while the system processes these complex 3D inputs through software algorithms, keeping the physical device structure relatively simple.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of manufacture

If pre-defined configurations are provided, then ease of manufacture is improved, but adaptability deteriorates

Engineering Contradiction:
Improveconfiguration distributionVSAvoidgesture customization
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The system implements dynamics by making the input configuration flexible and changeable rather than fixed. The gesture mapping is stored in a data structure that can be dynamically updated, allowing users to define custom gestures and have these configurations saved and reused across application sessions. This dynamic approach enables the system to start with pre-defined configurations for ease of deployment while allowing full customization when users define their own gestures, satisfying both ease of manufacture and adaptability requirements.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10086267B2Physical gesture input configuration for interactive software and video games
Publication Date: 2018.10.02 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10086267B2 patent drawing
  • US10086267B2 patent drawing
  • US10086267B2 patent drawing

AI summary

Technologies are described for configuring user input using physical gestures. For example, a user can be prompted to perform a physical gesture to assign to a software application command (e.g., an action within a video game or a command in another type of application). In response, a physical gesture can be received from the user via a physical gesture input device. The received physical gesture can then be associated with the software application command so that when the user performs the physical gesture the software application command can be initiated.