Virtual Controller for Touch Display Resolving Button Space Trade-off

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Portable gaming devices face challenges in size constraints due to hard button controls, which are difficult to actuate during fast-paced gameplay and detract from the device's multifunctional usability and appearance for non-gaming consumers.

Innovation Solution

Implementing a virtual controller on a touch-sensitive display that detects user inputs to generate controller input parameters, allowing for intuitive game control without physical buttons, and repositions itself to prevent misstrikes and border interference.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If hard button controls are used, then tactile feedback and correct finger positioning are provided, but device size increases and display space is reduced

Engineering Contradiction:
Improvetactile feedbackVSAvoiddisplay space
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent removes physical hard buttons from the device and extracts their control functionality to a virtual controller interface on the touch display. This extraction eliminates the space-occupying physical buttons while preserving the control capabilities through software-based virtual buttons that respond to touch inputs.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a virtual copy of the physical button controls as software elements on the display screen. These virtual buttons replicate the functionality of physical buttons without requiring the physical hardware, allowing users to interact with the same control interface through touch gestures on the display surface.

Inventive Principle:
Principle #26Copying

2Area of stationary object

If hard buttons are reduced in size, then device size is reduced, but ease of actuation during fast-paced gameplay deteriorates

Engineering Contradiction:
Improvedevice sizeVSAvoidease of actuation
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent replaces the mechanical physical button system with a software-based touch interface. Instead of relying on mechanical actuation of small physical buttons, users interact through touch gestures on the display, eliminating the size-action tradeoff inherent in physical buttons while maintaining responsive control for fast-paced gameplay.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If dedicated buttons are added to the front of the device, then game play control is improved, but device appearance and multifunctional usability are compromised

Engineering Contradiction:
Improvegame play controlVSAvoidmultifunctional usability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent implements a universal virtual controller interface that serves multiple functions: it provides dedicated game control capabilities when needed while maintaining full compatibility with standard touch interactions for browsing, messaging, and other applications. The same touch display handles both gaming controls and general device operations, eliminating the need for separate dedicated buttons.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Device complexity

If virtual controller neutral position is fixed, then implementation is simplified, but misstrikes and border interference increase

Engineering Contradiction:
Improveimplementation complexityVSAvoidinput accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent transforms the fixed neutral position from a static parameter to a dynamic one that automatically adjusts based on the user's hand position and device orientation. The neutral position is continuously recalculated based on detected touch characteristics, allowing the virtual controller to adapt to different usage scenarios and prevent misstrikes without adding significant implementation complexity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP2659340B1Virtual controller for touch display
Publication Date: 2023.02.22 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP2659340B1 patent drawingFigure 1
  • EP2659340B1 patent drawingFigure 2
  • EP2659340B1 patent drawingFigure 3~5

AI summary

Systems and methods are provided for use with a computing device having a touch sensitive display including a touch sensor configured to detect touches of a digit of a user. The method may include detecting an initial digit down position on the display via the touch sensor, and establishing a neutral position for a virtual controller at the digit down position. The method may further include detecting a subsequent movement of the digit relative to the initial digit down position, and determining a controller input parameter based on the subsequent movement of the digit relative to the initial digit down position. The method may further include generating a controller input message indicating the determined controller input parameter.