Dynamic Character Interface for Gaming Console Text Entry

Solution Overview

Problem

Text entry via virtual/on-screen QWERTY keyboards is cumbersome on gaming consoles and emerging VR, AR, and MR platforms due to inefficiencies in input modalities like gamepad interaction and hand gestures, which are less efficient than simultaneous ten-finger input.

Innovation Solution

A dial or sequentially arranged character input user interface that dynamically adjusts based on language models, allowing users to indicate characters with sustained and uniform input, using a dialing cursor or other indicator, and displaying characters with prominence based on conditional probability for efficient selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a QWERTY keyboard layout is used for text entry on gaming consoles and VR/AR/MR platforms, then text input can be achieved, but the input efficiency is low and the operation is cumbersome due to sequential navigation requirements

Engineering Contradiction:

Improvetext input efficiencyVSAvoidoperation naturalness

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The keyboard layout dynamically reconfigures itself based on language models and prediction algorithms. Frequently used characters and predicted next characters are positioned in optimal locations, allowing the interface to adapt to user needs in real-time rather than maintaining a static QWERTY arrangement

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system pre-positions frequently used characters and predicted next characters in easily accessible locations before the user needs to input them. Language models predict upcoming characters and prepare the interface in advance, reducing navigation time and effort

Inventive Principle:

Principle #10Preliminary action

2Productivity

If sequential character navigation is used with gamepad or gesture input, then text entry is possible, but the input speed is slower compared to simultaneous ten-finger input

Engineering Contradiction:

Improveinput speedVSAvoidtime for character selection

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system pre-positions frequently used characters and predicted next characters in easily accessible locations before the user needs to input them. Language models predict upcoming characters and prepare the interface in advance, reducing navigation time and effort

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system uses language models to analyze input patterns and provide feedback by adjusting character positions and predictions in real-time. This continuous optimization reduces the time required for character selection as the system learns from user behavior

Inventive Principle:

Principle #23Feedback

3Adaptability or versatility

If a static character arrangement is used, then the interface is simple to implement, but it cannot optimize for frequently used characters or language patterns

Engineering Contradiction:

Improvelanguage model optimizationVSAvoidinterface dynamics

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The keyboard layout dynamically reconfigures itself based on language models and prediction algorithms. Frequently used characters and predicted next characters are positioned in optimal locations, allowing the interface to adapt to user needs in real-time rather than maintaining a static QWERTY arrangement

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes the positional parameters of characters based on language model predictions and usage frequency. Characters are repositioned dynamically according to probabilistic language models that calculate the likelihood of next characters, optimizing the layout for anticipated input

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentEP3607421B1Text entry interface

Publication Date: 2022.03.16 MICROSOFT TECHNOLOGY LICENSING LLC

Figure 1A
Figure 1B
Figure 1C

AI summary

Receiving user input. A method includes displaying a set of characters arranged sequentially in a curvilinear or linear fashion such that any one of the characters in the set of characters can be identified for selection by continuous and uniform user input from a user. The method further comprises displaying a plurality of the characters in the set of characters in a fashion where each given character in the plurality of characters is displayed at a level of prominence determined by a probability that the given character is a next character in a string of characters selected by a user. The method further includes receiving user input in a continuous and uniform fashion from a user to identify a character in the set of characters. The method further includes receiving user input selecting the identified character. The method further includes adding the identified character to the string of characters.