Multimodal Input Mechanism for Secure Usable Character Entry

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional input mechanisms face usability and security challenges, especially for visually impaired and physically disabled users, in noisy environments and public places, due to vulnerabilities like shoulder surfing and observation attacks, which limit their access to sensitive information and services.

Innovation Solution

A multimodal input mechanism that allows users to select from preconfigured modalities such as touch, motion keyboard, air gestures, and voice, using vibration patterns for haptic feedback to securely enter alphanumeric and special characters, providing enhanced security and usability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If voice-based input mechanism is used, then usability for visually impaired users is improved, but security is worsened due to observation attacks and eavesdropping

Engineering Contradiction:

Improveusability for visually impaired usersVSAvoidsecurity vulnerability to observation attacks

Core Design Contradiction:

Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The input mechanism is segmented into multiple independent modalities (voice, touch, gestures, head movements) that can be used separately or combined. This allows users to switch between secure input methods depending on the environment, preventing reliance on a single vulnerable modality like voice input.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system dynamically adapts the input mechanism based on environmental context and user needs. It can switch between voice-based input for convenience and touch/gesture-based input for security, making the system flexible enough to balance usability and security requirements in different situations.

Inventive Principle:

Principle #15Dynamics

2Reliability

If conventional touch-based input is used, then security is improved, but usability is worsened for physically disabled users

Engineering Contradiction:

Improvesecurity against unauthorized accessVSAvoidusability for physically disabled users

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The input system is designed to be universal by supporting multiple input modalities that can accommodate different user abilities. Physically disabled users can use head movements or eye tracking instead of touch, while the system maintains security through authenticated access and encrypted data transmission across all modalities.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces intermediary input methods (eye tracking, head gestures, voice commands) that bridge the gap between physically disabled users and the device interface. These intermediaries allow users with limited motor control to interact securely with the device without direct touch input.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If multiple input modalities are provided, then usability for diverse users is improved, but device complexity is worsened

Engineering Contradiction:

Improveusability for diverse usersVSAvoidcomplexity of multimodal input system

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges multiple existing input technologies (voice recognition, touch screen, gesture detection, eye tracking) into a unified input system. By integrating these modalities through a common processing framework, the system achieves high adaptability without proportionally increasing complexity, as each modality leverages existing hardware and software components.

Inventive Principle:

Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enhances security by preventing unauthorized access and improves usability for diverse users by offering flexible input methods, allowing secure and convenient entry of sensitive information in various environments.

Implementation Method 1

indicating a selected character set through a first vibration pattern and indicating a selected character through a second vibration pattern

Methodology Applied

Scientific EffectMechanical vibration: Vibration

Data Source

PatentEP3945402B1Method and device providing multimodal input mechanism

Publication Date: 2024.03.27 TATA CONSULTANCY SERVICES LTD

Figure 1
Figure 2A
Figure 2B

AI summary

Conventional input mechanisms available are built considering majority users but face usability and security challenge when used by special users or when used in challenging environments. Embodiments herein provide a method and device for multimodal input mechanism. The device is preconfigured for a plurality of modalities and provides an option to a user to select an input modality pair for entering a sequence of characters into the device. A first modality among the pair enables selection of a character set among a plurality of character sets and the second modality enables selecting a character from the selected character set. The plurality of modalities comprise a touch mode defined by a set of touch based gestures, a motion keyboard mode defined by a set of device tilt based gestures, an air gesture mode defined by a set of virtual gestures and a voice mode defined by a set of voice commands. The input modality pair from among the plurality of input modalities is selected by the user based on physical constraints of the user and environmental constraints posed by an environment around the device.