Multimodal Voice Interface for Hands-Free Terminal Control

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users face difficulties in controlling terminals, such as cellular phones and personal computers, when their hands are occupied or not available, as existing methods primarily rely on manual input for command and control.

Innovation Solution

A user interface method and device that utilizes a multimodal interface, enabling voice input and output to allow users to control terminal events through voice commands, with features like voice recognition and synthesis, allowing hands-free operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual input methods (keyboard, keypad, touchpad) are used for controlling terminal events, then control precision is improved, but ease of operation deteriorates when hands are occupied

Engineering Contradiction:

Improvecontrol precisionVSAvoidease of operation

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces manual mechanical input methods (keyboard, keypad, touchpad) with voice-based acoustic input. The voice input unit captures spoken commands, which are then processed through speech recognition to control terminal events, eliminating the need for hand operations while maintaining control capability.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces speech recognition technology as an intermediary between the user's voice and the terminal control system. The speech recognition module translates acoustic signals into actionable commands, serving as a mediator that enables hands-free operation without direct mechanical interaction.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If voice input unit is continuously activated for hands-free control, then ease of operation is improved, but energy consumption increases

Engineering Contradiction:

Improveease of operationVSAvoidenergy consumption

Core Design Contradiction:

Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic activation of the voice input unit rather than continuous operation. The controller activates the voice input unit only when specific conditions are met (e.g., when a message is received or when the terminal is in a ready state), and deactivates it during normal operation to conserve energy.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The patent performs preliminary checks before activating the voice input unit. The controller determines whether activation is necessary based on terminal state and event conditions, preparing the system in advance to activate only when needed, thereby avoiding unnecessary energy consumption.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS9613623B2User interface method and device comprising repeated output of an audible signal and a visual display and vibration for user notification

Publication Date: 2017.04.04 LG ELECTRONICS INC

AI summary

A user interface method and corresponding device, where the user interface method includes waiting for detection of an event, which is a function of the user interface device, performing the event detection in the user interface device and notifying a user that the event has been detected, activating a voice input unit configured to allow the user to input his or her voice therethrough, receiving a voice command from the user with respect to the event through the voice input unit, and processing a function according to the received voice command from the user, including repeated output of an audible signal or a visual display or a vibration to notify the user when the command had not been received.