Voice-Screen-Mouse Ternary Verification for Icon Operation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for reducing errors in human-computer interaction, such as re-confirmation and multi-person operation checks, are either ineffective due to operator overconfidence or excessively cumbersome, particularly in high-frequency operations with strict time requirements, like railway traffic command.

Innovation Solution

A voice-screen-mouse ternary verification system that associates specific voice inputs with screen icons and mouse positions, issuing alarms or prohibiting operations if there is inconsistency, ensuring accurate and secure interactions by requiring alignment of 'eyes, hands, and mouth' for confirmation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If re-confirmation is implemented to reduce maloperation, then operation accuracy is improved, but operation time and operator fatigue increase

Engineering Contradiction:
Improveoperation accuracyVSAvoidoperation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces the mechanical re-confirmation process (manual review and repeated clicking) with a voice recognition system that automatically verifies operator intent through voice commands, thereby reducing operation time while maintaining accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces voice recognition technology as an intermediary between the operator and the icon selection process, serving as a mediator that verifies intent without requiring additional manual confirmation steps

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If double or multi-person operation check is implemented, then operation accuracy is improved, but labor costs and contact time between operators increase

Engineering Contradiction:
Improveoperation accuracyVSAvoidpersonnel requirements
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent enables the system to perform self-verification through voice recognition, eliminating the need for multiple personnel to check operations manually, thereby reducing labor costs while maintaining high accuracy

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical multi-person verification process with an automated voice recognition system, substituting human personnel with technological automation

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Area of stationary object

If screen space is limited, then device portability is improved, but icon distinguishability and operation accuracy deteriorate

Engineering Contradiction:
Improvescreen areaVSAvoidoperation accuracy
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The patent introduces voice recognition as an intermediary verification layer that compensates for the limited visual discrimination capacity on small screens, allowing accurate icon selection without increasing screen space

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method significantly reduces errors in human-computer interaction by leveraging voice recognition to ensure precise operation, enhancing safety and reducing operator fatigue and labor costs, especially in high-security environments.

Implementation Method 1

activating an associated icon through a voice input of a voice recognition system

Methodology Applied
Scientific EffectVoice recognition:

Data Source

PatentUS11656738B2Secure operation method for icon based on voice-screen-mouse verification
Publication Date: 2023.05.23 NANJING INST OF RAILWAY TECH
  • US11656738B2 patent drawing
  • US11656738B2 patent drawing
  • US11656738B2 patent drawing

AI summary

A secure operation method for an icon based on a voice-screen-mouse ternary verification includes verifying and comparing an icon associated with an operator's voice, an icon displayed on the screen to specify an operation, and an icon to which the mouse points when the mouse stops moving, and providing permission for operation and warning by a system. An association between a specific voice and the icon is established first. An associated icon is activated by a voice input of a voice recognition system, and then verification and comparing is performed with the icon to which the mouse points when the mouse stops moving. For the touch screen computer and mobile terminal, the binary verification is performed through the icon associated with the operator's voice and the icon displayed on the screen to specify the operation. The system provides authorization for the operation.