Voiceprint-Matched Touchscreen Output for Multi-User Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing human-computer interaction methods using touchscreen input face challenges such as joined-up handwriting difficulties and low input efficiency, particularly in controlling handwriting and vocal command directives.

Innovation Solution

A multi-modality human-computer interaction system that integrates touch operations and voice recognition to establish a correspondence between a user's voiceprint and a predetermined output position on a touchscreen, ensuring accurate and efficient input by matching voiceprints to determine the correct display location.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touchscreen input is implemented by using touch operation, then handwriting input can be achieved, but joined-up handwriting and difficulty in controlling handwriting occur, causing low input efficiency

Engineering Contradiction:
Improvehandwriting controlVSAvoidinput efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent replaces the mechanical touch operation system with a voice recognition system. Instead of using physical touch gestures that cause handwriting control difficulties, the system captures voice signals, processes them through voiceprint recognition, and converts them into text or commands. This substitution eliminates the joined-up handwriting problem and improves input efficiency by allowing users to speak naturally without worrying about stroke separation or gesture precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If voice command directives are used for input, then input efficiency can be improved, but interference from other users' voice inputs occurs, reducing reliability

Engineering Contradiction:
Improveinput efficiencyVSAvoidvoice input accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements voiceprint recognition as a feedback mechanism to verify the source of voice inputs. When a voice command is detected, the system first performs voiceprint analysis to confirm whether the voice belongs to the authenticated user before executing the command. This feedback loop ensures that even in multi-user environments, only authorized voice inputs are processed, thereby maintaining high reliability while preserving the efficiency benefits of voice input.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If multi-user voice input is allowed, then collaboration can be enhanced, but interference from other users' voice inputs occurs, causing incorrect display positions

Engineering Contradiction:
Improvemulti-user collaborationVSAvoidoutput position accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent segments the voice input processing by creating distinct processing channels for different users based on their voiceprints. Each user's voice is independently identified and routed to their designated output position on the touchscreen. This segmentation allows multiple users to collaborate simultaneously without interference, as each user's voice inputs are clearly distinguished and displayed at the correct position, maintaining both multi-user adaptability and position accuracy.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP4209864B1Human-computer interaction method, apparatus and system
Publication Date: 2025.11.05 HUAWEI TECH CO LTD
  • EP4209864B1 patent drawingFigure 1~2
  • EP4209864B1 patent drawingFigure 3
  • EP4209864B1 patent drawingFigure 4A

AI summary

A human-computer interaction method and system, and an apparatus relate to the field of human-computer interaction technologies, to help output and display voice content of one or more users to a corresponding output position on a touchscreen, and improve touchscreen input efficiency and user experience. The human-computer interaction method includes: establishing a correspondence between a first voiceprint and a first output position on a touchscreen; and receiving first voice, and when it is determined that a voiceprint of the first voice matches the first voiceprint, recognizing content of the voice, and outputting and displaying the content to the first output position.