Touchscreen Voice Messaging Blind Operation via Gesture Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current instant messaging devices require users to visually locate and press a specific button for voice operations, leading to increased operational difficulty and risk, especially during activities like driving.

Innovation Solution

An instant messaging device and method that enables blind operation through a touchable screen with a touch detector, action interpreter, and voice recorder, allowing users to initiate voice recording and sending by continuous screen presses and releases without visual guidance, accompanied by prompt signals and confirmation processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a virtual button at a specific position is used for voice operations, then the device can perform voice recording and sending functions, but the user must visually locate and press the correct position, increasing operational difficulty and risk

Engineering Contradiction:
Improveease of voice operationVSAvoidoperational safety
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The entire touchable screen is designed to perform multiple functions: it serves as both the display interface and the control input area. Any position on the screen can initiate voice recording, and specific patterns (long press + release, or double click) can trigger voice sending, eliminating the need for dedicated button positions and enabling blind operation

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically detects touch patterns and interprets them into appropriate voice commands. The action interpreter analyzes the touch duration, release timing, and click patterns to determine whether the user intends to record or send voice, reducing the cognitive load and visual attention required from the user

Inventive Principle:
Principle #25Self-service

2Measurement precision

If the user must watch the screen to click the correct position, then accurate operation can be achieved, but the number of times of lowering the head increases, reducing convenience and increasing risk during activities like driving

Engineering Contradiction:
Improveoperational accuracyVSAvoidconvenience of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The voice communication process is segmented into distinct phases with different control mechanisms: voice recording phase (initiated by long press or double click), voice sending phase (initiated by release or additional clicks). Each phase has clear tactile feedback and distinct operation patterns that can be executed without visual confirmation

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system provides immediate tactile and visual feedback when touch actions are detected. The touch detector and action interpreter provide real-time response to user inputs, confirming that the intended operation (recording or sending) has been triggered, allowing users to verify operations through feedback rather than visual screen inspection

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3393090B1Instant messaging apparatus and method
Publication Date: 2020.05.06 ZHEJIANG GEELY HLDG GRP CO LTD
  • EP3393090B1 patent drawingFigure 1
  • EP3393090B1 patent drawingFigure 2
  • EP3393090B1 patent drawingFigure 3

AI summary

Provided are an instant messaging apparatus and method, relating to the field of communications. The instant messaging apparatus comprises: a touchable screen for displaying a touch action, a touch detector for detecting a touch action, an action interpreter for sending a control instruction corresponding to the touch action in response to the touch action, and a voice recorder for starting recording in response to a voice recording instruction, stopping recoding in response to a voice sending instruction and sending a currently recorded voice to a receiver in an instant messaging interface. By means of the structure of the instant messaging apparatus of the present invention, a blind operation of voice communication is achieved, so that the number of times that a user operates the instant messaging apparatus, with the head being lowered, tends to zero, thereby greatly improving the convenience of an operation, and thus, by taking driving as an example, effectively reducing the risk for driving.