Grip Gesture Recognition on Foldable Screens

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Foldable-screen terminals face challenges with single-handed control due to screen expansion, leading to low accuracy in recognizing user gripping postures, as existing methods are not suitable for foldable screens and often misinterpret user gestures.

Innovation Solution

A method involving a foldable screen with a first and second screen, where sensor data from a touch sensor on the side bezel of the first screen and touch parameters from the second screen are used to determine the gripping posture, including single-sided and double-sided gripping, improving recognition accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the screen is expanded to foldable size, then the display area is increased, but the control accuracy with one hand deteriorates

Engineering Contradiction:
Improvedisplay areaVSAvoidgrip recognition accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent divides the grip recognition problem into multiple independent detection zones: a first detection area on the first screen and a second detection area on the second screen. Each area independently detects touch gestures, allowing the system to accurately identify grip postures (single-handed or double-handed) on the expanded foldable display without compromising recognition accuracy despite the increased overall display area.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If existing grip recognition methods are used on foldable screens, then the system structure is simple, but the gesture recognition accuracy deteriorates

Engineering Contradiction:
Improvesystem structureVSAvoidgesture recognition accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent extends the grip recognition approach from a single-screen two-dimensional detection to a multi-screen three-dimensional detection space. By adding the second detection area on the second screen, the system creates a spatial dimension for gesture recognition that accurately captures foldable screen usage patterns, enabling precise distinction between single-handed and double-handed grips while maintaining reasonable system complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If the screen is unfolded to expand terminal screens, then the screen expansion function is achieved, but the single-handed control range deteriorates

Engineering Contradiction:
Improvescreen expansion functionVSAvoidsingle-handed control range
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements feedback by continuously monitoring touch gestures in both the first and second detection areas and using this information to dynamically adjust the user interface. The system provides feedback about detected grip postures and adapts the interface layout and control element positioning accordingly, enabling effective single-handed operation on the expanded foldable screen by reorganizing controls within reachable areas based on real-time grip detection.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240353948A1Grip gesture recognition method and apparatus, device, storage medium, and chip
Publication Date: 2024.10.24 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • US20240353948A1 patent drawing
  • US20240353948A1 patent drawing
  • US20240353948A1 patent drawing

AI summary

A method for recognizing gripping posture includes: obtaining first sensor data of a touch sensor arranged on a side bezel of a first screen of a terminal fold able screen, obtaining a touch parameter of a second screen of the terminal fold able screen, and determining a gripping posture of the terminal according to the first sensor data and the touch parameter, where the gripping posture includes single-sided gripping on first side, single-sided gripping on second side or double-sided gripping.