Predictive Gesture Optimizations for Foldable Display Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Foldable computing devices face challenges with cumbersome and error-prone user interface (UI) gestures when performing inter-region operations, leading to inefficient navigation and incorrect user input, particularly due to the ambiguity in gestures spanning multiple screen regions.

Innovation Solution

The implementation of predictive gesture optimizations that allow foldable devices to recognize and interpret intra-region gestures for inter-region UI operations, combining different types of gestures to enhance accuracy and expressiveness, and dynamically determining thresholds and target zones to accurately perform operations across display boundaries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional UI gestures are used for inter-region operations on foldable devices, then the device can perform basic navigation, but the gestures become cumbersome and error-prone

Engineering Contradiction:
ImproveUI gesture usabilityVSAvoidgesture accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system performs preliminary analysis of gesture trajectory and predicts the user's intended destination region before the gesture is completed. This allows the device to pre-prepare the target region and provide feedback during the gesture, reducing errors and improving reliability while maintaining ease of operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides real-time feedback during gesture execution by highlighting potential target regions and indicating the predicted outcome. This feedback mechanism allows users to correct mistaken gestures before completion, significantly improving gesture accuracy without adding complexity to the interaction.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If gestures span multiple screen regions, then inter-region operations can be performed, but ambiguity increases leading to incorrect user input

Engineering Contradiction:
Improveinter-region operation capabilityVSAvoidgesture interpretation accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system analyzes the gesture trajectory in real-time and predicts the intended target region before the gesture completes. This preliminary determination of intent disambiguates gestures that span multiple regions, allowing the system to correctly interpret the user's destination even when the gesture path passes through multiple display regions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system adds a temporal dimension to gesture interpretation by analyzing the sequence and timing of regions traversed. Instead of treating all multi-region gestures equally, the system uses the trajectory's temporal progression to distinguish between gestures intended for different destinations, resolving ambiguity through multi-dimensional analysis.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If traditional navigation methods are used, then basic UI operations can be performed, but computational resources are wasted on processing inefficient navigation and incorrect input

Engineering Contradiction:
Improvenavigation efficiencyVSAvoidcomputational resource consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary prediction of the user's intended gesture outcome during gesture execution. By determining the likely destination and operation in advance, the system can prepare the target state and avoid unnecessary processing of incorrect or ambiguous gestures, improving productivity while reducing computational waste.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides feedback during gesture execution that allows users to correct mistakes before completion. This prevents the system from processing incorrect navigation commands, reducing computational resource consumption associated with handling and correcting erroneous input while maintaining efficient navigation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12079464B2Predictive gesture optimizations for moving objects across display boundaries
Publication Date: 2024.09.03 MICROSOFT TECHNOLOGY LICENSING LLC
  • US12079464B2 patent drawing
  • US12079464B2 patent drawing
  • US12079464B2 patent drawing

AI summary

Technologies are disclosed herein that enable a foldable computing device having multiple screen regions to perform an inter-region user interface (UI) operation in response to an intra-region UI gesture. For example, a UI gesture that begins and ends within a first region may be used to move a window from the first region to the second region. The disclosed technologies address the technical problems described above by providing succinct, accurate UI gestures that cause foldable computing devices to perform inter-region UI operations. The disclosed technologies further address the technical problems described above by combining different types of UI gestures to increase gesture accuracy and expressiveness of inter-region UI operations.