Foldable Device UI Window Relocation for Keyboard Occlusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Foldable computing devices face issues with cumbersome and error-prone user interfaces due to traditional UI paradigms, leading to incorrect user input and inefficient resource utilization when a hardware or software keyboard occludes a display region.

Innovation Solution

The implementation of transitions and optimizations that relocate UI windows and provide alternative interface presentations when a keyboard occludes a display region, allowing for easier user interaction and reduced resource consumption by adjusting the position of UI elements and presenting virtual trackpads and other components below or above the keyboard.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional UI paradigms are used in foldable computing devices, then the device can maintain compatibility with conventional computing interfaces, but the user interface becomes cumbersome and error-prone when a keyboard occludes the display region

Engineering Contradiction:
ImproveUI compatibilityVSAvoidUI usability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The UI layout dynamically adjusts based on keyboard presence and position. When a keyboard occludes part of the display, the system automatically relocates UI windows and elements to non-occluded regions, transforming the static traditional UI into an adaptive interface that responds to changing physical conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system utilizes the spatial dimension created by the folded display configuration. By recognizing the keyboard's position in the folded geometry and adjusting UI element placement accordingly, the interface leverages the three-dimensional folding structure to maintain usability despite occlusion.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If traditional UI paradigms are used in foldable computing devices, then the device can maintain compatibility with conventional computing interfaces, but user input errors increase and computing resources are consumed inefficiently

Engineering Contradiction:
ImproveUI compatibilityVSAvoidinput accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The UI layout dynamically adjusts based on keyboard presence and position. When a keyboard occludes part of the display, the system automatically relocates UI windows and elements to non-occluded regions, transforming the static traditional UI into an adaptive interface that responds to changing physical conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system continuously monitors the physical state of the foldable device and keyboard position, using this feedback to automatically adjust UI element placement. This closed-loop approach ensures that UI elements remain in optimal positions, reducing input errors and improving reliability.

Inventive Principle:
Principle #23Feedback

3Area of stationary object

If UI windows are displayed in the second display region when a keyboard is present, then the full display area can be utilized, but the UI becomes occluded and difficult to interact with

Engineering Contradiction:
Improvedisplay area utilizationVSAvoidUI accessibility
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The system proactively detects keyboard presence and pre-emptively relocates UI windows to non-occluded regions before the user encounters usability problems. This preliminary adjustment prevents occlusion issues rather than reacting to them after they occur.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The UI layout dynamically adjusts based on keyboard presence and position. When a keyboard occludes part of the display, the system automatically relocates UI windows and elements to non-occluded regions, transforming the static traditional UI into an adaptive interface that responds to changing physical conditions.

Inventive Principle:
Principle #15Dynamics

4Power

If the foldable device operates in productivity mode with keyboard attached, then computing power and processing capability are enhanced, but UI navigation becomes more complex and resource-consuming

Engineering Contradiction:
Improveprocessing capabilityVSAvoidUI navigation complexity
Core Design Contradiction:
PowerVSDevice complexity

Solution Approach 1:

The UI system automatically manages its own layout and positioning without requiring user intervention. The system monitors keyboard presence and autonomously adjusts UI element placement, eliminating the need for users to manually navigate complex UI configurations and reducing the cognitive load associated with productivity mode operation.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11221759B2Transitions and optimizations for a foldable computing device operating in a productivity mode
Publication Date: 2022.01.11 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11221759B2 patent drawing
  • US11221759B2 patent drawing
  • US11221759B2 patent drawing

AI summary

A foldable computing device provides user interface (“UI”) transitions and optimizations while operating in a productivity mode. When the foldable computing device is operating in productivity mode, it can present a UI below a hardware keyboard placed over a display region and occluding only a top portion of the display region or a software keyboard presented in the display region occluding only the top portion of the display region. If the hardware keyboard or the software keyboard occlude only the bottom of the display region, a UI can be shown above the hardware keyboard or the software keyboard. The foldable computing device can adjust the position of UI windows that are occluded when the hardware or software keyboard is placed on the display region. The foldable computing device can move the UI windows back to their original positions if the hardware or software keyboard no longer occlude the display region.