Mobile UI Frame Navigation via Gesture Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of mobile computing devices face difficulties navigating applications with multiple frames due to limited screen resolution, requiring cumbersome scrolling and manual alignment of frames, which is tedious and inefficient.
Innovation Solution
A system and method that utilize a user interface analyzer to identify frames, their positions, and relationships on a mobile device, allowing users to perform gestures to automatically align and navigate between frames, using an extended virtual screen buffer to display adjacent frames and apply zoom operations for better alignment with the device's screen.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users manually scroll and align frames on mobile device screens, then they can view different sections of the application user interface, but the navigation process becomes cumbersome and time-consuming
Solution Approach 1:
The system pre-processes the user interface to identify frame boundaries, positions, and relationships before user interaction. This preliminary analysis enables the system to automatically calculate and execute optimal frame transitions when users provide simple navigation commands, eliminating the need for manual scrolling and alignment operations.
Solution Approach 2:
The frame navigation system performs self-service by automatically detecting frame positions and relationships, calculating optimal display parameters, and executing frame transitions without requiring manual user intervention. The system serves itself by maintaining an internal model of the UI structure that it uses to autonomously navigate between frames based on simple user input.
2Adaptability or versatility
If the application user interface is delivered to mobile devices with smaller screens, then more applications can be accessed from handheld devices, but users are limited to a reduced view and must manually align frames
Solution Approach 1:
The system applies local quality by adapting the display parameters specifically for frame navigation on mobile devices with smaller screens. It identifies and processes frame-specific information such as positions, sizes, and relationships, then applies optimized display transformations locally to each frame based on the device's screen characteristics, rather than applying uniform scaling to the entire interface.
Solution Approach 2:
The system changes display parameters including frame position, size, and orientation based on the mobile device's screen dimensions and the identified frame characteristics. It dynamically adjusts these parameters to optimize the viewing experience on smaller screens while maintaining the ability to navigate between all frames without manual alignment.
3Area of stationary object
If users view multiple frames on larger screens, then all frames can be displayed simultaneously, but on mobile devices only a limited view is available requiring tedious manual navigation
Solution Approach 1:
The system pre-analyzes the user interface structure to identify all frames, their positions, and their relationships before navigation begins. This preliminary action creates a mental model of the complete interface layout, enabling the system to efficiently navigate between any frames using simple user commands, thereby compensating for the limited display area on mobile devices.
Solution Approach 2:
The system introduces an intermediary frame analysis component that acts as a mediator between the user interface and the display device. This intermediary processes the UI structure, identifies navigable frames, and translates user navigation requests into optimized display commands, thereby enabling efficient navigation despite the constrained mobile screen real estate.
Data Source
AI summary
In general overview, the present disclosure is directed to a system and method for selectively displaying a frame of an application user interface on a mobile computing device. A user interface analyzer on a mobile computing device analyzes a user interface for an application executing on a remote server. The user interface analyzer identifies frames in the user interface, the positions of the frames, relationships between frames, and horizontal and vertical panning offsets to move between adjacent frames. The mobile computing device receives a user input requesting the display of an adjacent frame. Based on the information the user interface analyzer obtained, the mobile computing device displays an adjacent frame of the user interface.