Gesture-Based UI Element Management on Touch Screens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face difficulties in efficiently exploring and managing multiple user interface elements on small mobile device screens, such as photos and videos, due to limited space and restrictive viewing options like tile view and 3D wall view, which limit sorting and access freedom.
Innovation Solution
Implementing gesture-based interactions on touch screens, where users can spread, collapse, and organize user interface elements by drawing arcs, lines, or shapes, allowing for customizable gestures to manage and sort content, including facial recognition for advanced photo searching and organization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If multiple user interface elements are displayed on a small screen, then the quantity of information is improved, but the ease of operation deteriorates
Solution Approach 1:
The patent applies dynamics by making the user interface elements movable and reconfigurable through gesture-based interactions. Users can dynamically spread, collapse, and rearrange photo stacks and video clips along gesture paths, transforming the static grid layout into a dynamic, flexible interface that adapts to user needs while managing multiple elements on a small screen.
Solution Approach 2:
The patent introduces a new spatial dimension by stacking multiple photos and video clips vertically within grid cells, transforming the traditional 2D grid into a 3D-like structure. This allows more content to be displayed by utilizing the depth dimension, while gesture-based spreading distributes these stacked elements along paths across the screen, effectively managing quantity without sacrificing operability.
2Ease of operation
If traditional tile view or 3D wall view is used, then the ease of operation is improved, but the adaptability deteriorates
Solution Approach 1:
The patent implements universality by creating a gesture-based interaction system that can perform multiple functions: viewing photos and videos, sorting by different criteria (date, type, size), organizing into stacks, and customizing layouts. A single gesture mechanism replaces multiple dedicated controls, making the interface both easy to operate and highly adaptable to different user needs.
Solution Approach 2:
The interface transitions from static viewing modes to dynamic, gesture-driven interactions. Users can dynamically change sorting criteria, reorganize content stacks, and adjust layouts through natural gestures, providing both ease of operation through intuitive movements and adaptability through programmable gesture paths and multiple sorting options.
3Adaptability or versatility
If users manually sort and organize photos and videos, then the adaptability is improved, but the loss of time increases
Solution Approach 1:
The patent applies preliminary action by automatically grouping photos into stacks based on metadata (date, location, event) and video clips by type and duration before the user interacts with them. This pre-organization reduces the time users need to spend on manual sorting, while still maintaining high adaptability as users can subsequently customize these pre-grouped stacks through simple gestures.
Solution Approach 2:
The system performs self-service by automatically organizing and categorizing media content based on embedded metadata, eliminating the need for users to manually sort every item. The interface serves itself by intelligently creating stacks and groups, freeing users to focus only on high-level organization decisions through gesture-based interactions, thus reducing time loss while preserving adaptability.
Data Source
AI summary
Systems and methods for managing user interface elements using gestures are disclosed. In some implementations, a block representing a plurality of user interface elements is displayed on a touch screen of a device. A first gesture is initiated at a position corresponding to the block representing the plurality of the user interface elements is received via the touch screen. A first path corresponding to the first gesture is stored in a memory. At least a portion of the plurality of user interface elements are displayed on the touch screen in positions along the first path.