Multimedia Interface Gesture Control and Segmented Scrolling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional graphical user interfaces (GUIs) face limitations in processing and smoothly displaying large amounts of information, particularly when scrolling through sequences of images, and often require reliance on joysticks, mice, or trackballs for user interaction, which may not fully utilize the GUI system's capabilities.
Innovation Solution
The implementation of a multimedia processing system that enables high-speed scrolling in GUIs using a video image capture device and audio signal capture device, allowing users to interact with and manipulate images on the screen without traditional input devices, and employing techniques like alpha blending and directional input recognition to enhance user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If conventional GUI scrolling is used to display large amounts of information, then the user can access more content, but the system cannot process and display images fast enough to achieve smooth scrolling
Solution Approach 1:
The patent segments the information display into multiple pages, with only the current page being processed and displayed at high speed. Previous and next pages are pre-loaded or cached in background memory, allowing the GUI to maintain smooth scrolling performance while providing access to large quantities of information across multiple pages.
2Ease of operation
If conventional input devices like mouse or trackball are used for GUI interaction, then precise control is achieved, but the system does not fully utilize the capabilities of the GUI system and requires additional hardware
Solution Approach 1:
The patent enables the GUI system to serve itself by using its own display capabilities as the input mechanism. The display device detects user gestures (such as hand movements or pointing gestures) directly and translates them into navigation commands, eliminating the need for separate input devices like mice or trackballs.
3Area of stationary object
If the window size is enlarged to display more data, then more information fits in the display, but this is only useful when data amount is less than available window size and does not solve the fundamental scrolling performance issue
Solution Approach 1:
Instead of enlarging the window to display all data at once, the patent segments information into multiple manageable pages that fit within the display constraints. This allows the system to maintain optimal processing speed for the visible page while providing access to the complete dataset through page navigation.
Data Source
Figure 1
Figure 2A
Figure 2B~2D
AI summary
A method of moving objects in a graphical user interface, includes obtaining a video image of a user of the interface; displaying the video image on a display such that the video image is superposed with one or more objects displayed on the display; and moving one or more objects displayed on the display based on recognition of motions of the video image of the user. Recognition of motions of the video image may include recognition of motions of an image of the user's hand.