Sideline Gesture Control for Multiscreen Programs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gesture operations on display screens, such as zoom-in and zoom-out, are inefficient and require multiple repetitions to achieve desired magnification levels, lack visual feedback on current magnification scale, and block the display with finger placement, while current input systems limit multitasking and security methods rely on biological biometrics prone to errors.
Innovation Solution
A method and system for gesture operation on display screens that allows users to develop personalized gestures, includes an AI module to recognize and authenticate these gestures, and divides screens into multiple interacting portions for simultaneous program control, providing visual feedback and security through personalized gesture patterns.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional zoom-in and zoom-out gestures are used, then the display screen can be operated, but multiple repetitions are required to achieve desired magnification levels and the user lacks feedback on current magnification scale
Solution Approach 1:
The patent introduces visual feedback elements (such as magnification indicators or scale references) that display the current magnification level during zoom operations. This allows users to see exactly how much the image is zoomed in or out, eliminating the need for repeated guessing and adjustments. The feedback mechanism directly addresses the technical contradiction by providing real-time information about the zoom state, reducing the time and repetitions needed to achieve desired magnification.
2Ease of operation
If two-finger gestures are used for zooming, then the operation is simple, but the gesture has limited magnification capacity and requires multiple operations to achieve full range
Solution Approach 1:
The patent implements dynamic gesture recognition that adapts to different magnification requirements. The system can detect various finger configurations (two-finger, three-finger, four-finger gestures) and automatically adjust the magnification step size based on the gesture type and current zoom level. This dynamic adaptation allows the simple two-finger gesture to achieve full magnification range through intelligent interpretation rather than requiring multiple different gesture types.
Solution Approach 2:
The system changes the parameter of magnification step size dynamically based on the gesture detected. When a two-finger gesture is detected, the system adjusts the increment or decrement amount accordingly. This parameter change allows the same simple gesture to cover the full magnification range by adjusting the step size rather than requiring multiple repetitive gestures.
3Ease of operation
If fingers are placed on the display screen for gesture operation, then the gesture can be detected, but the display is blocked and accuracy is affected
Solution Approach 1:
The patent introduces an intermediary layer (such as a transparent overlay or virtual touch interface) that allows gesture detection without direct finger contact with the display surface. This intermediary enables the system to detect gestures through the overlay material, maintaining both detectability and display visibility. The intermediary resolves the contradiction by allowing gesture input while preventing finger placement from blocking the display or affecting accuracy.
4Productivity
If conventional input systems are used, then programs can be controlled, but multitasking is limited and security methods rely on biological biometrics prone to errors
Solution Approach 1:
The patent implements a universal gesture-based input system that can control multiple programs simultaneously through a single interface. The system recognizes gestures that can be applied across different applications, enabling one set of gestures to perform multiple functions including program control, window management, and security authentication. This multi-functionality resolves the contradiction by providing a single input mechanism that handles both multitasking and security requirements.
Solution Approach 2:
The system creates a virtual copy of the user's gesture patterns and uses this copied information for both control functions and security verification. The gesture patterns detected for program operation are copied and stored as authentication credentials, allowing the same gestures to serve dual purposes: controlling programs and verifying user identity. This copying approach enables multitasking while maintaining security without requiring separate systems.
Data Source
AI summary
A system for gesture operation on one or more display screens of one or more electronic devices includes a computer usable medium having computer-readable program code embodied in the medium to perform executable operations. The computer-readable program code includes a first executable portion for managing one or more adjusters for providing one or more adjusting operations of one or more displaying contents corresponding to one or more programs on the one or more display screens, a second executable portion for analyzing one or more touch point information and retrieving one or more display screen information from the one or more display screens, and controlling the one or more adjusters generated based on the one or more touch point information for displaying on the one or more display screens.