Replicated User Interface Boundary Area Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices often lack the hardware support to detect touch screen gestures that involve both a boundary area and an active display area, leading to misinterpretation of user inputs when interacting with remote user interfaces.
Innovation Solution
A replicated user interface is provided on the mobile device with a replicated active display area and a replicated boundary area, allowing the device to recognize and respond to touch screen gestures as if it had the necessary hardware support, by establishing a communications link with a remote device and simulating the user interface based on the remote device's gesture recognition capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a mobile device interacts with a remote user interface, then the user can access remote device functionality, but the mobile device lacks hardware support to detect gestures involving boundary area and active display area
Solution Approach 1:
The patent creates a replicated user interface that copies the boundary area and active display area structure from the remote device. The local display is divided into a replicated boundary area and a replicated active display area, allowing gesture detection software to simulate the hardware capabilities needed for proper gesture recognition without requiring physical boundary area sensors
Solution Approach 2:
The patent introduces a software intermediary layer that translates between the mobile device's native touch interface and the remote device's gesture recognition system. This intermediary processes touch inputs and synthesizes them into the appropriate gesture commands that the remote device expects, bridging the hardware capability gap
2Area of stationary object
If the mobile device uses its existing active display area for interaction, then the display is fully utilized, but gestures requiring boundary area detection cannot be properly recognized
Solution Approach 1:
The patent adds a conceptual boundary area dimension around the active display area by creating a replicated boundary area that extends beyond the physical display edges. This virtual boundary layer allows the system to detect and process gestures that originate from or extend into the boundary area, effectively adding spatial dimensions for gesture input without physical hardware extension
3Reliability
If the remote device's user interface is replicated on the mobile device, then the user interface appearance and functionality are preserved, but the mobile device must simulate hardware capabilities it lacks
Solution Approach 1:
The patent creates a replicated user interface that copies not only the visual appearance but also the functional structure of the remote device's interface. This includes replicating the boundary area and active display area layout, allowing the mobile device to present an identical interaction model to the user while handling input detection through software simulation
Solution Approach 2:
The patent makes the mobile device's display system multi-functional by enabling it to serve both as a native touch interface and as a replicated interface for the remote device. The same display hardware is used to present both the replicated boundary area and active display area, allowing a single component to fulfill multiple functional roles
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An apparatus, method, and computer program product are described that provide for a replicated user interface, including a replicated active display area and a replicated boundary area, such that the replicated user interface can recognize the same types of user inputs that are recognized by a remote user interface, and the same operations may be executed upon receipt of such inputs. The apparatus can establish a communications link with the remote user interface and determine whether the remote user interface is configured to detect a user input at least partially received in a boundary area outside an active display area of the remote user interface. A replicated active display area and a replicated boundary area may then be provided for in response to a determination that the remote user interface is configured to detect a user input at least partially received in the boundary area of the remote user interface.