Virtual Contact Points for Touchscreen GUI Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Small screen sizes on mobile devices, especially when multiple graphical user interfaces (GUIs) are displayed, lead to errors in user input due to the close proximity of GUIs, making it difficult to accurately select the intended GUI using a touch panel.
Innovation Solution
The implementation of an information processing device that generates virtual points of contact around the actual point of contact on a touch panel, using a configuration file to determine the distribution and number of these points, allowing for precise identification of the intended GUI by considering user behavior and device orientation, thereby eliminating the need for margin areas in hit determination zones.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of moving object
If the screen size is reduced to meet mobile device constraints, then the device becomes more portable and convenient, but the interval between GUIs decreases leading to selection errors
Solution Approach 1:
The patent segments the touch input by generating multiple virtual points of contact around the actual touch position. Instead of treating the touch as a single point, it divides the contact area into multiple discrete points that are evaluated separately against GUI hit determination areas, thereby improving selection accuracy on small screens.
Solution Approach 2:
The patent transitions from two-dimensional touch coordinates to three-dimensional evaluation by considering multiple virtual points in space around the actual touch position. This dimensional expansion allows the system to account for finger size and pressure distribution, resolving the contradiction between small screen size and accurate GUI selection.
2Adaptability or versatility
If multiple GUIs are displayed simultaneously to provide more functionality, then the device becomes more versatile, but the close proximity of GUIs increases selection errors
Solution Approach 1:
The patent applies local quality by evaluating each virtual point of contact individually against the hit determination areas of different GUIs. Each point contributes differently to the selection outcome based on its position and the GUIs it overlaps, allowing accurate selection even when multiple GUIs are densely arranged.
Solution Approach 2:
The system provides feedback by calculating which GUI has the maximum number of overlapping virtual points and using this information to determine the intended selection. This feedback mechanism resolves ambiguities when multiple GUIs are displayed in close proximity.
3Ease of operation
If margin areas are added to hit determination zones to improve selection tolerance, then the ease of operation increases, but the area occupied by each GUI increases reducing the number of GUIs that can be displayed
Solution Approach 1:
The patent creates virtual copies of the touch point distributed around the actual contact position. These copied points simulate the effective contact area without requiring physical expansion of GUI boundaries, thereby maintaining ease of operation while preserving screen real estate for displaying more GUIs.
Solution Approach 2:
The system performs preliminary evaluation of multiple virtual points before making the final GUI selection. This preliminary action of evaluating all virtual points against all GUIs allows the system to determine selection intent accurately without requiring enlarged hit determination areas.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A plurality of GUIs (42a, 42b, 42c) are displayed on the screen (40) of a display. A hit determination area of each GUI (42a, 42b, 42c) is defined within a graphic of the GUI (42a, 42b, 42c). When a user touches a point of contact (44), four virtual points of contact (46a, 46b, 46c, 46d) are generated in the shape of a 'V' within the screen (40). A GUI desired to be selected by the user is identified according to a predetermined rule by referring to whether points of contact (44, 46a, 46b, 46c, 46d) are located within each hit determination area, the number of points of contact, the priority level defined for each GUI, etc.