Contactless Screen Interaction With Distance-Based Visual Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Contactless operation on screens makes it difficult for users to visually grasp the correspondence between distance from the screen and the operation performed, leading to potential misinterpretation and accidental selection of incorrect functions.
Innovation Solution
An information processing apparatus that displays a first frame centered on the detected object's position and multiple second frames with different display forms, each assigned specific operations based on distance, aiding in accurate contactless interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If contactless operation is implemented without visual feedback, then operation speed and convenience are improved, but user understanding of distance-operation correspondence deteriorates
Solution Approach 1:
The patent introduces visual markers as an intermediary element between the user's hand and the screen. These markers are displayed at positions corresponding to the detected hand location and provide visual feedback about the current operation mode. The markers act as a mediator that conveys information about distance without requiring direct visual contact with the screen surface, thus maintaining contactless operation while improving distance awareness.
Solution Approach 2:
The system continuously provides visual feedback by displaying markers that indicate the detected hand position and the current operation mode (e.g., different markers for different distance zones). This feedback loop allows users to understand the correspondence between hand distance and operation type without touching the screen, resolving the information loss problem while preserving contactless operation benefits.
2Adaptability or versatility
If multiple operation zones are defined by distance, then functional versatility is improved, but user confusion and accidental selection increase
Solution Approach 1:
The patent applies different visual characteristics to markers corresponding to different operation zones. Each distance zone has its own distinct visual marker style, allowing users to easily distinguish between different operation modes. This local differentiation helps users understand which zone they are currently in and what operation will be triggered, reducing accidental selections while maintaining multiple functional zones.
Solution Approach 2:
The system uses different colors or visual styles for markers corresponding to different distance zones and operation types. This visual differentiation makes it easy for users to identify the current operation zone and understand the correspondence between distance and function, thereby improving selection accuracy while preserving operational versatility.
Data Source
AI summary
An information processing apparatus includes a processor configured to: cause a first frame to be displayed, in response to detection of an object performing contactless operation over a screen, in accordance with a distance between the screen and the object, the first frame being centered on a position on the screen corresponding to a position of the detected object; and cause multiple second frames to be displayed in association with multiple regions, the multiple second frames being centered on the position on the screen corresponding to the position of the detected object and having a different display form from the first frame, the multiple regions being defined in accordance with a distance from the screen and being assigned in advance different operations to be performed in response to the contactless operation.