External Display Mirroring With Finger Overlay for Smartphone Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile information terminals face operability and usability issues when mirroring screens onto external displays, as users need to visually switch between the mobile device and external display to perform operations, leading to cumbersome visual line movements.
Innovation Solution
An information display apparatus that includes a touch panel with a touch sensor, which detects user interactions and creates a superimposed screen with an operating-object image, such as a finger image, to be displayed on an external display, eliminating the need for visual line movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If screen mirroring is used to display mobile terminal content on external display, then large screen viewing is improved, but operability deteriorates due to visual line movement between screens
Solution Approach 1:
The patent creates a copied view of the mobile terminal screen on the external display, including a visual representation of the operating object (finger). This copy allows users to see both the operation target and the operating object position simultaneously on the external display, eliminating the need to switch visual attention between screens while maintaining large screen viewing benefits
Solution Approach 2:
The patent introduces an intermediary visual element (operating object image) that mediates between the user's finger operation on the mobile terminal and the displayed content on the external display. This intermediary provides visual feedback about finger position on the external display, serving as a bridge that connects the two displays and eliminates the need for visual line movement
2Adaptability or versatility
If visual line movement between screens is required for operation, then screen mirroring functionality is maintained, but usability deteriorates due to cumbersome visual switching
Solution Approach 1:
The patent merges information from both screens into a single unified view on the external display. By combining the screen content copy with the operating object visual representation, users can perform operations while viewing only the external display, merging the functions of both displays into one visual interface that improves usability without losing screen mirroring capability
Data Source
AI summary
A smartphone which is an information display apparatus includes: a touch panel having a touch sensor detecting contact of an operating object by a user with respect to a display screen; and a proximity sensor detecting proximity of the operating object with respect to the display screen. The operating object is, for example, a hand/finger of the user. The smartphone creates, based on detection by the touch sensor and the proximity sensor, second display information having a content including an operating-object image representing the operating object superimposed on first display information displayed on the display screen of the touch panel, externally outputs the second display information to the external display apparatus, and displays the second display information on a display screen of the external display apparatus.