External Display Mirroring With Finger Overlay for Smartphone Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile information terminals face operability and usability issues when mirroring screens to external displays, as users need to visually switch between the mobile device and external display to perform operations, leading to cumbersome visual line movements.
Innovation Solution
An information display apparatus that includes a touch panel with a touch sensor, which detects user interactions and creates a superimposed screen with an operating-object image, such as a finger image, to be displayed on an external display, eliminating the need for visual line movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If traditional screen mirroring is used, then the user can view the mobile terminal screen on a large external display, but the user needs to move visual line between the external display and mobile terminal screen, reducing operability
Solution Approach 1:
The patent merges the mobile terminal screen display and the external display into a unified visual interface. The external display shows both the mirrored screen content and the finger operation image simultaneously, allowing the user to view both the display content and the operation position on the same large screen without moving the visual line between devices.
Solution Approach 2:
The patent introduces a finger operation image as an intermediary visual element that bridges the gap between the mobile terminal screen and the external display. This intermediary image is generated from the touch sensor data and displayed on the external display, serving as a visual mediator that shows the user where their finger is touching without requiring them to look at the small mobile terminal screen.
2Area of stationary object
If the user operates the touch panel while visually recognizing the external display, then the user cannot recognize the hand/finger operation state, requiring visual line movement
Solution Approach 1:
The patent creates a visual copy of the finger operation state by generating a finger operation image based on touch sensor data. This copy is displayed on the external display alongside the mirrored screen content, allowing the user to see the finger operation state on the large external display without losing any operational information or needing to switch visual attention to the mobile terminal screen.
Data Source
AI summary
A smartphone which is an information display apparatus includes: a touch panel having a touch sensor detecting contact of an operating object by a user with respect to a display screen; and a proximity sensor detecting proximity of the operating object with respect to the display screen. The operating object is, for example, a hand/finger of the user. The smartphone creates, based on detection by the touch sensor and the proximity sensor, second display information having a content including an operating-object image representing the operating object superimposed on first display information displayed on the display screen of the touch panel, externally outputs the second display information to the external display apparatus, and displays the second display information on a display screen of the external display apparatus.