Remote Screen Control via Mobile Image Capture and Touch Relay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for controlling a display device's screen, such as using a touch panel, remote controller, or mobile terminal as a mouse, are limited by requiring direct proximity, multiple key presses, or being unsuitable for multi-touch interactions while watching the screen.
Innovation Solution
A mobile terminal with an image-obtaining unit, display unit, user input unit, and transmission unit that captures and transmits screen images and touch information to a broadcast receiving terminal, enabling remote selection and control of menu items, zooming, rotating, and scrolling of the screen.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a touch panel is used for direct screen control, then the user can directly select menu items, but the user cannot execute the menu from a far distance
Solution Approach 1:
The patent introduces a mobile terminal as an intermediary device between the user and the display device. The mobile terminal captures images of the display screen, displays them locally, and transmits touch information to control the display device remotely, enabling users to operate the display from a distance while maintaining direct selection capability
Solution Approach 2:
The patent creates a visual copy of the display device screen on the mobile terminal's display unit. This copy allows the user to interact with a replicated version of the original screen, selecting menu items and controlling the display device without needing to be physically close to it
2Length of stationary object
If a remote controller with arrow keys is used, then the user can control the display device from a distance, but the user must press the arrow keys several times to select the desired menu
Solution Approach 1:
The mobile terminal creates a visual copy of the display screen and transmits it to the user's mobile device. The user can then directly touch the desired menu item on the copied screen image, which instantly transmits the selection to the display device, eliminating the need for multiple arrow key presses and significantly reducing selection time
Solution Approach 2:
The patent replaces the mechanical sequential key-press system of traditional remote controllers with an image-based direct selection system. Instead of pressing arrow keys multiple times to navigate, the user directly touches the target menu item on the displayed image, substituting sequential mechanical input with a single direct selection action
3Length of stationary object
If a mobile terminal is used as a mouse, then the user can click menu items remotely, but it is not appropriate for multi-touches because the menu should be selected while directly watching the screen
Solution Approach 1:
The patent displays a complete visual copy of the screen on the mobile terminal, preserving all spatial relationships and multiple touch points. This allows users to perform multi-touch operations on the copied screen image, selecting multiple menu items or performing gestures simultaneously, which would be impossible when directly watching a distant screen
Solution Approach 2:
The patent transitions the interaction from a two-dimensional distant screen view to a close-up view on the mobile terminal display. This dimensional change brings the entire screen content into the user's immediate field of view, enabling accurate multi-touch interactions without requiring the user to physically approach the original display device
Data Source
AI summary
A mobile terminal includes an image-obtaining unit configured to obtain an image including a screen displayed by a display device; a display unit configured to display the obtained image to a user; a user input unit configured to receive touch information on the display unit from the user; and a transmission unit configured to transmit screen display information about how the screen is displayed on the display unit and the touch information to a broadcast receiving terminal connected to the display device, wherein the touch information includes selection information of a first point on the display unit and movement direction information of the first point when the first point moves.