Handheld Touchscreen TV Control With Mirrored UI and Gesture Modes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interface (UI) interaction methods for handheld devices with televisions, such as using a mouse or keyboard, are inadequate for accurate operations like choosing a movie or playing games, especially when sliding over large areas, failing to meet user convenience and comfort.
Innovation Solution
A UI interaction system using HDMI connections between a handheld device and a TV, which includes a touch screen, gesture managing module, and display managing module, adjusts resolution and operation modes to enable seamless control of the TV through touch gestures, eliminating the need for additional hardware like a mouse or keyboard.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a mouse or keyboard is used to interact with the television, then the operation can be conducted on a large screen, but the operation precision and ease of use deteriorate when performing tasks like choosing a movie or playing games
Solution Approach 1:
The patent creates a virtual copy of the television interface on the handheld device's touch screen. The display managing module renders a scaled-down version of the TV interface that mirrors the actual TV screen layout, allowing users to interact with familiar visual elements using touch gestures. This virtual copy enables precise selection operations on the small touch screen while maintaining the large-screen viewing experience on the TV.
Solution Approach 2:
The patent adds a new interaction dimension by implementing dual-mode operation: cursor mode for precise point-to-point selection and touch mode for natural gesture-based navigation. The gesture managing module translates two-dimensional touch gestures on the handheld device into corresponding operations on the television interface, creating a new spatial dimension for interaction that combines the precision of cursor control with the intuitiveness of touch gestures.
2Adaptability or versatility
If additional hardware like a mouse or keyboard is used to operate the television, then the operation capability is enhanced, but the device complexity and cost increase
Solution Approach 1:
The patent makes the handheld device universally functional for both media consumption and television control. The display managing module and gesture managing module work together to enable the handheld device's touch screen to serve dual purposes: displaying media content and controlling the television interface. This eliminates the need for separate control hardware, as the handheld device itself becomes the universal controller.
Solution Approach 2:
The system enables self-service operation where the handheld device provides its own interface for controlling the television. Instead of requiring external control hardware, the handheld device uses its existing touch screen and processing capabilities to generate and transmit control commands to the television. The device serves itself as both the control interface and the processing unit, eliminating unnecessary external peripherals.
3Manufacturing precision
If the touch screen resolution is adjusted to match the television resolution, then the display quality is improved, but the processing load and power consumption increase
Solution Approach 1:
The display managing module dynamically adjusts the touch screen resolution based on the operational mode and content being displayed. Rather than maintaining a fixed high resolution that matches the television's native resolution at all times, the system adaptively scales the resolution according to the specific task requirements, balancing display quality with power consumption and processing load.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
Disclosed are a UI system and method for interaction between a handheld device and a TV set, comprising the configuration and connection of a second HDMI transfer module, a touch screen, a gesture management module and a display management module, and of a first HDMI transfer module and a television screen. The UI system and method for interaction between a handheld device and a TV set utilize a handheld device having a touch screen to operate the TV set and do not require other hardware, such as a mouse or keyboard. All the operations can be done by using only the handheld device, thereby reducing the costs of devices.