Screen Control via Image Recognition for Non-Touch Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current screen interaction technologies for televisions, such as touch control, require significant additional hardware costs and complex manufacturing processes, especially for large screens like 65/75 inches, making them impractical for widespread use.
Innovation Solution
A screen control method that recognizes user operation intent based on current display content, generates preset identifications for subregions on the screen, and executes corresponding operation instructions using a target image captured by a photography terminal, allowing interaction without physical buttons.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch control is implemented on large screens (65/75 inches or larger), then user interaction experience is improved, but manufacturing cost and process complexity increase significantly
Solution Approach 1:
The patent uses image capture (photography) to create a digital copy of the screen display, which is then processed to identify user selection. This copying approach replaces the need for physical touch control hardware on large screens, achieving touch-like interaction through software-based image recognition instead of hardware modification
Solution Approach 2:
The patent replaces the mechanical touch control system with an optical-based system using image capture and processing. Instead of requiring physical contact sensors or touch layers on the screen, the system uses photography terminals to capture the screen display and identifies user selections through image analysis, substituting mechanical interaction with optical-digital processing
2Adaptability or versatility
If additional detection devices are attached around screens to achieve touch control effect, then interaction capability is improved, but device complexity and manufacturing requirements increase
Solution Approach 1:
The patent makes the photography terminal serve multiple functions: it captures the screen display, identifies user selections through image processing, and transmits control signals. This universal approach allows a single device to perform what would traditionally require multiple specialized components (detection devices, processing units, control interfaces), thereby reducing overall system complexity
Solution Approach 2:
The system uses the existing display screen itself as the interaction interface by capturing its own image. The screen serves both as the display medium and as the target for interaction identification, eliminating the need for separate detection devices attached around the screen
Data Source
AI summary
A screen control method, a device, a storage medium, and a terminal device. The method includes: recognizing a user's operation intend; generating preset identifications on a display terminal based on the operation intent and an identification generation rule; obtaining a target image; extracting the preset identifications in the target image, and executing operation instructions on the display terminal. The embodiments of the present invention can enable a display screen without a touch screen to have the effect that the display screen may be interacted with without the aid of physical buttons.