Gesture Control Terminal Interface via Camera Motion Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current terminal device control methods rely on touch or voice operations, limiting flexibility and resulting in an unsatisfactory interactive experience for users.
Innovation Solution
Implementing a gesture control function that activates a camera to capture and analyze motion images, matching them with preset motions to generate operation instructions and control the terminal device interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If touch operation or voice operation is used to control terminal device, then the operation mode is simple to implement, but the flexibility and interactive experience are limited
Solution Approach 1:
The patent introduces gesture recognition as an intermediary between traditional touch/voice operations and device control. The camera captures hand gestures, the processor recognizes these gestures, and converts them into control commands, thereby adding operational flexibility without requiring fundamental changes to the device architecture.
Solution Approach 2:
The patent replaces traditional mechanical touch input or acoustic voice recognition with optical gesture recognition. By using the camera to capture visual hand movements and processing these visual inputs, the system substitutes optical-based gesture control for conventional input methods, enhancing versatility while maintaining implementation feasibility.
2Ease of operation
If gesture control function is activated with camera capture and motion analysis, then the interactive experience and intellectuality are improved, but the device complexity increases
Solution Approach 1:
The patent makes the existing camera and processor serve multiple functions: the camera is used both for regular display content capture and for gesture recognition, while the processor handles both general computing tasks and gesture analysis. This multi-functionality approach improves interactive experience without proportionally increasing device complexity.
Solution Approach 2:
The system uses the device's own existing resources (camera, processor, display) to implement gesture control, rather than requiring entirely new dedicated components. The camera serves itself by switching between normal operation and gesture capture modes, and the processor self-manages the additional gesture recognition workload alongside its other tasks.
Data Source
AI summary
The present disclosure provides a method and apparatus for controlling a terminal device, and a storage medium. The method includes: when a gesture control function is activated on a current interface of the terminal device, obtaining an interface identifier of the current interface and a preset motion corresponding to the interface identifier; turning on a camera and displaying an image taken by the camera in a preset display area of the current interface; determining whether the image contains a motion image matching with the preset motion; and if the image contains the motion image matching with the preset motion, obtaining an operation instruction corresponding to the motion image, and controlling the current interface according to the operation instruction.