Scene Control via Hand Gesture Recognition on Mobile Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional human-computer interaction methods, such as those using data gloves or 3D depth cameras, are limited by the need for wearable devices or expensive hardware, making them unsuitable for natural and cost-effective scene control in portable devices like smartphones.
Innovation Solution
A scene controlling method and device that recognizes a trigger object's motion to switch between scene modalities without requiring hardware upgrades, using a display module, recognition module, and controlling module to associate hand gestures with scene changes, allowing for intuitive control of scene elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If data gloves or wearable products are used for gesture recognition, then the complexity of detection and recognition algorithm can be reduced, but the requirement of wearing cannot meet the demand for natural human-computer interaction
Solution Approach 1:
The patent replaces mechanical/wearable gesture recognition systems (data gloves) with a vision-based system using cameras and image processing algorithms. This substitution eliminates the need for physical wearables while maintaining gesture recognition capabilities through computer vision technology, thereby achieving natural interaction without compromising on ease of operation.
2Measurement precision
If 3D depth cameras are used for gesture recognition, then gesture control accuracy can be improved, but the large volume, high cost of hardware and high demand for computing capacity make it difficult to integrate into popular intelligent terminals
Solution Approach 1:
The patent replaces expensive 3D depth cameras with standard 2D cameras and planar image processing algorithms. This substitution uses readily available, low-cost hardware that can be easily integrated into mobile devices, significantly reducing hardware costs and computational requirements while maintaining practical gesture recognition accuracy for mobile applications.
Solution Approach 2:
The patent extracts and utilizes only the essential 2D image plane information from camera captures, eliminating the need for complex 3D depth sensing hardware. By focusing on planar image processing and key point detection in 2D space, the system achieves gesture recognition functionality using simple, lightweight camera modules that can be easily integrated into mobile devices.
3Productivity
If conventional scene control methods are used, then scene switching can be achieved, but the need for specific complicated devices and inability to control scene modality limit practical application
Solution Approach 1:
The patent implements a universal gesture recognition system that can control multiple scene modalities (e.g., switching between landscape and portrait modes, adjusting brightness, changing camera filters) using a single camera and unified algorithm framework. This multi-functional approach eliminates the need for separate control devices for different scene operations, enabling comprehensive scene control through natural gestures alone.
Data Source
AI summary
A scene controlling method, a device and electronic equipment are provided, which relate to the field of scene controlling. The scene controlling method includes displaying a scene in a first modality, recognizing a trigger object, determining a motion of the trigger object, and switching the scene from the first modality to a second modality based on the motion. The first modality of the scene is associated with the second modality of the scene. Predetermined scene information is retrieved based on the motion of the trigger object so as to switch between scenes or control an element in the scene. By associating the motions of the trigger object with the scenes, the scene displayed on the electronic equipment can be controlled without any hardware upgrade of the conventional electronic equipment, thereby reducing the cost.