Head-Mounted Display Gesture Control via Motion Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Small, portable electronic devices face limitations in replicating high-resolution, large-format visual experiences due to physical size constraints, leading consumers to seek alternative high-quality, portable display solutions like head-mounted eyewear devices that can effectively integrate voice commands and hand or head movements for input control.
Innovation Solution
A portable personal computer with a microdisplay, motion detectors, and audio processing circuits that combine head and hand movements with voice commands to control operating systems or applications locally or on a remote host, using sensors and wireless interfaces for seamless interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a large-format display is used to provide high-resolution visual experience, then display quality is improved, but device portability and size are worsened
Solution Approach 1:
The patent transitions from traditional handheld display dimensions to a head-mounted spatial configuration, projecting the display field into the user's field of view in three-dimensional space. This allows a large virtual display area to be experienced without increasing the physical volume of the portable device, resolving the contradiction between display resolution/size and device portability.
Solution Approach 2:
The patent introduces optical elements (lenses, waveguides, or retinal projection mechanisms) as intermediaries between the microdisplay and the user's eyes. These intermediaries magnify and project the small microdisplay image to create a large-format visual experience, allowing high-resolution display without increasing device size.
2Measurement precision
If traditional input devices (keyboard, mouse) are used, then control precision is improved, but ease of operation in mobile environments is worsened
Solution Approach 1:
The patent replaces mechanical input devices (keyboard, mouse) with voice recognition and gesture-based control systems. Voice commands substitute for keyboard typing, and hand gestures substitute for mouse movements, eliminating the need for physical mechanical interfaces while maintaining control precision in mobile environments where traditional devices are cumbersome.
Solution Approach 2:
The patent integrates multiple input modalities (voice, gestures, touch) into a single unified control system, allowing the device to adapt to different operational contexts. This multi-functional approach provides both precision (through deliberate gestures or clear voice commands) and ease of operation (through natural, context-appropriate input methods).
3Ease of operation
If voice commands are used for control, then ease of operation is improved, but reliability in noisy environments is worsened
Solution Approach 1:
The patent combines multiple input modalities (voice commands, gesture recognition, and touch input) into a hybrid control system. This merging allows the system to cross-validate inputs and maintain reliability in noisy environments by falling back on gesture or touch recognition when voice recognition confidence is low, while preserving the ease of operation benefits of voice control.
4Adaptability or versatility
If multiple sensors are integrated for gesture and motion detection, then functionality is improved, but device complexity is worsened
Solution Approach 1:
The patent segments the sensing functions into specialized modules (accelerometer for head motion, gyroscope for orientation, microphone array for voice, camera for gestures) that can be independently optimized and processed. This segmentation manages complexity by organizing sensors into functional groups with dedicated processing pipelines, allowing high adaptability while controlling system complexity through modular architecture.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
A head mounted microdisplay (HMD) device that uses hand, body, head movement or gesture and voice commands to control interaction with a local processor or host computer. The local processor overlays information, such as onto an operating system desktop or application program menu, indicating the motion, gesture, and/or voice input needed to activate an associated action.