Multipurpose Controller Using Facial Expression and Body Motion Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies for controlling electronic devices without handheld or touch-activated controllers face limitations such as lack of hands-free or legs-free functionality, complexity, inaccuracy, lack of portability, and high manufacturing costs, resulting in few commercially successful hands-free computer controller products.
Innovation Solution
A processor-based apparatus that receives facial expression and body motion information to generate signals for controlling electronic devices, using sensors like optoelectronic, proximity, and image sensors to detect facial expressions and body movements, allowing hands-free interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If facial expression and body motion sensors are used for hands-free control, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The control system is divided into separate functional modules: facial expression sensing module, body motion sensing module, signal processing module, and device control module. Each module handles specific sensor data independently before integrating results, reducing overall system complexity while maintaining hands-free operation capability
Solution Approach 2:
A microprocessor-based control unit acts as an intermediary between the sensors and the electronic device. The control unit receives raw data from multiple sensors, processes and filters the information, and generates appropriate control signals, thereby simplifying the interaction between complex sensor systems and the target device
2Measurement precision
If multiple sensors are integrated for comprehensive detection, then measurement precision is improved, but manufacturing cost increases
Solution Approach 1:
The control unit serves multiple functions: it processes facial expression data from the first sensor, processes body motion data from the second sensor, integrates both data streams, and generates control signals. This multi-functionality reduces the need for separate dedicated processing circuits for each sensor type, thereby lowering manufacturing costs while maintaining high measurement precision
Solution Approach 2:
The patent combines facial expression sensing and body motion sensing into a unified control system that processes both data types through a single microprocessor. The control unit merges the detection capabilities of multiple sensors into one integrated platform, reducing the number of separate components needed and lowering overall manufacturing complexity
3Adaptability or versatility
If sensor-based detection is used, then adaptability is improved, but reliability decreases due to potential inaccuracy
Solution Approach 1:
The control unit continuously monitors the output from both facial expression and body motion sensors, comparing the data against predefined thresholds and patterns. When sensor readings fall outside expected ranges or indicate ambiguous input, the system can request re-input or wait for clearer signals, thereby maintaining high reliability while preserving adaptability to various user input methods
Data Source
AI summary
Method and apparatus is disclosed for a user to communicate with an electronic device. A processor receives user intention actions comprising facial expression (FE) information indicative of facial expressions and body information indicative of motion or position of one or more body parts of the user. When the FE or body information crosses a first level, the processor starts generating first signals based on the FE or body information to communicate with the electronic device. When the FE or body information crosses a second level, the processor can end generation of the first signals or modify the first signals. An image processing or eye gaze tracking system can provide some FE information or body information. The signals can modify attributes of an object of interest.