Wearable UI Adaptation Through Body Posture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices lack the ability to dynamically adapt user interface elements based on user input and body posture, leading to suboptimal interaction experiences.
Innovation Solution
A wearable device equipped with a camera, display, and communication circuitry that identifies user body parts and postures to dynamically change visual objects on the display based on user inputs, allowing for enhanced interaction through shape and posture recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the wearable device displays a fixed user interface, then the device complexity is reduced, but the adaptability to different user inputs and body postures deteriorates
Solution Approach 1:
The user interface is transformed from a static display to a dynamic system that automatically adapts its visual objects based on detected body postures and external objects. The processor continuously monitors camera input, identifies body part postures, and modifies UI element positions, sizes, and orientations in real-time, creating a living interface that responds to user context without requiring complex manual configuration
Solution Approach 2:
The wearable device performs self-adjustment of its user interface by automatically detecting body postures through the camera and externally provided object information. The system serves itself by autonomously determining when to reposition, resize, or rotate visual objects based on detected gestures and environmental context, eliminating the need for explicit user commands or complex control algorithms
2Adaptability or versatility
If the wearable device uses camera-based body part identification, then the adaptability to gestures is improved, but the use of energy increases
Solution Approach 1:
The system processes only the necessary portion of camera data required for body part identification rather than analyzing the entire field of view continuously. The processor focuses computational resources on detecting specific body part postures and gestures that are relevant to UI adaptation, reducing overall energy consumption while maintaining adaptability to user inputs
Solution Approach 2:
The camera-based body part identification operates periodically rather than continuously, triggering processing only when specific gestures or posture changes are detected. This periodic operation reduces energy consumption by keeping the camera and processing circuits in low-power states between detection events, while still maintaining high adaptability to user body movements
3Ease of operation
If the visual objects are dynamically transformed based on external objects, then the ease of operation is improved, but the device complexity increases
Solution Approach 1:
The system uses externally provided object information as an intermediary to bridge the gap between the user environment and the wearable device interface. Instead of requiring complex computer vision algorithms to identify all objects, the device receives pre-processed object data from external sources and uses this information to automatically adjust visual object positions, sizes, and orientations, simplifying the overall system architecture while improving ease of operation
Data Source
AI summary
A method of a wearable device, includes: obtaining an image with respect to external environment; displaying a first visual object in a state of displaying at least a portion of the image with respect to the external environment; based on a signal being received from an external electronic device connected through communication circuitry while the first visual object is displayed, controlling a function of the first visual object based on whether an input to control the first visual object is received through the external electronic device; based on identifying a body part having a first posture facing the first visual object while the first visual object is displayed: changing the first visual object to a second visual object corresponding to a shape of the body part; and based on identifying a second posture of the body part about the second visual object, controlling the function of the first visual object.