Wearable Camera Resolution Control by Gaze and Posture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices struggle to effectively control the resolution of multiple areas within an image captured by a camera, particularly in virtual reality, augmented reality, and mixed reality environments, leading to suboptimal user experiences.
Innovation Solution
A wearable device equipped with multiple cameras and a processor that adjusts resolution based on gaze and posture information, allowing for dynamic resolution changes in different areas of the field-of-view to enhance image quality and user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the resolution of all areas in the captured image is increased, then the image clarity is improved, but the processing time and computational resources increase
Solution Approach 1:
The field of view is divided into multiple areas (first area, second area, third area) with different resolution requirements. The processor applies different resolutions to different areas based on their importance and the user's gaze direction, rather than uniformly increasing resolution across the entire image.
Solution Approach 2:
Different areas of the image are assigned different quality levels (resolutions). The first area corresponding to the user's gaze direction is processed at high resolution, while other areas are processed at lower resolutions, optimizing the balance between image clarity and processing efficiency.
2Measurement precision
If the resolution of the first area corresponding to gaze direction is increased, then the user experience is improved, but the overall processing load increases
Solution Approach 1:
The resolution allocation is dynamic rather than static. The processor continuously adjusts which area receives high resolution based on real-time gaze detection. When the user's gaze direction changes, the high-resolution processing area shifts accordingly, ensuring processing resources are always focused on the most relevant region.
Solution Approach 2:
The system uses gaze detection as feedback to dynamically adjust resolution allocation. The processor detects the user's gaze direction and uses this information to determine which area should receive high-resolution processing, creating a closed-loop system that optimizes processing load based on actual user attention.
3Measurement precision
If the processing resolution is increased to capture fast-moving objects, then the measurement accuracy is improved, but the frame rate decreases
Solution Approach 1:
The image processing is segmented into different resolution zones. Only the first area containing potentially fast-moving objects of interest is processed at high resolution, while other areas use lower resolution, maintaining frame rate while preserving detection accuracy for critical regions.
Solution Approach 2:
Instead of applying excessive processing to the entire image, the system applies high-resolution processing only partially to the most critical area (first area) where fast-moving objects are detected. This partial action maintains frame rate while achieving sufficient measurement precision for the important regions.
Data Source
AI summary
A processor of a wearable device is provided. The processor includes obtaining posture information of the wearable device in a space including the wearable device, based on classification information for selecting at least one feature point within pixels based on differences between pixels included in a first frames output from a first camera, identifying resolutions of each of a plurality of areas included in field-of-view (FoV) formed based on a display, based on the number of feature points obtained in each of the plurality of areas by the classification information, and changing resolution, among resolutions identified based on gaze information indicating gaze of user wearing the wearable device, corresponding to a first area, among a plurality of areas, to resolution larger than resolution corresponding to second area.