Camera Pipeline Resolution Switching for AR Eyewear Power Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing eyewear devices, such as smart glasses, face challenges in managing power consumption due to the processing of high-resolution images, which affects their operational duration and thermal management.
Innovation Solution
The implementation of a camera pipeline in eyewear devices that selectively controls camera resolution based on mode, switching to lower resolution in Computer Vision (CV) mode to reduce power consumption, while maintaining higher resolution in Augmented Reality (AR) mode for improved image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If high-resolution images are processed in eyewear devices, then image quality is improved, but power consumption increases
Solution Approach 1:
The system dynamically switches between different camera resolution modes based on operational requirements. In CV mode, the camera operates at lower resolution to reduce power consumption, while in AR mode, it switches to higher resolution for improved image quality. This dynamic adaptation resolves the contradiction by making the system flexible rather than fixed.
Solution Approach 2:
The patent changes the resolution parameter of the camera based on the operational mode. By adjusting this key parameter, the system achieves different performance characteristics - lower resolution for power savings in CV mode, and higher resolution for quality in AR mode, thereby resolving the contradiction between these two requirements.
2Measurement precision
If high-resolution images are processed, then image quality is improved, but operational duration is reduced
Solution Approach 1:
The system dynamically adjusts camera resolution based on the current operational mode. During extended CV operations, it uses lower resolution to extend battery life and operational duration. When AR mode is activated and high image quality is needed, it temporarily switches to higher resolution. This dynamic behavior resolves the contradiction between image quality and operational duration.
Solution Approach 2:
The system periodically switches between different resolution settings based on operational needs. It maintains lower resolution for extended periods during CV mode to maximize operational duration, and periodically switches to higher resolution when AR functionality is required, thus balancing both requirements over time.
3Use of energy by moving object
If camera resolution is reduced, then power consumption is reduced, but image quality deteriorates
Solution Approach 1:
The system applies different quality levels to different operational contexts. In CV mode, it accepts lower image quality in exchange for reduced power consumption. In AR mode, it maintains high image quality when needed. This local differentiation of quality based on operational requirements resolves the contradiction between power consumption and image quality.
Solution Approach 2:
The patent changes the resolution parameter dynamically based on operational mode. By reducing this parameter in CV mode, the system achieves lower power consumption. By increasing it in AR mode, the system achieves better image quality. This parameter adaptation resolves the contradiction by making the system flexible rather than fixed.
Data Source
AI summary
An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.