Distributed ISP Processing for Longer Head-Mounted Device Battery Life
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays (HMDs) face significant battery life challenges due to heavy image signal processor (ISP) operations, which rapidly deplete lightweight batteries, limiting their extended use.
Innovation Solution
A distributed image signal processing (ISP) system that offloads ISP operations from the head-mounted device to a companion computing device, utilizing both devices' processing capabilities to extend battery life.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If ISP operations are performed locally on the head-mounted device, then image processing speed is improved, but battery life deteriorates
Solution Approach 1:
The ISP operations are segmented into multiple processing stages (raw image processing, Bayer processing, RGB processing, YUV processing). Different stages are distributed between the head-mounted device and companion device based on power consumption characteristics, allowing fast local processing of critical paths while offloading power-intensive operations
Solution Approach 2:
A companion computing device acts as an intermediary to handle power-intensive ISP operations. The companion device receives image data from the head-mounted device, performs computationally heavy processing (Bayer, RGB, YUV conversions), and returns processed images, thereby extending battery life while maintaining processing capability
2Duration of action of moving object
If battery capacity is increased to extend operation time, then duration of action is improved, but device weight increases
Solution Approach 1:
The companion computing device serves as an external intermediary that provides additional processing power and battery capacity. By offloading ISP operations to the companion device, the head-mounted device can maintain lightweight design with smaller battery while achieving extended operation time through the companion device's resources
Solution Approach 2:
The system transitions from a single-device architecture to a distributed two-device architecture. This dimensional change allows the head-mounted device to remain lightweight while the companion device (which can be larger and heavier) provides the additional battery capacity and processing power needed for extended operation
Data Source
AI summary
A distributed image signal processing (ISP) system for a head-mounted device reduces the power load on the battery of the head-mounted device. The distributed ISP system includes a Bayer image processing engine, an RGB image processing engine, and a YUV image processing engine. The Bayer image processing engine is operated by, for example, processing logic of the head-mounted device. The Bayer image processing engine provides Bayer image data from raw image data. The YUV image processing engine is operated by, for example, processing logic of a (companion) computing device (e.g., a phone, tablet, laptop, compute puck, personal computer). The computing device is communicatively coupled (e.g., wired or wirelessly) to the head-mounted device to receive image data. The RGB image processing engine may be operated by the head-mounted device or the computing device.