Companion Processing Unit Initialization via Scene Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing methods for initializing companion processing units in mobile devices lead to latency and increased power consumption, as they either cause delays in image processing or adversely impact battery life due to unnecessary initialization of main IPs or keeping the companion chip in a low-power retention state.
Innovation Solution
The application processor proactively detects the scene captured by the camera and initializes the companion processing unit by determining the scene category, allowing it to enter a mission mode ahead of time, thereby reducing latency and power consumption by only activating necessary processing units when required.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the companion processing unit is initialized early to reduce latency, then image processing speed is improved, but power consumption increases
Solution Approach 1:
The system performs preliminary scene detection and category classification before initializing the companion processing unit. By detecting the scene type early and predicting whether companion unit initialization is needed, the system prepares only when necessary, avoiding unnecessary power consumption while ensuring readiness when required.
Solution Approach 2:
The system dynamically adjusts the initialization timing of the companion processing unit based on real-time scene detection results and predicted user actions. Instead of static initialization, the system flexibly determines whether to initialize the companion unit based on current image content and scene category, optimizing the balance between speed and power consumption.
2Use of energy by moving object
If the companion processing unit is kept in low-power retention state, then power consumption is reduced, but initialization latency increases
Solution Approach 1:
The system performs preliminary scene detection and analyzes image content to predict whether the companion processing unit will be needed. This early analysis allows the system to initialize the companion unit in advance only when the scene category suggests it will be required, hiding the initialization latency from the user experience.
Solution Approach 2:
The system uses feedback from scene detection algorithms and image analysis to dynamically adjust companion unit initialization timing. By continuously monitoring scene categories and predicting user actions, the system receives feedback that informs whether to initialize the companion unit, optimizing the response time while managing power consumption.
3Productivity
If main IPs are initialized unnecessarily, then processing capability is improved, but battery life deteriorates
Solution Approach 1:
The system performs preliminary analysis of image content and scene detection before initializing the companion processing unit. By evaluating whether the scene category requires companion unit processing capabilities, the system avoids unnecessary initialization and preserves battery life while maintaining processing capability when needed.
Solution Approach 2:
The system changes the operational parameters of the companion processing unit based on scene category and predicted user actions. Instead of maintaining fixed high-performance state, the system adjusts whether the companion unit is initialized based on actual processing needs, optimizing the trade-off between processing capability and energy consumption.
Data Source
AI summary
Embodiments of apparatus and method for operating a companion processing unit. In an example, an apparatus includes an application processor, a memory, and a companion processing unit. The apparatus also includes an image sensor. The application processor is configured to turn on the image sensor, perform a scene detection on an image received from the image sensor, and determine whether a scene category of the image is supported by the companion processing unit. In response to the scene category being supported by the companion processing unit, the application processor controls the companion processing unit to start a boot-up sequence corresponding to the scene category. The boot-up sequence enables the companion processing unit to enter a mission mode in which the companion processing unit is ready to receive and process image data from the image sensor and send processed image data to the application processor.