Image Sensor Mode Control via Scene Analysis for Power Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile image capture devices face resource constraints such as limited memory, processing power, and energy, which hinder their ability to continuously capture and store high-resolution images without overheating, making it challenging to efficiently manage image storage and capture modes.
Innovation Solution
A resource-efficient mobile image capture device with an image sensor that adjusts frame rate and resolution based on scene analysis, using a scene analyzer with neural networks to selectively retain and store images, transitioning between capture modes to conserve energy and reduce memory consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the device continuously captures high-resolution images, then image quality is improved, but power consumption increases and memory resources are depleted
Solution Approach 1:
The system dynamically adjusts capture resolution and frame rate based on scene analysis. The scene analyzer evaluates each captured image to determine if it contains worthwhile content, and the capture mode is adjusted accordingly - using high resolution only when needed and lower resolution otherwise, thereby reducing overall power consumption while maintaining image quality for important moments
Solution Approach 2:
The patent changes operational parameters (resolution, frame rate) based on scene desirability. The scene analyzer assesses scene worthiness and the system transitions between different capture modes with different parameter settings, allowing high-quality capture only when the scene justifies the power consumption
2Manufacturing precision
If the device continuously captures high-resolution images, then image quality is improved, but memory usage increases
Solution Approach 1:
The system dynamically adjusts the resolution of captured images based on scene analysis. When the scene analyzer determines low worthiness, the system captures at reduced resolution, directly reducing memory usage while preserving high resolution for worthwhile scenes
Solution Approach 2:
The patent implements parameter changes in capture resolution based on scene desirability assessment. The system transitions between high and low resolution capture modes, controlling the quantity of image data stored in memory according to scene worthiness
3Productivity
If the device operates at high processing power, then capture speed is improved, but thermal power dissipation increases
Solution Approach 1:
The system uses periodic scene analysis interspersed with capture operations. Rather than continuously operating at maximum processing power, the scene analyzer periodically evaluates scenes and the system alternates between high-performance capture modes and lower-power modes, reducing overall thermal dissipation while maintaining capture capability
Solution Approach 2:
The processing power is dynamically adjusted based on scene worthiness. The system transitions between different capture modes with different processing demands, using high processing power only when the scene analyzer determines the scene is worthwhile, thereby reducing thermal power dissipation
4Use of energy by moving object
If the device uses scene analysis to selectively capture images, then power consumption is reduced, but device complexity increases
Solution Approach 1:
The system segments the image processing function into two parts: a lightweight scene analysis function that runs on the mobile device to determine scene worthiness, and a more complex image processing function that runs on the cloud server. This segmentation allows the mobile device to use simpler, lower-power processing while still achieving selective capture based on scene analysis
Solution Approach 2:
The patent introduces cloud computing as an intermediary to handle complex image processing tasks. The mobile device sends captured images to the cloud server for analysis and processing, allowing the device to reduce its own processing complexity and power consumption while still achieving intelligent selective capture
Data Source
AI summary
The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. In particular, the present disclosure provides low power frameworks for controlling image sensor mode in a mobile image capture device. On example low power frame work includes a scene analyzer that analyzes a scene depicted by a first image and, based at least in part on such analysis, causes an image sensor control signal to be provided to an image sensor to adjust at least one of the frame rate and the resolution of the image sensor.