Bokeh Effect Accuracy via Lens Movement Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The application of the bokeh effect in mobile devices often degrades due to the lack of consideration for lens assembly movement during optical image stabilization, leading to reduced performance and accuracy in depth mapping and image processing.
Innovation Solution
An electronic device with a motion sensor and dual camera modules, where the processor controls the lens assembly movement based on motion data to adjust the camera's angle of view, allowing for improved bokeh effect application and depth mapping by compensating for field of view variations caused by OIS operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the lens assembly is moved during OIS operation, then image stabilization performance is improved, but the accuracy of bokeh effect application deteriorates because the bokeh effect is applied without considering the lens movement
Solution Approach 1:
The system uses motion sensors to detect lens assembly movement during OIS operation and feeds this information back to the image processing device. The processor then applies the bokeh effect based on the detected movement amount, ensuring that the effect remains accurate even when the lens position changes during stabilization.
Solution Approach 2:
The system performs preliminary detection of lens movement using motion sensors before applying the bokeh effect. By knowing the lens movement amount in advance, the processor can pre-calculate the correct parameters for bokeh application, ensuring accurate effect application without requiring post-processing adjustments.
2Reliability
If the lens assembly is moved during OIS operation, then image stabilization is enhanced, but depth mapping accuracy deteriorates due to field of view variations
Solution Approach 1:
The system continuously monitors lens assembly position through motion sensors during OIS operation and uses this feedback information to adjust depth mapping calculations. The processor compensates for field of view variations by incorporating real-time lens movement data, maintaining accurate depth information despite lens repositioning.
Solution Approach 2:
The system dynamically adjusts depth mapping parameters based on the detected lens movement amount. When the lens assembly moves during OIS, the processor modifies the depth calculation parameters to account for the changed field of view, ensuring that depth mapping accuracy is maintained throughout the stabilization process.
3Productivity
If motion data from motion sensor is used to control lens assembly movement, then processing speed is improved and latency is reduced, but device complexity increases
Solution Approach 1:
The system introduces a motion sensor as an intermediary device that directly measures lens assembly movement and provides real-time data to the processor. This intermediary approach enables fast, direct measurement of lens position without requiring complex computational methods, improving processing speed while keeping the added complexity minimal and focused on a single sensor component.
Data Source
AI summary
According to certain embodiments, an electronic device comprises: a motion sensor; a first camera module including a lens assembly and a driving circuit configured to move the lens assembly in a direction substantially perpendicular to an optical axis, the first camera module having a first angle of view when the lens assembly is positioned in a reference position; a second camera module having a second angle of view, wherein the first angle of view is entirely in the second angle of view; and at least one processor electrically connected to the motion sensor, the first camera module, and the second camera module, wherein the at least one processor is configured to: control the driving circuit to move the lens assembly based on motion data received from the motion sensor, thereby causing the first camera module to have a third angle of view, offset from the first angle of view by an angle, acquire, from the first camera module, a first image corresponding to the third angle of view, acquire a second image corresponding to the second angle of view from the second camera module, acquire depth information for the first image based on the second image and the motion data, and apply a bokeh effect to the first image based on the depth information.