Camera Zoom Pipeline Scaling for Faster Low-Light Response
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices experience delays and reduced responsiveness in camera zoom functions due to pipeline processing delays and frame processing times, particularly in low-light environments, leading to sluggish zoom performance.
Innovation Solution
The electronic device processes frames at a first zoom magnification while displaying the first frame, requests and processes subsequent frames at a new zoom magnification upon user input, and scales the frames to the new magnification at the time of acquisition, using an image signal processor and a scaler to reduce pipeline delays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the image signal processor processes frames in sequential order through the pipeline, then image processing completeness is improved, but zoom responsiveness deteriorates due to pipeline delay
Solution Approach 1:
The patent applies preliminary action by requesting and processing the (N+1)th frame at the first zoom magnification in advance while the Nth frame is being displayed. This allows the processing pipeline to be prepared ahead of time, so when a zoom change is requested, the system can quickly switch to processing frames at the new magnification without waiting for the current frame to complete processing, thereby reducing pipeline delay and improving zoom responsiveness
Solution Approach 2:
The patent implements dynamics by allowing the image signal processor to dynamically switch between processing frames at the first zoom magnification and the second zoom magnification based on user input. The system can adjust the processing magnification on-the-fly without requiring a complete pipeline reset, enabling responsive zoom changes while maintaining continuous frame processing
2Reliability
If the frame interval is increased for exposure adjustment in low-light environments, then image quality is improved, but zoom responsiveness deteriorates
Solution Approach 1:
In low-light environments where longer exposure times are required, the patent applies preliminary action by preparing and processing frames in advance at the current magnification. This allows the system to have frames ready for quick zoom switching without compromising the necessary exposure time for image quality, thereby maintaining both image quality and zoom responsiveness
3Manufacturing precision
If multiple frames are processed through the complete pipeline before display, then processing thoroughness is improved, but time delay increases
Solution Approach 1:
The patent applies preliminary action by requesting and preprocessing frames in advance before they are needed for display. By preparing frames at the appropriate magnification ahead of time and maintaining a buffer of preprocessed frames, the system reduces the time delay between zoom request and display while ensuring thorough processing is completed
Solution Approach 2:
The patent implements continuity of useful action by maintaining continuous frame processing through the pipeline without interruption. Frames are continuously captured, processed, and buffered, ensuring that when a zoom change is requested, the system can immediately switch to processing frames at the new magnification without stopping the processing flow, thereby minimizing time delay while maintaining processing thoroughness
Data Source
AI summary
An electronic device is provided. The electronic device includes a display, an image sensor, an image signal processor for processing frames transmitted from the image sensor, a scaler arranged between an output end of an image pipeline and an input end of the display, memory, comprising one or more storage media, storing instructions, one or more processors operatively connected to the display, the image sensor, the image signal processor, the scaler, and the memory, wherein the instructions, when executed by the one or more processors individually or collectively, cause the electronic device to acquire, from the image sensor, a first frame of a first zoom magnification, control that a second frame to Nth frames are image-processed at the first zoom magnification through the image signal processor while the first frame of the first zoom magnification processed through the image signal processor is output to the display, receive a user input for requesting the display of a second zoom magnification, which differs from the first zoom magnification at the time of N+1 frame acquisition, request the image signal processor to process the N+1 frame, set to transmit, to the scaler, a second zoom magnification request at the time of N+1 frame acquisition, and allow the scaler to scale, in a second frame output order, at the second zoom magnification requested at the time of N+1 frame acquisition, a second frame processed at the first zoom magnification in the image signal processor so as to transmit same to the display.