Camera Still Capture During Video Using Intermediate Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional cameras compromise on still picture quality and performance when capturing video, often missing video frames during still picture processing and limiting the rate of consecutive still picture recording.
Innovation Solution
A method that processes sensor frames by generating intermediate frames, down-sampling them for video, and formatting them for still pictures simultaneously, allowing for high-quality still capture during continuous video recording without missing frames, using different compression techniques and pre-processing methods for each.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video recording is performed continuously, then video stream is captured, but still picture quality and performance are compromised
Solution Approach 1:
The patent divides the image processing pipeline into separate video processing and still picture processing streams. Video frames are processed through one path while still pictures are processed through another path, allowing independent optimization of each stream without interference. This segmentation enables high-quality still capture during video recording by preventing still picture processing from interrupting the video frame sequence.
Solution Approach 2:
The patent performs preliminary processing of sensor data to create an intermediate representation that can be used for both video and still pictures. By pre-processing the sensor output into a format suitable for both streams before the streams diverge, the system avoids the need to re-process the same data twice, enabling high-quality still pictures without compromising video continuity.
2Manufacturing precision
If still pictures are captured during video recording, then still picture quality improves, but video frames are missed
Solution Approach 1:
The processing system is segmented into parallel video and still picture processing paths. When a still picture is captured, only the still picture processing path is activated while the video processing path continues uninterrupted. This eliminates video frame dropout while still allowing high-resolution still picture capture by dedicating separate processing resources to each function.
Solution Approach 2:
The system performs preliminary processing of sensor data into an intermediate format that serves as the source for both video and still picture streams. This pre-processed intermediate data is then distributed to both processing paths, allowing still pictures to be generated from the intermediate representation without requiring interruption of the video processing stream, thus preventing frame dropout.
3Manufacturing precision
If video processing is performed at full resolution, then video quality improves, but processing speed decreases
Solution Approach 1:
The patent applies different processing qualities to different output streams based on their specific requirements. Video processing operates at the resolution and quality level appropriate for video, while still picture processing operates at higher quality levels suitable for photographic output. This local quality approach optimizes processing speed for video while maintaining high quality for still pictures, as each stream receives the appropriate level of processing without unnecessary overhead.
Solution Approach 2:
By segmenting the processing into separate video and still picture paths, the system can optimize each path independently. The video processing path can use faster, lower-resolution processing appropriate for video, while the still picture path can use slower, higher-resolution processing. This segmentation resolves the contradiction by allowing video to maintain acceptable quality at higher processing speeds while still pictures achieve high quality when captured.
Data Source
AI summary
A method for processing a source frame is disclosed. The method generally includes the steps of (A) generating an intermediate frame by digitally processing the source frame, wherein the intermediate frame has an intermediate resolution and has an intermediate color space, (B) generating a video frame by down-sampling the intermediate frame, wherein the video frame has a video resolution lower than the intermediate resolution and has a video color space different than the intermediate color space, (C) generating a video stream by compressing the video frame with a video encoding technique and (D) generating a still picture by formatting the intermediate frame with a picture formatting technique, wherein (i) the still picture has the intermediate resolution and (ii) generating the still picture occurs substantially simultaneously with generating the video stream.