Video Highlight Image Acquisition with Buffered RAW Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile devices struggle to automatically select and present highlight images from video recordings with sufficient image quality, as they often subsample images to meet video processing demands, resulting in lower resolution than desired by users.
Innovation Solution
The method involves buffering images in a first queue, applying a RAW domain image processing algorithm to enhance image quality, and selecting high-resolution images for presentation after recording, using an image signal processor (ISP) to perform additional processing without subsampling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If images are subsampled to meet video processing demands, then video processing efficiency is improved, but image resolution deteriorates
Solution Approach 1:
The patent divides the image processing pipeline into two separate paths: one path subsamples images for video processing to ensure efficiency, while another path processes original high-resolution images for highlight picture generation. This segmentation allows both video processing efficiency and high image resolution to be achieved simultaneously by handling different image quality requirements through dedicated processing channels.
2Manufacturing precision
If original RAW domain image processing algorithms are applied to enhance image quality, then image quality is improved, but processing complexity increases
Solution Approach 1:
The patent applies RAW domain image processing algorithms to buffer images in advance during video recording, preparing high-quality images before they are needed for highlight picture generation. This preliminary processing ensures that when highlight pictures need to be created, high-quality processed images are already available, reducing the complexity of real-time processing while maintaining image quality.
3Manufacturing precision
If high-resolution images are processed without subsampling, then image resolution is improved, but processing time increases
Solution Approach 1:
The patent processes high-resolution images in advance during the video recording period, buffering processed images before they are needed. By performing the computationally intensive processing of high-resolution images beforehand rather than in real-time when highlight pictures are needed, the system maintains high image resolution while avoiding excessive processing delays when the images are actually required.
Data Source
Figure 1~3
Figure 4
Figure 5
AI summary
An image obtaining method and an electronic device relate to the field of photographing technologies, and can automatically select and present a highlight image in a video record to a user. The solution includes: An electronic device receives a first operation of a user; displays a first interface (that is, a viewfinder interface on which a video is being recorded) in response to a first operation, where the first interface includes a preview image; selects a second image (that is, an image including a target object) from a first video stream, where the first video stream is obtained by an ISP by performing, on a plurality of frames of first images, first processing including subsampling; buffers the first images in a first buffer queue; uses m frames of first images corresponding to the second image in the first images buffered in the first buffer queue as an input, and runs a preset RAW domain image processing algorithm to obtain a third image; performs, by sampling an ISP, second processing not including subsampling on the third image, to obtain a fourth image; and after video recording ends, displays a highlight image obtained by encoding the fourth image.