Microvideo Format with On-the-Fly Trimming for Resource-Limited Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image capture devices face challenges with resource-constrained environments, including limited memory, processing power, and energy, and produce videos with extraneous imagery that reduces quality due to out-of-pocket motion, sudden brightness changes, and undesired camera movements.
Innovation Solution
A novel microvideo format that combines a still image with a brief video, incorporating motion data for stabilization, and a microvideo generation system that trims the video on-the-fly to remove unwanted imagery, using sensor and ISP data for low computational complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a short movie captures imagery for a predetermined time before and after user input, then the user can see context around the captured moment, but the video includes extraneous imagery that reduces quality
Solution Approach 1:
The patent extracts and removes extraneous portions of the video sequence that contain unwanted imagery such as out-of-pocket motion, sudden brightness changes, and undesired camera zooming or rotation. This leaves only the high-quality segments containing the captured moment and relevant context, resolving the contradiction by selectively removing harmful content while preserving useful context.
Solution Approach 2:
The system dynamically adjusts video parameters by identifying segments where motion characteristics, brightness levels, and camera orientation remain within acceptable thresholds. By changing the temporal boundaries of the video based on these parameter analyses, the system maintains quality while preserving contextual information.
2Quantity of substance
If the device captures and stores video continuously, then more video content is available for review, but memory and processing resources are quickly depleted
Solution Approach 1:
Instead of storing all captured video content, the system extracts only the relevant high-quality segments for storage. By identifying and keeping only portions of video that meet quality criteria (excluding segments with unwanted motion, brightness changes, or rotation), the system significantly reduces storage requirements and processing energy while maintaining useful video content.
Solution Approach 2:
The system discards low-quality video segments that consume resources but provide little value, while recovering and retaining only the valuable portions. This selective discarding and recovery approach optimizes the balance between video content quantity and resource consumption.
3Manufacturing precision
If video stabilization processing is applied to remove unwanted motion, then video quality improves, but computational complexity increases significantly
Solution Approach 1:
The system performs preliminary analysis of motion characteristics, brightness changes, and camera orientation during or immediately after capture to identify quality segments before final processing. By pre-identifying which segments require stabilization and which should be discarded, the system reduces the overall computational complexity while maintaining quality improvement where needed.
Solution Approach 2:
The system applies stabilization processing selectively based on parameter thresholds, adjusting the intensity and scope of processing according to the specific characteristics of each video segment. This parameter-based approach reduces computational complexity by avoiding unnecessary processing in already high-quality segments while applying stabilization only where needed.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
The present disclosure provides systems and methods that use and/or generate image files according to a novel microvideo image format. For example, a microvideo can be a file that contains both a still image and a brief video. The microvideo can include multiple tracks, such as, for example, a separate video track, audio track, and/or one or more metadata tracks. As one example track, the microvideo can include a motion data track that stores motion data that can be used (e.g., at file runtime) to stabilize the video frames. A microvideo generation system included in an image capture device can determine a trimming of the video on-the-fly as the image capture device captures the microvideo.