Flash Removal in Video Frames Using Luminance Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge of capturing low-light videos while avoiding flash overexposure in still photographs, as modern cameras struggle to balance illumination between video and still-frame image capture, leading to either flash bursts in videos or underexposed still photos.
Innovation Solution
A method and system for identifying flash-exposed frames in videos and generating replacement frames using timestamp, luminance, or user input, with options to duplicate, interpolate, or render three-dimensional scenes without flash lighting, allowing for seamless integration of still-image capture without disrupting video recording.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If flash is used for still photograph capture during video recording, then still image illumination is improved, but video frames become overexposed
Solution Approach 1:
The patent extracts and removes the harmful flash illumination from the video frames while preserving the still image capture function. The system identifies frames containing flash exposure and generates replacement frames without the flash lighting, effectively separating the still image illumination need from the video recording process.
Solution Approach 2:
The patent creates replacement frames by copying and modifying existing video frames. The replacement frames are generated by duplicating adjacent frames or interpolating motion between frames, then adjusting the luminance to match the original flash-exposed frame's lighting conditions without the harmful flash effect.
2Object-affected harmful factors
If flash is avoided during video recording, then video frame exposure is maintained, but still photograph capture becomes underexposed
Solution Approach 1:
The patent performs preliminary identification of flash-exposed frames using timestamps, luminance thresholds, or user input before finalizing the video output. This allows the system to prepare replacement frames in advance and ensures that still image capture quality is maintained without causing video overexposure.
Solution Approach 2:
The patent changes the luminance parameter of replacement frames to match the original flash-exposed frame's lighting conditions. By adjusting the brightness and contrast parameters of the generated replacement frames, the system maintains proper still image illumination while avoiding flash overexposure in the video.
3Object-affected harmful factors
If flash-exposed frames are replaced, then flash lighting is removed, but video continuity may be disrupted
Solution Approach 1:
The patent applies local quality adjustments by generating replacement frames with matched luminance and contrast characteristics specific to each flash-exposed frame. The system analyzes the local lighting conditions of each frame and adjusts the replacement frame's parameters to match, ensuring seamless integration and maintaining video continuity.
Solution Approach 2:
The patent uses feedback mechanisms to evaluate the quality of replacement frames and adjust the generation process accordingly. By comparing the luminance, contrast, and motion characteristics of replacement frames with their neighbors, the system iteratively improves the generation process to maintain video continuity and minimize visual artifacts.
Data Source
AI summary
A flash removal system identifies and removes flash lighting from a video. The flash removal system identifies flash-exposed frames in the video based on a time stamp of the frame, an average luminance of the frame, or a user input. The flash removal system generates a replacement frame for each identified flash-exposed frame based on at least one frame of the video. The flash removal system replaces the flash-exposed frames with the replacement frames, generating a modified video having reduced flash lighting.