Virtual Long Exposure Image Generation via Motion Vector Blending
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional digital photography systems on mobile devices struggle to capture high-quality long exposure photographs due to lack of necessary hardware and limitations in settings, often resulting in inaccurate, blurry, and unsatisfactory results, especially when capturing moving objects at high speeds, and are inflexible in terms of exposure settings and lighting conditions.
Innovation Solution
The system employs robust alignment models and motion vector path blending to generate virtual long exposure images from a sequence of short exposure images, using pixel-adjusted-gyroscope-alignment and feature-based-alignment models to align images and estimate motion vectors, allowing for the creation of smooth trails for moving objects without the need for additional hardware like tripods.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If conventional mobile devices capture long exposure photographs, then the photograph can be taken with simple hardware, but the image quality becomes inaccurate and blurry
Solution Approach 1:
The patent divides a long exposure photograph into multiple short exposure images captured at different times. Instead of using a single long exposure shot that requires complex stabilization hardware, the system captures multiple shorter images and processes them computationally to simulate the long exposure effect, thereby achieving high image quality without complex hardware
Solution Approach 2:
The patent replaces the mechanical stabilization system (tripod, remote trigger) with a computational approach. Instead of physically preventing hand movement during long exposure, the system uses image processing algorithms to align and blend multiple captured images, substituting mechanical stability with digital processing to achieve sharp, accurate long exposure results
2Manufacturing precision
If additional hardware like tripod and remote trigger is used, then image quality improves, but device complexity and cost increase
Solution Approach 1:
The patent creates a virtual copy of the long exposure photograph by processing multiple short exposure images. Instead of requiring physical long exposure capture with complex equipment, the system generates a synthetic long exposure image through computational methods, providing the same visual result without the bulky tripod and remote trigger
Solution Approach 2:
The mobile device uses its own built-in camera and processing capabilities to generate the long exposure effect. The device serves itself by capturing multiple images and automatically processing them through alignment and blending algorithms, eliminating the need for external tripod and remote trigger equipment
3Productivity
If conventional systems average frames from digital images, then long exposure photograph is generated, but artifacts appear and smooth trails are not achieved
Solution Approach 1:
The patent introduces dynamic alignment and blending processes that adapt to motion patterns in the scene. Instead of simple static averaging, the system dynamically adjusts image alignment based on detected motion vectors and blends images along motion paths, creating smooth trails for moving objects while maintaining accuracy and eliminating artifacts
Solution Approach 2:
The patent changes the processing parameters from simple frame averaging to sophisticated alignment and blending operations. By adjusting alignment models, blending modes, and motion vector thresholds, the system achieves accurate long exposure results with smooth motion trails, avoiding the artifacts produced by conventional averaging methods
4Productivity
If conventional systems capture images, then images can be obtained, but flexibility in exposure settings and lighting conditions is limited
Solution Approach 1:
The patent enables dynamic adjustment of exposure parameters after image capture. Users can modify exposure time, aperture, and ISO settings computationally by adjusting the number of images processed, their alignment, and blending parameters, providing flexibility in exposure settings without requiring physical camera adjustments
Solution Approach 2:
The patent creates a universal processing system that can generate various types of long exposure images (standard long exposure, light painting, rear-sync flash effects) from the same captured images. This multi-functional approach allows a single capture sequence to produce multiple different exposure effects, greatly enhancing adaptability to different lighting conditions and artistic requirements
Data Source
AI summary
This disclosure relates to methods, non-transitory computer readable media, and systems that generate a virtual long exposure image from a sequence of short exposure images portraying a moving object. In various embodiments, the image transformation system aligns two digital images in the sequence of short exposure images. The image transformation system can determine a motion vector path for the moving object between the first digital image and the second digital image. The image transformation system can also blend pixels along the motion vector path to generate a blended image representative of the motion of the moving object between the first digital image and the second digital image. The image transformation system can generate additional blended images based on consecutive pairs of images in the sequence of digital images and generates a virtual long exposure image by combining the first blended image with the additional blended images.