Long Exposure Image Generation via Multi-Frame Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Photographers face challenges in capturing long exposure images without the need for cumbersome tripods or additional equipment, as handheld camera stabilization is difficult due to involuntary muscle movements during multi-second exposures.

Innovation Solution

Techniques for creating long exposure imagery on mobile devices that allow users to capture images without tripods, using multi-phase processing to align and merge multiple short exposures into a single image, leveraging hardware components like cameras, sensors, and machine learning for real-time feedback and image stabilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional long exposure photography is performed handheld, then the photographer can move freely and capture images without tripods, but involuntary muscle movements during multi-second exposures cause camera shake and blur the images

Engineering Contradiction:
Improvehandheld operationVSAvoidimage sharpness
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The long exposure capture process is segmented into multiple short exposure frames captured in rapid succession. Each frame is captured with a short exposure time (e.g., 1/30 second) to freeze motion and eliminate camera shake, while multiple frames are combined later to achieve the cumulative effect of a long exposure. This segmentation allows handheld operation while maintaining image sharpness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system captures multiple frames and uses image processing algorithms to analyze and combine them, providing feedback through the final composite image that shows the long exposure effect. The multi-frame approach provides real-time feedback on scene stability and allows selective combination of the best frames to achieve the desired artistic effect while maintaining sharpness.

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If multiple short exposures are captured and combined to create long exposure images, then image quality and noise reduction improve, but the processing time and computational resources increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing multiple short exposure frames in rapid succession during the exposure period. This preliminary capture of multiple frames allows for later processing and combination to achieve the long exposure effect. The preliminary action of capturing multiple frames enables subsequent noise reduction and quality improvement through computational processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates multiple copies of the scene through repeated short exposure captures. These copies (frames) are then processed and combined to produce the final long exposure image. The copying approach allows for selective combination of frames, noise reduction through averaging, and achievement of the desired artistic effect while managing processing requirements.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If traditional long exposure techniques are used, then smooth water features and light trails can be captured, but the requirement for tripods and additional equipment increases device complexity

Engineering Contradiction:
Improvelong exposure effectVSAvoidequipment requirements
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system replaces the mechanical stabilization system (tripod) with a computational approach. Instead of mechanically fixing the camera to eliminate movement, the system captures multiple short exposure frames and uses image processing algorithms to combine them, achieving the long exposure effect while allowing handheld operation. This substitution eliminates the need for additional equipment while maintaining the desired artistic effect.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The multi-frame capture and processing system provides universal functionality that can achieve various long exposure effects (smooth water, light trails, star trails) using the same basic approach. The system is multi-functional in that it can capture different types of long exposure imagery without requiring specialized equipment, making the technique universally applicable to mobile devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11477391B1Generating long exposure images
Publication Date: 2022.10.18 LUX OPTICS INC
  • US11477391B1 patent drawing
  • US11477391B1 patent drawing
  • US11477391B1 patent drawing

AI summary

Video stream data is received. The video stream data comprises a plurality of arriving frames. An indication that the stream data should be processed into a long exposure image is received. In response to receipt of a frame arrival, an attempt to align a current frame with a registration image is made. Based at least in part on at least one of the frame arrival and the attempt to align the current frame with the registration image, a determination is made that feedback should be provided to a user. The feedback is provided to the user.