Long-Exposure Image Simulation via Optical Flow Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for capturing long-exposure images require stable camera settings and long exposure times, or manual image processing, which can be cumbersome and time-consuming, and do not effectively simulate the desired blur effect for moving elements.

Innovation Solution

A method that examines a series of images, determines optical flow, blurs regions based on optical flow attributes, and composites the blurred regions onto original images to simulate a long-exposure effect, allowing for automatic creation of high-quality long-exposure images without the need for stable camera settings or manual processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a camera is set in a stable and stationary position with a long exposure time to capture a scene, then moving elements in the scene are blurred and stationary elements remain crisp, but the user effort and time required to capture and process the images increases

Engineering Contradiction:
Improveimage qualityVSAvoidtime to capture and process images
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing a burst of short-exposure images before the user needs the long-exposure effect. These pre-captured images are then processed automatically to generate the long-exposure effect, eliminating the need for the user to manually set up long exposure timing and reducing the time required at the moment of capture.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical/optical system of actual long-exposure photography with a computational approach. Instead of using a long exposure time setting on the camera, the system uses image processing algorithms to combine multiple short-exposure images and simulate the long-exposure effect, substituting computational mechanics for optical mechanics.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If manual image processing is used to create long-exposure effects, then the desired blur effect can be achieved, but the process becomes cumbersome and time-consuming

Engineering Contradiction:
Improveblur effect qualityVSAvoiduser effort for image processing
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system performs self-service by automatically detecting moving elements in the captured images and applying the appropriate blur effects without requiring user intervention. The algorithm autonomously identifies regions with motion, calculates the blur parameters, and generates the final long-exposure effect image, making the process effortless for the user.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes the parameter of exposure time from long (in the camera setting) to short (in the captured images), and compensates by changing other parameters in the processing stage - combining multiple short-exposure images with different motion states to achieve the equivalent effect of a single long-exposure image, but with automated parameter adjustment.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If traditional long-exposure methods are used, then the blur effect for moving elements is achieved, but the method does not work effectively with images captured over various time spans

Engineering Contradiction:
Improveblur effect accuracyVSAvoidflexibility in capture time spans
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The system introduces dynamics by allowing flexible capture time spans rather than requiring a fixed long exposure duration. The algorithm dynamically adjusts to images captured over varying time periods, automatically determining the appropriate blur intensity and applying temporal filtering that adapts to the actual capture duration, making the system versatile for different shooting scenarios.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback by analyzing the actual content and motion characteristics of the captured short-exposure images to determine the appropriate blur effect parameters. The algorithm examines the images, identifies moving elements, and adjusts the blur intensity based on the observed motion, providing feedback-driven adaptation to the specific capture conditions rather than applying a fixed processing routine.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9836831B1Simulating long-exposure images
Publication Date: 2017.12.05 GOOGLE LLC
  • US9836831B1 patent drawing
  • US9836831B1 patent drawing
  • US9836831B1 patent drawing

AI summary

Implementations relate to simulating long-exposure images. In some implementations, a method includes examining a series of images, determining an optical flow of pixel features between the image and an adjacent image in the series of images, and blurring one or more regions in one or more of the images, where the one or more regions are spatially defined based on one or more attributes of the optical flow.