Motion Blur Application for Overcaptured Content

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for adding motion blur to panoramic content, especially 360° overcapture content, are computationally expensive and unsuitable for mobile devices, leading to unnatural rendering and motion judder, which de-stabilizes the content and is not viable for spherical cameras.

Innovation Solution

A method involving selecting frames and pixel locations for motion blur application, using averaging filters to assign average pixel color values, and implementing virtualized neutral density filters to simulate cinematic effects, while allowing user adjustment of judder and stabilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple pixel-by-pixel computations of optical flow are used to add motion blur, then motion blur quality is improved, but computational expense increases making it unsuitable for mobile devices

Engineering Contradiction:
Improvemotion blur qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical optical flow computations with a simpler digital processing approach using predefined motion vectors and pixel sampling. Instead of calculating optical flow pixel-by-pixel, the system uses substituted digital operations to achieve motion blur, reducing computational burden while maintaining quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the parameters of the motion blur application by using motion vectors derived from keyframe analysis rather than continuous optical flow computation. This parameter substitution allows the system to achieve similar visual effects with significantly reduced computational complexity, making it suitable for mobile devices.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If in-camera motion blur is used with longer shutter times, then motion blur effect is improved, but stabilization is de-stabilized

Engineering Contradiction:
Improvemotion blur effectVSAvoidstabilization
Core Design Contradiction:
Manufacturing precisionVSStability of the object's composition

Solution Approach 1:

The patent applies preliminary stabilization during the capture phase using short shutter times, then adds motion blur effect in post-processing. This preliminary action ensures stabilization is maintained while the motion blur effect is applied separately through computational methods, resolving the conflict between stabilization and motion blur.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the image processing into distinct phases: capture with short shutter time for stabilization, then separate post-processing for motion blur application. This segmentation allows each function to be optimized independently, maintaining stabilization while adding the desired motion blur effect without compromise.

Inventive Principle:
Principle #1Segmentation

3Stability of the object's composition

If short shutter times are used for stabilization, then stabilization quality is improved, but motion blur effect is reduced

Engineering Contradiction:
Improvestabilization qualityVSAvoidmotion blur effect
Core Design Contradiction:
Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

The patent performs preliminary stabilization during capture using short shutter times, then compensates for the reduced motion blur effect by adding it as a post-processing step. This preliminary action ensures stabilization quality is maintained while the motion blur effect is restored through computational techniques.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent substitutes the mechanical in-camera motion blur with a digital post-processing system. This substitution allows short shutter times to be used for stabilization while the motion blur effect is replicated through computational algorithms, achieving both stabilization quality and motion blur effect.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Manufacturing precision

If motion is added to images in post-processing, then motion blur effect is improved, but motion judder is caused

Engineering Contradiction:
Improvemotion blur effectVSAvoidmotion judder
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent uses feedback from motion vector analysis and frame comparison to adjust the motion blur application dynamically. This feedback mechanism allows the system to compensate for motion judder by adapting the blur parameters based on actual motion detection, smoothing out artifacts while maintaining the desired motion blur effect.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes the parameters of motion blur application based on analyzed motion characteristics. By adjusting blur intensity, direction, and timing parameters according to detected motion patterns, the system reduces motion judder while maintaining natural motion blur effects.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11769231B2Methods and apparatus for applying motion blur to overcaptured content
Publication Date: 2023.09.26 GOPRO INC
  • US11769231B2 patent drawing
  • US11769231B2 patent drawing
  • US11769231B2 patent drawing

AI summary

Apparatus and methods for applying motion blur to overcapture content. In one embodiment, the motion blur is applied by selecting a number of frames of the captured image content for application of motion blur; selecting a plurality of pixel locations within the number of frames of the captured image content for the application of motion blur; applying motion blur to the captured image content in accordance with the selected number of frames and the selected plurality of pixel locations; and outputting the captured image content with the applied motion blur. In some implementations, motion blur is applied via implementation of a virtualized neutral density filter. Computerized devices and computer-readable apparatus for the application of motion blur are also disclosed.