Multishot Tilt OIS for Shallow Depth of Field

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Typical mobile phone cameras with small lenses and image sensors have limited depth of field range, making it difficult to create natural bokeh effects or other depth of field effects, as tilt-based optical image stabilization (OIS) can only achieve a shallow depth of field effect on one axis, which is not suitable for images requiring parts to be both in and out of focus.

Innovation Solution

The method involves capturing multiple image frames with different tilt and focus properties and combining them using predetermined heuristics or algorithms to generate composite images with desired depth of field effects, such as bokeh effects, by adjusting the tilt axis and focus between shots and using autofocus to optimize focus positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If tilt OIS technology is used to create depth of field effects, then focus control is improved, but the depth of field shape becomes wedge shaped and limited to one axis

Engineering Contradiction:
Improvefocus controlVSAvoiddepth of field shape flexibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent divides the depth of field effect creation into multiple independent image frames captured at different tilt angles. Each frame contributes a portion of the final composite image, allowing the system to overcome the wedge-shaped limitation of single-axis tilt OIS by synthesizing a circular or customized depth of field shape from multiple segmented views.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from single-axis tilt control to multi-axis depth of field control by capturing images at multiple tilt angles around different axes. This dimensional expansion allows the system to create depth of field effects in multiple directions simultaneously, transforming the limited one-axis wedge shape into a versatile multi-directional or circular bokeh effect.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Manufacturing precision

If multiple image frames are captured and combined to create desired depth of field effects, then depth of field effect quality is improved, but device complexity increases

Engineering Contradiction:
Improvedepth of field effect qualityVSAvoidmulti-frame capture and processing
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent implements automated algorithms that independently analyze captured image frames, identify in-focus and out-of-focus regions, and composite them into the final image with desired depth of field effects. The system performs self-service by automatically determining optimal focus positions and combining frames without requiring complex manual intervention, thereby managing device complexity through intelligent automation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent systematically varies tilt angle and focus position parameters across multiple captured frames according to a predetermined pattern. By controlling these parameters in a structured sequence, the system achieves high-quality depth of field effects while managing complexity through algorithmic parameter management rather than requiring complex hardware modifications.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for the creation of images with desired depth of field effects, where parts of the image can be in focus while others are intentionally out of focus, enhancing aesthetic qualities by overcoming the limitations of small camera lenses and sensors.

Implementation Method 1

Optical image stabilization (OIS) is a useful technology for providing improved image quality when images are taken by a camera that is shaking or otherwise not stationary

Methodology Applied
Scientific EffectOptical image stabilization:

Implementation Method 2

Auto-focus (AF) technologies can also be used in conjunction with tilt OIS to provide images with better focus properties

Methodology Applied
Scientific EffectAutofocus:

Implementation Method 3

Sometimes it is desirable to capture images where part of the image is in focus and another part of the image is intentionally out of focus. This can be referred to as a 'depth of field effect.' Some depth of field effects are known as 'bokeh effects.'

Methodology Applied
Scientific EffectDepth of field: Depth of Field

Implementation Method 4

This is known as the Scheimpflug principle. A typical use of this principle, e.g., in landscape photography, is to tilt the lens sufficiently to keep both near and far in focus with a single image.

Methodology Applied
Scientific EffectOptical distortion:

Data Source

PatentUS10104292B2Multishot tilt optical image stabilization for shallow depth of field
Publication Date: 2018.10.16 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10104292B2 patent drawing
  • US10104292B2 patent drawing
  • US10104292B2 patent drawing

AI summary

Described herein are methods for creating images with depth of field effects from plural image frames each having different tilt and/or focus properties. Exemplary methods comprise capturing plural image frames and adjusting the tilt axis of the camera and/or focus of the camera in between each shot. The plural image frames can then be combined to create desired depth of field effects, such as bokeh effects. One exemplary method comprises capturing a first image frame of a scene with a primary subject in focus, capturing at least a second image frame of the scene at a different tilt axis and with suitable alternative focus, and combining pixels from at least the first and second image frames based on a predetermined heuristic or algorithm to generate a resultant composite image with the desired depth of field effect (such as with a primary subject in focus and the background out of focus).