Telephoto Image Composition Using Wide Dynamic Range Angle Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging technologies face challenges in composing telephoto images with small overlapping regions and achieving high accuracy and detail, especially when capturing wide dynamic range images, as they require numerous images and expensive sensors or compromise on image quality.

Innovation Solution

An imaging apparatus with a wide angle and telephoto optical system sharing a common optical axis, a directional sensor with two-dimensional photoelectric conversion elements, and a system for generating wide dynamic range images, allowing for accurate composition of telephoto images using composition information from wide dynamic range wide angle images, even with minimal overlapping regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If telephoto images are composited using traditional methods requiring numerous overlapping images, then composition accuracy can be achieved, but capture time increases and device complexity increases

Engineering Contradiction:
Improvecomposition accuracyVSAvoidcapture time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent introduces wide angle images as an intermediary to bridge the composition of telephoto images. Instead of directly composing telephoto images that have small overlapping regions, the system uses wide angle images with larger overlapping regions to establish composition information, which then guides the telephoto image composition. This intermediary approach enables accurate composition without requiring numerous telephoto images to overlap.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the imaging process into two distinct stages: first capturing both wide angle and telephoto images, then using the wide angle images to acquire composition information that guides the telephoto image composition. This segmentation allows the system to leverage the advantages of wide angle imaging (larger overlap, easier feature matching) to improve telephoto image composition efficiency.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If telephoto images are composited using traditional methods, then composition accuracy can be achieved, but the number of images required increases

Engineering Contradiction:
Improvecomposition accuracyVSAvoidnumber of images
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent introduces wide angle images as an intermediary to bridge the composition of telephoto images. Instead of directly composing telephoto images that have small overlapping regions, the system uses wide angle images with larger overlapping regions to establish composition information, which then guides the telephoto image composition. This intermediary approach enables accurate composition without requiring numerous telephoto images to overlap.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Illumination intensity

If dynamic range enlargement processing is applied to wide angle images, then dynamic range is improved, but processing complexity increases

Engineering Contradiction:
Improvedynamic rangeVSAvoidprocessing complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent applies dynamic range enlargement processing to wide angle images as a preliminary action before composition. By enhancing the dynamic range of wide angle images in advance, the system improves the quality of composition information extraction. This preliminary processing ensures that subsequent composition operations benefit from high dynamic range data without requiring complex real-time processing during the composition stage.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables efficient composition of telephoto images with reduced capture times and high resolution, independent of light intensity variations, by analyzing wide dynamic range wide angle images to acquire precise composition information.

Implementation Method 1

a directional sensor that includes a plurality of pixels configured with photoelectric conversion elements arranged in two dimensions, the directional sensor including the plurality of pixels selectively receiving luminous flux incident through each of the wide angle optical system and the telephoto optical system by pupil separation

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS11122215B2Imaging apparatus, unmanned moving object, imaging method, system, and program
Publication Date: 2021.09.14 FUJIFILM CORP
  • US11122215B2 patent drawing
  • US11122215B2 patent drawing
  • US11122215B2 patent drawing

AI summary

An imaging apparatus, an unmanned moving object, an imaging method, a system, and a program capable of favorably compositing a telephoto image group even in a case where an overlapping region between images of the telephoto image group is small, and accurately compositing a telephoto image regardless of a subject (scene) of a wide angle image are provided. An imaging apparatus (100) includes an imaging optical system, a directional sensor, a wide dynamic range image generation part (302) that generates a wide dynamic range wide angle image obtained by enlarging a dynamic range of a wide angle image, an image acquisition part (2a) that acquires a wide dynamic range wide angle image group and a telephoto image group configured with a telephoto image, a composition information acquisition part (2b) that acquires composition information to be used for compositing the telephoto image group by analyzing the acquired wide dynamic range wide angle image group, and a composite image generation part (2c) that generates an image in which the telephoto image group is composited, based on the composition information, information related to focal lengths of the wide angle optical system and the telephoto optical system, and the telephoto image group.