Image Composition Unit for Seamless Field of View Transitions

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing systems struggle to seamlessly handle changes in the field of view during video recording, leading to abrupt transitions and discomfort for the user when panning or tilting the camera, as they fail to smoothly integrate overlapping image regions and update the display accordingly.

Innovation Solution

An image processing device that determines changes in the field of view by using movement detection units and generates composite image data by superimposing overlapping areas of images along the direction of change, while updating the display with a seamless transition by combining latest and last image data when no change is detected.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the imaging device pans or tilts during recording, then the field of view changes to capture different areas, but abrupt transitions and visual discomfort occur for the user

Engineering Contradiction:

Improvefield of view change capabilityVSAvoidvisual discomfort

Core Design Contradiction:

Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary actions by detecting field of view changes in advance and preparing composite image data through superimposition before the actual display update occurs. This allows smooth transitions by pre-processing the image data to eliminate abrupt changes that would cause visual discomfort.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent merges multiple image data pieces by superimposing overlapping areas to create composite image data. This combining approach allows seamless transitions when the field of view changes, as the composite image smoothly integrates the transition area with the new field of view, eliminating abrupt visual shifts.

Inventive Principle:

Principle #5Merging (Combining)

2Loss of information

If multiple images are continuously captured during panning, then comprehensive coverage of the moving field of view is achieved, but processing complexity increases to seamlessly integrate overlapping regions

Engineering Contradiction:

Improvefield of view coverageVSAvoidimage processing complexity

Core Design Contradiction:

Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the image processing task by identifying and processing overlapping areas separately from non-overlapping areas. By dividing the composite image data generation into distinct regions (transition area and new field of view area), the system manages processing complexity while ensuring complete coverage of the moving field of view.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system combines multiple captured images by superimposing their overlapping regions to create unified composite image data. This merging process integrates information from multiple images comprehensively while managing processing complexity through systematic combination of corresponding pixel data from different image pieces.

Inventive Principle:

Principle #5Merging (Combining)

3Speed

If the display is updated with each new image, then the latest field of view information is provided, but abrupt transitions occur that reduce user comfort

Engineering Contradiction:

Improvedisplay update speedVSAvoidabrupt transitions

Core Design Contradiction:

SpeedVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary processing by generating composite image data that pre-integrates the transition area with the new field of view before updating the display. This preliminary composition ensures that when the display is updated at high speed, the transitions appear smooth rather than abrupt, maintaining both update speed and user comfort.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The composite image data acts as an intermediary between the captured images and the display output. By introducing this intermediate processing step that superimposes overlapping areas, the system mediates between rapid display updates and smooth visual transitions, eliminating abrupt changes while maintaining update speed.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS9137459B2Image processing device, display device, image processing method, and computer-readable recording medium for generating composite image data

Publication Date: 2015.09.15 OLYMPUS CORPORATION(JP)

AI summary

An image processing device includes: a determination unit that determines, based on a plurality of pieces of image data which is generated by continuously taking images of an area of field of view and input from an imaging unit provided outside the image processing device, whether the area of field of view of the imaging unit has been changed; an image composition unit that superimposes overlapping areas of imaging regions of a plurality of images corresponding to the plurality of pieces of image data along a direction in which the area of field of view of the imaging unit has been changed, to generate composite image data when the area of field of view of the imaging unit has been changed; and a display control unit that causes a display unit provided outside the imaging processing device to display a composite image corresponding to the generated composite image data.