Panoramic Image Generation Using End Deformation for Natural 360-Degree Overlap

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing panoramic image generation methods distort the entirety of 360-degree panoramic image data to correct deviations at the starting and terminal ends, resulting in unnatural images due to size and posture mismatches between subjects at these ends.

Innovation Solution

A method that combines and deforms the starting and terminal ends of panoramic image data to match size and posture, then overlaps them to generate a natural 360-degree panoramic image, using a panoramic image generation unit within an image capturing apparatus.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the entirety of 360-degree panoramic image data is distorted to correct deviation at the starting end and terminal end, then the deviation is corrected, but the image becomes unnatural due to distortion

Engineering Contradiction:
Improvedeviation correction precisionVSAvoidimage naturalness
Core Design Contradiction:
Manufacturing precisionVSShape

Solution Approach 1:

The patent segments the panoramic image data into multiple regions: a first region containing the starting end, a second region containing the terminal end, and a third region between them. Different processing methods are applied to each region - the first and second regions undergo deformation processing to correct deviations, while the third region maintains its original state to preserve natural appearance. This segmentation allows selective correction without global distortion.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by performing deformation processing only on specific regions (first and second regions at the ends) rather than the entire panoramic image. The deformation parameters are locally adjusted based on the deviation amounts detected at the starting and terminal ends, allowing precise correction where needed while preserving the natural appearance of the intermediate regions.

Inventive Principle:
Principle #3Local quality

2Area of stationary object

If photographing is performed by rotating the camera 360 degrees while holding it by hand, then 360-degree panoramic coverage is achieved, but deviation in size and posture of subjects occurs between starting end and terminal end

Engineering Contradiction:
Improvepanoramic coverage areaVSAvoidsubject size and posture consistency
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent employs feedback mechanisms by detecting the deviation amounts of subjects between the starting end and terminal end of the panoramic image. Based on this detected deviation information, the system calculates appropriate deformation parameters and applies corrective deformation to the first and second regions, creating a closed-loop correction process that ensures subject consistency.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes the deformation parameters of the first and second regions based on the detected deviation amounts. By adjusting these parameters dynamically according to the actual deviation observed, the system can compensate for variations in camera position and posture that occur during manual 360-degree rotation, thereby maintaining subject size and posture consistency.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If the starting end and terminal end of panoramic image data are overlapped without correction, then the panoramic image is generated, but unnatural overlapping occurs due to size and position mismatches

Engineering Contradiction:
Improvepanoramic image generation speedVSAvoidoverlapping naturalness
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent performs preliminary deformation processing on the first and second regions before overlapping them. By pre-correcting the deviation amounts through deformation in advance of the overlapping operation, the system ensures that when the starting and terminal ends are overlapped, the subjects align properly in terms of size, posture, and position, preventing unnatural artifacts.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9973691B2Panoramic image generation method and image capturing apparatus
Publication Date: 2018.05.15 FUJIFILM CORP
  • US9973691B2 patent drawing
  • US9973691B2 patent drawing
  • US9973691B2 patent drawing

AI summary

A panoramic image generation unit 19 which generates a surrounding 360-degree panoramic image data centering around a photographing point using a plurality of photographed image data performs a step of combining the plurality of the photographed image data to generate a surrounding 360-degree or more panoramic image data centering around the photographing point, a step of deforming any one of common subjects of a starting end and a terminal end with respect to the common subject included in each of the starting end and the terminal end of the 360-degree or more panoramic image data, to match sizes and postures of the common subject, and a step of overlapping the common subjects included in the starting end and the terminal end with each other to generate the 360-degree panoramic image data.