Panoramic Image Stitching Guide for Camera Rotation Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing devices lack a notification function to guide users in capturing images for generating high-quality panoramic images, particularly when capturing selfies, leading to issues like parallax, misalignment, and distortion due to camera shifting, resulting in unsatisfactory image quality.

Innovation Solution

An image processing device with a display and guide control unit that displays a guide on the screen to indicate the direction and degree of camera rotation, using a motion sensor to detect and adjust the guide accordingly, ensuring proper alignment and rotation for capturing images from different angles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a user captures images while shifting the camera in parallel movement, then the operation is simple and easy to perform, but parallax occurs causing misalignment and distortion in the panoramic image

Engineering Contradiction:
Improveease of camera operationVSAvoidimage alignment precision
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system provides real-time visual feedback by displaying a guide image that shows the user's current camera position and movement. The guide image updates dynamically to indicate whether the user is moving the camera in the correct rotational direction, allowing the user to adjust their movement to achieve proper alignment without parallax distortion.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

A guide image serves as an intermediary between the user's camera movement and the final panoramic image quality. This guide image acts as a mediator that translates complex alignment requirements into simple visual cues, guiding the user to rotate rather than shift the camera.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If the system provides real-time guidance to users, then image alignment precision improves, but device complexity increases due to additional display and control functions

Engineering Contradiction:
Improveimage alignment precisionVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The display device serves multiple functions: it shows the live camera feed, displays the guide image for alignment assistance, and provides visual feedback during the panoramic capture process. By making the display multi-functional, the system avoids adding separate dedicated devices while still providing comprehensive guidance to improve alignment precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If the guide image is updated in real-time based on camera movement, then guidance accuracy improves, but processing speed and energy consumption increase

Engineering Contradiction:
Improveguide accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system updates the guide image at a frequency sufficient to provide accurate real-time feedback, but not at the maximum possible rate. This partial action approach provides enough guidance accuracy to help users maintain proper alignment while avoiding the excessive energy consumption that would result from continuous high-frequency updates.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution helps users capture images correctly, reducing parallax and distortion, and ensuring high-quality panoramic images by providing real-time guidance on camera movement, thereby improving the quality of generated panoramic images.

Implementation Method 1

using a motion sensor to detect and adjust the guide accordingly

Methodology Applied
Scientific EffectMotion detection: Accelerometer

Data Source

PatentUS10713828B2Image processing device, image processing method, non-transitory computer readable recording medium and photographing assist equipment
Publication Date: 2020.07.14 MORPHO INC
  • US10713828B2 patent drawing
  • US10713828B2 patent drawing
  • US10713828B2 patent drawing

AI summary

An image processing device for stitching a plurality of input images together so as to generate a panoramic composite image is provided. An imaging control section sets a guide for photographing a photographing subject from different imaging directions as a guide information for obtaining a plurality of input images suitable for the image composition. A guide display setting section displays a photographing guide image based on the guide information. A user rotates a camera while checking the guide image and captures the plurality of input images from different imaging directions. An image compositing section stitches the plurality of input images together so as to generate a composite image.