Image Processing Apparatus for Photographer Panoramic Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for generating panoramic images that include a photographer are inconvenient and result in multiple human figures of the same person appearing in the final image, as they require fixation devices or rotation of the camera with the photographer as a subject.

Innovation Solution

An image processing apparatus that determines an alignment coefficient between images, extracts and stores foreground and background images, and generates a background combined image by using the alignment coefficient to selectively combine foreground and background images, allowing for the generation of panoramic images without multiple human figures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a photographer holds an image capturing apparatus and captures images while panning with the apparatus directed toward the photographer, then a panoramic image including the photographer can be generated, but multiple human figures of the same photographer appear in the panoramic image

Engineering Contradiction:
Improveability to capture photographer in panoramic imageVSAvoidaccuracy of human figure representation
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The panoramic image is divided into multiple individual images captured at different angles. Each image is processed separately to extract the foreground (photographer) and background components. This segmentation allows selective combination of background elements from multiple images while maintaining a single foreground figure, resolving the contradiction between capturing the photographer and avoiding multiple figures.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The foreground (photographer) is extracted from each captured image using image processing techniques. By separating the foreground from the background in each individual image, the system can selectively combine only the background elements from multiple images while keeping the foreground intact, thus preventing multiple human figures from appearing in the final panoramic image.

Inventive Principle:
Principle #2Taking out (Extraction)

2Adaptability or versatility

If a fixation device such as a tripod is used to rotate the image capturing apparatus, then a panoramic image including the photographer can be generated, but the method becomes inconvenient and requires additional equipment

Engineering Contradiction:
Improveability to capture photographer in panoramic imageVSAvoidconvenience of panoramic image capture
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system uses the photographer's own movement and the camera's built-in imaging capabilities to capture panoramic images including themselves. By processing multiple images captured during natural panning motion and selectively combining background elements, the system eliminates the need for tripods or other fixation devices, making the process convenient and self-sufficient.

Inventive Principle:
Principle #25Self-service

3Area of stationary object

If multiple images are combined to generate a panoramic image, then a wider field of view is achieved, but the alignment and integration of foreground and background elements becomes complex

Engineering Contradiction:
Improvefield of view of panoramic imageVSAvoidcomplexity of image combination process
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The system performs preliminary processing on each captured image before combination, including extracting the foreground (photographer) and background components, and calculating alignment coefficients. This preliminary segmentation and pre-processing simplifies the subsequent combination process, making it easier to integrate multiple images into a coherent panoramic image with proper alignment of foreground and background elements.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10694104B2Image processing apparatus, image capturing apparatus, and image processing method
Publication Date: 2020.06.23 CANON KK
  • US10694104B2 patent drawing
  • US10694104B2 patent drawing
  • US10694104B2 patent drawing

AI summary

An image processing apparatus cuts out a plurality of background images and foreground images from a plurality of images, and stores a plurality of cutout foreground images and an alignment coefficient calculated from an image prior to cutout of each foreground image, the plurality of foreground images being stored in association with the alignment coefficient. Moreover, the image processing apparatus generates a background combined image by combining cutout background images, and selects any of the stored foreground images based on designation of a position in the background combined image. Then, image processing apparatus determines an alignment coefficient of the selected foreground image by using the alignment coefficient associated with the selected foreground image, and combines the selected foreground image and the background combined image.