Camera Array Image Arrangement for Vertical Orientation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional display methods for camera arrays fail to accurately align the arrangement of captured images with the image capturing units, especially when the camera array is held vertically, leading to confusion about the correspondence between captured images and image capturing units.

Innovation Solution

An image processing device that determines the arrangement of each image in a display region based on the display angle and the arrangement of the image capturing units, rotating and re-arranging the images to match the orientation and layout of the camera array at the time of capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the display rotation technique is applied to rotate captured images about the image center, then the orientation of the camera at the time of image capturing agrees with the orientation of the displayed image, but the arrangement of captured images to be displayed does not change and therefore does not agree with the arrangement of image capturing units when the camera array is held vertically

Engineering Contradiction:
Improveorientation agreementVSAvoidcorrespondence relationship
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent divides the image processing into two independent operations: (1) rotating each captured image about its image center to achieve proper orientation, and (2) re-arranging the displayed images according to the arrangement of image capturing units. This segmentation allows each operation to be optimized independently, resolving the contradiction between orientation agreement and correspondence relationship.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic re-arrangement of displayed images based on the display angle and the arrangement of image capturing units. When the camera array is held vertically, the displayed images are re-arranged to reflect the vertical arrangement of capturing units, making the correspondence relationship intuitive while maintaining the orientation correction benefit.

Inventive Principle:
Principle #15Dynamics

2Device complexity

If the arrangement of captured images to be displayed remains fixed regardless of camera orientation, then the display process is simple, but it becomes difficult to grasp the correspondence relationship between image capturing units and captured images when the camera array is held vertically

Engineering Contradiction:
Improvedisplay processVSAvoidcorrespondence grasping
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent makes the image arrangement dynamic by detecting the display angle and automatically re-arranging captured images to match the arrangement of image capturing units at that angle. This dynamic adaptation maintains simplicity in the display process while improving the ease of grasping correspondence relationships through automatic adjustment based on camera orientation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system automatically determines the display angle and re-arranges images without requiring manual intervention from the user. The image processing device self-adjusts the arrangement based on the detected camera orientation, making the correspondence relationship intuitive while keeping the operation simple for the user.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9307150B2Image processing device, image processing method, and program for display angle determination
Publication Date: 2016.04.05 CANON KK
  • US9307150B2 patent drawing
  • US9307150B2 patent drawing
  • US9307150B2 patent drawing

AI summary

In a case of a camera array, the arrangement of image capturing units and the arrangement of captured images that are displayed do not agree with each other depending on the orientation of the camera at the time of image capturing and it is hard to grasp the correspondence relationship between both. An image processing device for processing a plurality of images represented by captured image data obtained by a camera array image capturing device including a plurality of image capturing units includes a determining unit configured to determine, on the basis of a display angle of the images in a display region, an arrangement of each image in the display region corresponding to each of the plurality of image capturing units, and the arrangement of each image in the display region is determined based on the arrangement of the plurality of image capturing units.