Image Processing Apparatus Dual Camera Composition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging apparatuses with two cameras struggle to effectively display images captured by the main camera alone and require burdensome user instructions for switching between image composition modes, distracting the photographer.

Innovation Solution

An image processing apparatus with a first imaging unit capturing the user's direction, a second imaging unit capturing a different direction, and additional information generation and processing units that compress and embed information from the first image into the second image's data, allowing for enhanced display control and convenience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If image composition is performed by combining images from both cameras, then the utility of the sub-camera is utilized, but the main camera's captured images cannot be displayed separately

Engineering Contradiction:
Improveimage display flexibilityVSAvoidimage processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the image data processing into two independent paths: one for the main camera images that preserves them in original format for separate display, and another for the sub-camera images that generates additional information for composition. This allows the system to maintain both composition capability and standalone main camera display capability without forcing all images through composition processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by selectively processing only the necessary portions of image data. The main camera images are kept in their original state without additional processing, while only the sub-camera images undergo additional information generation. This partial processing approach enables flexible display options without the overhead of processing all images equally.

Inventive Principle:
Principle #16Partial or excessive action

2Ease of operation

If image composition mode switching is controlled by user instructions during capture, then display mode can be changed, but the photographer cannot concentrate on capturing images

Engineering Contradiction:
Improvedisplay mode controlVSAvoidphotographer concentration time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent implements preliminary action by pre-processing the sub-camera images to generate additional information (such as depth maps, edge detection, or segmentation data) at the time of capture, regardless of the final display mode selected. This preliminary processing enables flexible post-capture display options without requiring real-time user decisions during the critical capture moment, allowing photographers to focus on composition and timing.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If the sub-camera image is combined with the main camera image, then image composition is achieved, but the main camera image cannot be displayed alone effectively

Engineering Contradiction:
Improveimage composition efficiencyVSAvoidmain camera image independence
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent introduces an intermediary data structure that stores additional information generated from sub-camera images separately from the main camera images. This intermediary representation (such as metadata, depth maps, or segmentation masks) can be selectively applied to main camera images during composition without permanently altering or combining the original main camera image data, thus preserving the ability to display main camera images independently while enabling composition when desired.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9727993B2Image processing apparatus, image processing method, and program
Publication Date: 2017.08.08 SONY GROUP CORP
  • US9727993B2 patent drawing
  • US9727993B2 patent drawing
  • US9727993B2 patent drawing

AI summary

An in-image capturing unit captures an image of a subject in a direction facing a front surface of an image processing apparatus, as an in-image, and an out-image capturing unit captures an image of a subject in a direction facing a back surface of the image processing apparatus, as an out-image. A signal processing unit obtains a binary image as additional information, the binary image being obtained by binarizing the in-image, for example, and adds the additional information to image data of the out-image. Additionally, the signal processing unit combines the binary image serving as the additional information with the out-image when the out-image is reproduced, and displays the resultant image. In such a manner, information obtained from the in-image is added to the out-image as additional information, and thus it is possible to more effectively display an image and improve convenience.