Camera Image Composition with Real-Time Region Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional digital cameras require separate processes for photographing and image processing, which are time and space-separated, leading to a tedious and unenjoyable experience for users, especially when creating composite images, as users must manually designate and cut out regions in photo-retouching software.

Innovation Solution

An image processing apparatus with an imager, image display, imaging guide, operating mechanism, extracting mechanism, still image storage, composing mechanism, and deforming mechanism that allows real-time photographing and displaying of images, enabling easy composition and deformation of region images to create composite images directly on the device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If photographing and image processing are separated into different devices and time, then image processing can be performed with professional software, but the process becomes tedious and time-consuming

Engineering Contradiction:
Improveimage processing capabilityVSAvoidoperational convenience
Core Design Contradiction:
Ease of manufactureVSEase of operation

Solution Approach 1:

The patent combines the photographing function and image processing function into a single integrated camera device. The camera includes an imaging unit for capturing images and an image processing unit for automatically processing those images, eliminating the need to transfer images to a separate PC and use professional software. This integration directly resolves the contradiction by making the process both manufacturable (with embedded processing capabilities) and operationally convenient (all-in-one device).

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The camera performs image processing automatically without requiring user intervention to transfer images or manually designate regions. The image processing unit autonomously processes captured images, creating composite images by automatically extracting and combining regions from multiple photographs. This self-service capability eliminates the tedious manual operations required in prior art while maintaining professional processing quality.

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If manual region selection is required in photo-retouching software, then precise control is achieved, but the process becomes tedious and unenjoyable

Engineering Contradiction:
Improveregion selection precisionVSAvoidoperational simplicity
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent performs preliminary image capture and processing actions automatically before the user needs to view or edit the final composite image. The camera captures multiple images, automatically identifies relevant regions (such as faces or objects), and pre-processes them into composite images without requiring the user to manually select regions. This preliminary automated action maintains precision while eliminating tedious manual selection operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical manual operation of using a mouse to select regions with an automated image processing system. Instead of requiring users to mechanically click and drag to define regions, the system uses computer vision and image processing algorithms to automatically identify and extract regions. This substitution maintains the precision of region selection while completely eliminating the tedious manual operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If image processing is performed after photographing on a PC, then comprehensive processing options are available, but time separation causes loss of interest

Engineering Contradiction:
Improveprocessing optionsVSAvoidtime delay
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs image processing actions immediately during or right after the photographing process, eliminating time delay. The image processing unit is integrated into the camera and processes images as they are captured, allowing the user to view composite images instantly without waiting to transfer data to a PC. This preliminary processing action maintains comprehensive processing options while eliminating time separation and the resulting loss of interest.

Inventive Principle:
Principle #10Preliminary action

4Adaptability or versatility

If multiple images are captured and processed to create composite images, then creative flexibility is achieved, but the complexity of the process increases

Engineering Contradiction:
Improvecreative flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges multiple functions (image capture, region extraction, image composition, and display) into a single integrated camera device. This consolidation achieves creative flexibility for creating composite images while managing system complexity by integrating rather than multiplying separate components. The image processing unit handles all composite image operations internally, presenting a unified interface to the user.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS7529428B2Image processing apparatus and storage medium storing image processing program
Publication Date: 2009.05.05 NINTENDO CO LTD
  • US7529428B2 patent drawing
  • US7529428B2 patent drawing
  • US7529428B2 patent drawing

AI summary

An image processing apparatus includes a CPU and an imaging unit. In this image processing apparatus, an image captured by the imaging unit is displayed on an LCD together with an imaging index, indicative of a predetermined region of a face. In response to a shutter operation by an operator, a portion, matching with a position of the imaging index, is extracted from the image data as a region image. Furthermore, in response to a shutter operation, another image captured by the imaging unit is stored as a still image. Then the region image and the still image are composed with each other to display a composite image, obtained by pasting the image of the predetermined region of the face on to another image. In addition, with respect to the composite image, the region image is deformed according to a feature of the data from the imaging unit, an elapsed time without an operation input, and so on.