Feature Point Matching for Dynamic Image Superimposition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies do not effectively allow users to reflect user inputs on images other than the original image used for input, limiting the ability to create dynamic and interactive visual experiences.

Innovation Solution

An image processing program that functions as first image acquisition, feature point extraction, image superimposition, and display control means, enabling the superimposition of images based on feature points between different images, allowing user inputs to be reflected on various images, including moving images and real-time captured content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If image processing is performed such that the user directly puts makeup on a still image captured by the device, then the user can enjoy viewing the made-up still image, but the image that can be enjoyed by the user is only the made-up still image which is temporary

Engineering Contradiction:
Improveuser operation simplicityVSAvoidimage application scope
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent enables user inputs made on one image to be applied to multiple different images including moving images, still images, and images from different time points. This multi-functionality allows the same user input to enhance various types of images, transforming a single-purpose system into a versatile one that can create dynamic visual effects across different image formats and time periods.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent transitions from static image processing to dynamic image processing by allowing user inputs to be applied to moving images and different time-point images. This enables the system to handle time-varying images and create dynamic visual effects, where the superimposed image can be applied to sequences of frames rather than just a single static image.

Inventive Principle:
Principle #15Dynamics

2Device complexity

If user inputs are applied only to the original image used for input, then the processing is simple, but the ability to create dynamic and interactive visual experiences is limited

Engineering Contradiction:
Improveprocessing complexityVSAvoidvisual experience capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent introduces feature point matching as an intermediary mechanism that bridges the original image and target images. By extracting and matching feature points between images, the system can accurately transfer user inputs to different images while maintaining proper spatial alignment. This intermediary process enables complex visual experiences without requiring direct complex processing between all image pairs.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the image processing task into distinct components: feature point extraction, coordinate transformation, and image superimposition. This segmentation allows the system to handle the complexity of applying user inputs to multiple images by breaking down the process into manageable steps, where each component can be optimized independently.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If the system supports superimposition on multiple different images including moving images, then the visual experience is enhanced, but the processing complexity increases

Engineering Contradiction:
Improveimage type compatibilityVSAvoidprocessing system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal image processing framework that can handle multiple image types (moving images, still images, images from different time points) through a common feature point matching mechanism. This universal approach allows the same processing logic to be applied across different image formats, reducing the need for separate processing pipelines for each image type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent performs preliminary feature point extraction and coordinate system establishment before the actual superimposition operation. By pre-processing the images to extract feature points and establish coordinate transformations, the system simplifies the subsequent superimposition process. This preliminary action ensures that when user inputs need to be applied to different images, the complex coordinate transformations have already been prepared.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9101832B2Storage medium having stored thereon image processing program, image processing apparatus, image processing system, and image processing method
Publication Date: 2015.08.11 NINTENDO CO LTD
  • US9101832B2 patent drawing
  • US9101832B2 patent drawing
  • US9101832B2 patent drawing

AI summary

Data of a coordinate input provided on a second image displayed on a display device is acquired, and input position data representing the coordinate input provided on the second image is generated. At least a first feature point is extracted from a first image, the first feature point being a feature point having a first feature on the first image; a predetermined superimposition image is superimposed on the first image, at a position on the first image based on the first feature point, the position corresponding to a position, represented by the input position data, on the second image based on a second feature point, the second feature point being a feature point having the first feature on the second image; and the first image on which the superimposition has been made is displayed on the display device.