Metadata Registration Across Viewpoints Using Local Feature Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to allow arbitrary metadata to be attached to arbitrary positions within user-photographed images and do not enable sharing of metadata between users, as different users' images of the same object have varying coordinates, making it difficult to restore metadata accurately across different viewpoints.

Innovation Solution

An apparatus that includes a first acquisition unit for acquiring images and metadata, an extraction unit for extracting local features, a calculation unit for determining a representative point, a search unit for matching images with a database, and a registration unit for registering metadata at corresponding positions, allowing metadata to be shared and displayed accurately across different user images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If metadata is attached to arbitrary positions in user-photographed images, then metadata can be displayed at desired locations, but metadata cannot be shared accurately between users because different users' images of the same object have varying coordinates

Engineering Contradiction:
Improvemetadata attachment flexibilityVSAvoidmetadata position accuracy across images
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces a database of reference images as an intermediary. When a user attaches metadata to a local position in their photographed image, the system uses the reference image database to find corresponding regions and transfer the metadata to the appropriate position in other users' images. This intermediary mechanism enables accurate metadata sharing across different viewpoints without requiring direct coordinate alignment between users' images.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the parameter of metadata position from absolute coordinates in the original image to relative positions based on reference images. By using the reference image database to determine corresponding positions, the system transforms metadata attachment from fixed coordinate-based to reference-based positioning, enabling accurate reproduction across different image captures of the same object.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If existing systems store metadata with image coordinates, then metadata can be attached to specific locations, but the metadata cannot be restored on photographed images taken from different positions

Engineering Contradiction:
Improvemetadata position precisionVSAvoidcross-viewpoint metadata compatibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The reference image database serves multiple functions: it stores reference images of objects, provides position mapping information, and enables metadata transfer across different viewpoints. This universal reference system allows the same metadata attachment mechanism to work for images taken from any position, making the system adaptable to various imaging scenarios while maintaining position precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9076069B2Registering metadata apparatus
Publication Date: 2015.07.07 TOSHIBA DIGITAL SOLUTIONS CORP
  • US9076069B2 patent drawing
  • US9076069B2 patent drawing
  • US9076069B2 patent drawing

AI summary

An adding metadata apparatus includes a first acquisition unit which acquires a first image, first metadata, and a first position within the first image, the first position being for displaying the first metadata; an extraction unit which extracts local features from the first image; a calculation unit which searches for a group of the local features within a predetermined distance from the first position, and calculates a representative point of the group; a search unit which matches the first image with a plurality of images stored in a database by using the local features, and searches for a second image which coincides with the local features; and a registration unit which calculates a second position, within the second image, corresponding to the representative point, and registers the second position and the first metadata as metadata for the second image.