AR Object Display Color Correction via Multi-Region Feature Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional AR techniques fail to accurately reflect the features of real space images, leading to a sense of incongruity when objects are overlaid, as they rely on a single marker's color tone for correction, which may not represent the image's overall features.

Innovation Solution

An object display device and method that captures images, extracts features from multiple regions or the entire image, performs correction processing based on these features, and overlays the corrected object image to reduce incongruity, using image feature extraction and processing units to adjust color tones and noise distribution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If color tone correction is performed based on a single marker's color tone, then the correction process is simple, but the corrected object image does not accurately reflect the overall feature of the real space image, causing a sense of incongruity

Engineering Contradiction:
Improvesimplicity of correction processVSAvoidaccuracy of color tone representation
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The real space image is divided into multiple regions (first region and second region) with different characteristics. The first region contains the marker and is processed with one correction method, while the second region is processed with another correction method, allowing each region to be corrected according to its specific characteristics rather than applying a single uniform correction to the entire image

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different correction processing is applied to different regions of the image. The first region (containing the marker) receives correction based on the marker's color tone, while the second region receives correction based on its own color tone characteristics. This local differentiation ensures that each region is corrected appropriately for its specific context, improving overall accuracy

Inventive Principle:
Principle #3Local quality

2Measurement precision

If feature extraction is performed from multiple regions or entire image, then the accuracy of reflecting real space features is improved, but the processing complexity increases

Engineering Contradiction:
Improveaccuracy of feature representationVSAvoidcomplexity of image processing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The image processing is segmented into distinct regions (first region and second region) that can be processed independently. This segmentation allows the system to focus computational resources on extracting features from specific regions rather than processing the entire image uniformly, making the complex task of multi-region analysis more manageable and efficient

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention extracts and isolates specific features from different regions of the image separately. By taking out the color tone information from the first region and second region independently, the system can process and analyze each region's characteristics without being overwhelmed by the complexity of the entire image, then combine these extracted features for comprehensive correction

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9305399B2Apparatus and method for displaying objects
Publication Date: 2016.04.05 NTT DOCOMO INC
  • US9305399B2 patent drawing
  • US9305399B2 patent drawing
  • US9305399B2 patent drawing

AI summary

An object display device includes an image capturing unit for acquiring an image in real space, an image feature extraction unit for extracting a predetermined feature about an image either in a plurality of feature regions detected from the image in real space or in the entire image in real space, an image processing unit for performing correction processing on an image of an object based on the predetermined feature about the image, and a display unit for displaying an overlaid image in which the image of the object subjected to correction processing is overlaid on the image in real space. With this configuration, the feature of the image in real space is appropriately reflected in the image of the object in the overlaid image.