3D Color Space Object Extraction for Mixed Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality technologies face challenges in accurately extracting a specific object area from a captured image, particularly when the object and background colors are similar, leading to erroneous detections and requiring extensive user adjustment, which is time-consuming and labor-intensive.
Innovation Solution
An image processing apparatus that acquires and expands color information in a three-dimensional color space to accurately extract the object area by distinguishing between object and background colors, reducing the need for extensive user input and minimizing erroneous detections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If color information is previously registered to separate object and background, then object extraction is enabled, but extraction accuracy deteriorates when object and background colors are similar or when white/black areas are present
Solution Approach 1:
The patent transforms the color separation problem from a simple 2D color space comparison into a 3D color space analysis by introducing luminance (brightness) as an additional dimension. This allows the system to distinguish objects from backgrounds even when their chromatic colors are similar, by utilizing differences in their luminance values. The 3D color space comprises chromaticity coordinates (u, v) and luminance (y), enabling more robust object extraction.
Solution Approach 2:
The patent changes the parameter space for color comparison by expanding from 2D chromaticity coordinates to 3D color space parameters including luminance. This parameter expansion allows the system to handle cases where traditional color-based separation fails, such as when objects and backgrounds have similar hues but different brightness levels, or when dealing with achromatic regions.
2Measurement precision
If user adjusts color information to eliminate undetected and erroneously-detected areas, then extraction accuracy improves, but adjustment time increases significantly
Solution Approach 1:
The patent implements self-service by enabling the system to automatically determine and adjust color information without requiring extensive manual user input. The automatic color determination unit can autonomously analyze the captured image, identify object and background regions, and set appropriate color ranges in the 3D color space, significantly reducing the time users need to spend on manual adjustment while maintaining high extraction accuracy.
Solution Approach 2:
The system performs preliminary action by pre-establishing the 3D color space framework and automatic color determination algorithms before actual object extraction is needed. This preliminary setup includes defining the color space parameters, luminance thresholds, and separation criteria in advance, so that when extraction is required, the system can quickly and accurately identify objects without requiring users to perform time-consuming manual adjustments.
Data Source
AI summary
An image processing apparatus includes an acquisition unit configured to acquire color information about an object and color information about a background in a first image captured by an image capturing apparatus, a storage unit configured to store the acquired color information about the object and the acquired color information about the background, an expansion unit configured to expand, in a three-dimensional color space, the color information about the object and the color information about the background stored in the storage unit, and an extraction unit configured to extract an area of the object from a second image captured by the image capturing apparatus, based on the respective pieces of the color information expanded by the expansion unit.