Parallel Contour Tracking for Mixed Reality Occlusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing contour tracking technologies are inefficient due to sequential processing, which prevents effective use of parallel calculation capabilities and can fail to accurately obtain true contours of complex shapes, leading to incorrect object recognition and occlusion expression in mixed reality systems.

Innovation Solution

An image processing apparatus and method that enables parallel processing by determining direction vectors for pixels in a boundary portion of a captured image, selecting adjacent pixels based on these vectors, and generating contour information, allowing for efficient contour tracking and accurate occlusion expression in mixed reality systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If sequential processing is used for contour tracking, then processing accuracy is maintained, but processing speed and efficiency deteriorate

Engineering Contradiction:
Improvecontour tracking accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent divides the image into multiple blocks and processes each block independently to obtain contour information. This segmentation allows parallel processing of different image regions while maintaining accurate contour detection in each block, thereby improving overall processing speed without sacrificing accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a block-based dimensional structure, organizing the image processing into a two-dimensional grid of blocks. This allows simultaneous processing across multiple blocks in parallel, transforming the traditional sequential one-dimensional processing approach into a parallel multi-dimensional approach that enhances processing efficiency.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If parallel processing is implemented, then processing speed is improved, but processing complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

By dividing the image into independent blocks, the patent enables parallel processing where each block can be processed separately using the same algorithm. This segmentation strategy allows efficient utilization of multiple calculation cores while keeping the processing logic within each block simple and uniform, thus managing complexity effectively.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs a universal processing algorithm that can be applied to any block in the image. This multi-functional approach allows the same processing logic to handle different blocks simultaneously, reducing the need for complex specialized processing routines and simplifying the overall system architecture while maintaining high processing efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If dynamic contour method is used, then parallel processing capability is improved, but real-time processing capability deteriorates due to multiple iterative steps

Engineering Contradiction:
Improveparallel processing capabilityVSAvoiditerative processing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent divides the image into multiple blocks and performs contour processing independently on each block. This segmentation eliminates the need for multiple iterative steps across the entire image, as each block can be processed in a single pass using parallel computation, thereby achieving both parallel processing capability and real-time performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary processing by dividing the image into blocks and preparing block-based data structures before contour extraction. This preliminary organization enables direct parallel processing of each block without requiring multiple iterative refinement steps, reducing overall processing time while maintaining parallel processing advantages.

Inventive Principle:
Principle #10Preliminary action

4Stability of the object's composition

If contour correction is performed to minimize energy function, then contour smoothness is improved, but accuracy of complex shapes deteriorates

Engineering Contradiction:
Improvecontour smoothnessVSAvoidcomplex shape accuracy
Core Design Contradiction:
Stability of the object's compositionVSMeasurement precision

Solution Approach 1:

By processing each block independently, the patent preserves the local contour characteristics of complex shapes within each block without applying global smoothing that would distort these features. This segmentation approach maintains accuracy of complex shapes while still providing sufficient smoothness for practical applications.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies contour processing locally to each block rather than globally across the entire image. This local quality approach allows each block to maintain its specific contour characteristics, including complex shapes, without being overly smoothed by global energy minimization, thereby preserving accuracy while achieving adequate smoothness.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11508083B2Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
Publication Date: 2022.11.22 CANON KK
  • US11508083B2 patent drawing
  • US11508083B2 patent drawing
  • US11508083B2 patent drawing

AI summary

An image processing apparatus comprises a calculation unit configured to obtain, for a pixel of interest in a boundary portion of a specific region in a captured image bounding a non-specific region, a direction vector to the non-specific region, a selection unit configured to select one of pixels in the boundary portion that are adjacent to the pixel of interest, as a selected pixel based on the direction vector of the pixel of interest, and a generation unit configured to generate information indicating a direction from the pixel of interest to the selected pixel as information indicating a contour corresponding to the specific region.