Marker Visibility Occlusion Evaluation for Position Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in accurately obtaining positional information of a target object using markers, as recognition accuracy is affected by changes in the marker's image due to factors other than the target object's movement, leading to instability and increased design and manufacturing costs.

Innovation Solution

An information processing device and method that extract images of markers from a photographed image, determine valid position coordinates by evaluating visibility occlusion, and calculate the target object's position using valid coordinates, integrating data from an IMU sensor to stabilize accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a marker of known shape is used for recognition, then distinction from other objects and processing efficiency are improved, but recognition accuracy is greatly affected when the marker image changes due to factors other than target object movement

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidrecognition accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by making the marker spherical, which maintains a consistent circular image profile regardless of orientation. This dynamic adaptability to rotation while maintaining shape consistency resolves the contradiction by allowing efficient recognition without accuracy degradation from orientation changes

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the marker shape parameter to a sphere, which has the unique property that its projection remains a circle from any angle. This parameter change enables the marker to maintain recognition accuracy while allowing free rotation, thus improving processing efficiency without sacrificing precision

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the marker is made spherical or multiple dot-shaped markers are provided to stabilize accuracy, then recognition accuracy is stabilized, but design freedom and manufacturing cost increase

Engineering Contradiction:
Improverecognition accuracyVSAvoidmanufacturing cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

By making the marker spherical, the system achieves orientation-independent recognition without requiring multiple markers. This single dynamic solution maintains accuracy while simplifying manufacturing compared to multiple static markers

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent merges multiple potential marker functions into a single spherical marker that provides both orientation independence and sufficient recognition capability, eliminating the need for multiple separate markers and reducing manufacturing complexity

Inventive Principle:
Principle #5Merging (Combining)

3Device complexity

If all marker position coordinates are used for target object position calculation, then processing is simplified, but accuracy is affected by occluded or invalid markers

Engineering Contradiction:
Improveprocessing complexityVSAvoidposition detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent extracts and removes invalid marker data from the calculation set by evaluating visibility and occlusion. This selective extraction ensures that only valid, unoccluded markers contribute to position calculation, maintaining accuracy without requiring complex validation systems

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements feedback by continuously evaluating marker visibility and occlusion status, then adjusting which markers are used for calculation. This feedback loop maintains position detection accuracy by adapting to changing occlusion conditions while keeping processing relatively simple

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11227408B2Information processing device and positional information obtaining method
Publication Date: 2022.01.18 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11227408B2 patent drawing
  • US11227408B2 patent drawing
  • US11227408B2 patent drawing

AI summary

An information processing device disposes an object model of a target object in a virtual space, and projects a polygon of a marker onto an imaging plane. Visibility indicating a degree of occlusion of the marker is calculated from an area of an image of the marker on a model thereby obtained and an area of a corresponding image of the marker in a photographed image. When the visibility is equal to or higher than a threshold value, positional information of the marker which positional information is derived from the photographed image is determined to be valid, and is output to be used in calculation of position coordinates of the target object after a weight coefficient is determined. When the visibility is lower than the threshold value, the positional information of the marker is determined to be invalid, and is not output.