Mixed Reality Interference Region Visualization Behind Occluders

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In mixed reality systems, it is challenging to visually present the region of interference between virtual objects when the interfering region is hidden behind a line-of-sight blocking object, as existing methods fail to provide effective visualization in such scenarios.

Innovation Solution

An information processing apparatus comprising a virtual object drawer, an interference determiner, an interference region deriver, and an image outputter that draws and outputs the region of interference even when it is located behind other virtual objects, using techniques like hidden-line/hidden-surface removal processing and highlight display to ensure visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the display color of the region of interference is changed into a highlight color, then the visual presentation of the interference region is improved, but the interference region remains invisible when hidden behind a line-of-sight blocking object

Engineering Contradiction:
Improvevisibility of interference regionVSAvoidcomplexity of visualization method
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary virtual plane that intersects with the line-of-sight blocking object to create an opening, allowing the interference region to be visualized indirectly. This mediator (virtual plane with opening) enables the hidden interference region to become visible without directly modifying the blocking object itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent visualizes the hidden interference region by projecting it onto a virtual plane that exists in a different spatial dimension relative to the line-of-sight blocking object. This dimensional transformation allows the interference region, which is occluded in the original view, to be displayed in an alternative dimension where it becomes visible.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the display color of the interfering virtual object is changed in its entirety, then the interference region becomes recognizable when part of the virtual object is visible, but the method fails when no part of the virtual object is visible

Engineering Contradiction:
Improverecognizability of interference regionVSAvoidapplicability to all interference scenarios
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent segments the visualization approach by separating the interference region display from the virtual object display. Instead of coloring the entire virtual object, the method selectively displays only the interference region on a virtual plane, allowing independent control and visibility even when the parent virtual object is completely occluded.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The virtual plane acts as an intermediary carrier that displays the interference region independently of the virtual object's visibility. This mediator enables the interference information to be presented even when no part of the interfering virtual object is visible from the current viewpoint.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If simple color change is used for highlight display, then the implementation is simple, but the interference region cannot be presented when blocked by other objects

Engineering Contradiction:
Improvesimplicity of implementationVSAvoideffectiveness of interference visualization
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent maintains simplicity by using color change on the virtual plane while adding the intermediary element of a plane with opening. This approach preserves the ease of color-based highlight display while improving reliability by ensuring the interference region becomes visible even when blocked, through the mediator virtual plane that creates an opening in the line-of-sight blocking object.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10706625B2Information processing apparatus, control method, and storage medium storing program
Publication Date: 2020.07.07 CANON KK
  • US10706625B2 patent drawing
  • US10706625B2 patent drawing
  • US10706625B2 patent drawing

AI summary

The apparatus draws virtual objects as an image from a predetermined point of view, determines whether the virtual objects interfere with each other, calculates the region of interference of the virtual objects determined as interfering with each other, and outputs an image in which the region of interference located behind of the virtual objects as seen from the point of view is drawn.