Mixed Reality Interference Visualization for Virtual Object Assembly

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mixed reality systems struggle to effectively present the extent of interference between virtual objects, as they only sequentially link interference positions with line segments, making it difficult to determine the extent of interference traces.

Innovation Solution

An information processing apparatus that acquires real-space images, stores virtual object models, determines interference between objects, records interference information, generates composite images showing interference outlines, and outputs these images to a display, allowing for the presentation of interference shapes and history.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If sequential linking with line segments is used to record interference positions, then the system can track interference occurrences, but it becomes difficult to determine the extent of interference traces

Engineering Contradiction:
Improveinterference trace informationVSAvoidinterference recording method
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent creates a visual copy of the interference trace by projecting the sequence of interference positions onto the three-dimensional model of the component. This allows the interference extent to be directly visualized on the component model, making it easy to understand the spatial distribution and magnitude of interference without complex data processing.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms the one-dimensional sequential linkage of interference positions into a two-dimensional visual representation on the three-dimensional component model. By mapping interference trace information onto the surface or volume of the component, the system provides intuitive spatial understanding of interference extent across multiple dimensions.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If detailed interference trace information is recorded and visualized, then the understanding of interference extent improves, but the system complexity and processing requirements increase

Engineering Contradiction:
Improveinterference extent measurementVSAvoidinformation processing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of processing and analyzing complex interference trace data, the system creates a visual copy by overlaying the interference positions onto the component model. This approach maintains high measurement precision while avoiding complex processing, as the visualization directly represents the interference extent without requiring additional computational analysis.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces complex mechanical or computational analysis systems with a visual information processing approach. By using graphical representation of interference traces on the component model, the system achieves precise interference measurement through visual intuition rather than complex mathematical processing or additional hardware.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10410420B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2019.09.10 CANON KK
  • US10410420B2 patent drawing
  • US10410420B2 patent drawing
  • US10410420B2 patent drawing

AI summary

An apparatus includes an image acquisition unit configured to acquire a captured image of a real space, a position and orientation acquisition unit configured to acquire a position and orientation of each of a plurality of virtual objects, an interference determination unit configured to determine whether interference is present between the virtual objects based on the position and orientation of each of the plurality of virtual objects and model data of the plurality of virtual objects, an interference information recording unit configured to record an outline of an interference part where the virtual objects interfere with each other as interference information, based on a result of the interference determination unit, a generation unit configured to generate a composite image including the captured image, an image of the plurality of virtual objects, and an image representing the outline of the interference part.