MR Index Arrangement Guidance via Composite Image Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In mixed reality (MR) applications using video see-through head-mounted displays, the alignment of virtual objects with the physical space is challenging due to issues with camera position and orientation measurement, particularly when indices used for alignment are not within the camera's view or have a planar shape, leading to inefficient index detection and potential disruption of the scene's beauty.

Innovation Solution

An information processing apparatus that acquires pre-set arrangement positions for indices, specifies a target index based on predetermined conditions, and notifies the user of its arrangement position through a composite image displayed on a user interface, allowing for real-time index arrangement assistance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple indices are arranged to ensure sufficient image feature capture at any camera position and orientation, then the reliability of position alignment is improved, but the device complexity and processing load increase

Engineering Contradiction:
Improveposition alignment reliabilityVSAvoidindex arrangement complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the index arrangement task by providing individual guidance information for each index's arrangement position. Instead of requiring complex multi-index coordination, the system divides the problem into separate, manageable units where each index is independently positioned according to displayed guidance information, reducing overall system complexity while maintaining alignment reliability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements feedback by displaying guidance information on a display unit that shows the camera's current view and the recommended positions for indices. This visual feedback loop allows users to arrange indices based on real-time guidance, reducing the cognitive load and complexity of coordinating multiple indices while ensuring reliable position alignment.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If indices are arranged manually based on experience-based guidelines, then the ease of operation is improved, but the manufacturing precision and alignment accuracy deteriorate

Engineering Contradiction:
Improveindex arrangement easeVSAvoidposition alignment precision
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent enables self-service by providing automated generation of guidance information based on the camera's current position and orientation. The system automatically calculates and displays the optimal positions for indices without requiring users to rely on subjective experience-based guidelines, thus improving both ease of operation and position alignment precision simultaneously.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical arrangement processes with an automated information processing system. Instead of relying on human experience and manual positioning, the system uses computational algorithms to determine optimal index positions and presents them via visual guidance, substituting mechanical manual arrangement with automated digital guidance for improved precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of manufacture

If design diagrams are created to illustrate index locations, then the ease of manufacture is improved, but the difficulty of detecting and measuring increases

Engineering Contradiction:
Improveindex arrangement guidanceVSAvoidindex position detection difficulty
Core Design Contradiction:
Ease of manufactureVSDifficulty of detecting and measuring

Solution Approach 1:

The patent substitutes static design diagrams with dynamic, camera-based guidance information. Instead of relying on pre-created diagrams that may not account for actual camera positioning, the system uses real-time image processing and computational geometry to generate guidance information tailored to the specific camera view, making both the guidance more accurate and the detection process simpler.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9696543B2Information processing apparatus and information processing method
Publication Date: 2017.07.04 CANON KK
  • US9696543B2 patent drawing
  • US9696543B2 patent drawing
  • US9696543B2 patent drawing

AI summary

Arrangement positions in a physical space, which are set in advance for a plurality of indices, are acquired. Among indices in an image of the physical space, an index that satisfies a predetermined condition is specified as a target index. Notification of the arrangement position of the target index is performed.