Mixed Reality Floor Alignment via Automatic Vision Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mixed reality systems require manual input or numerical adjustments to align virtual object floors with real space floors, which can be cumbersome and impractical.

Innovation Solution

An information processing apparatus that acquires viewpoint information, specifies a virtual reference surface, determines its positional relationship with a real reference surface, corrects virtual space data, and generates a display image to align the virtual floor surface with the real floor surface, using a system comprising a captured image acquisition unit, viewpoint information measurement unit, floor surface obtaining unit, floor surface selection unit, and image generation unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual operation or numerical input is used to align virtual floor surface with real floor surface, then alignment can be achieved, but the operation becomes cumbersome and time-consuming

Engineering Contradiction:
Improvealignment precisionVSAvoidoperation complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically detects the real floor surface using the imaging apparatus and autonomously aligns the virtual floor surface without requiring manual coordinate input or keyboard operations. The alignment is performed by the system itself based on automatic recognition of the real-world floor plane, eliminating the need for user intervention in the alignment process.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical operations (keyboard input, controller manipulation) with an automated vision-based system. The imaging apparatus captures images of the real floor surface, and the system automatically processes these images to determine floor plane parameters and perform alignment, substituting mechanical user interaction with automated optical and computational processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If automated alignment is implemented, then ease of operation improves, but device complexity increases

Engineering Contradiction:
Improvealignment easeVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The imaging apparatus serves multiple functions: it captures images for both viewing the virtual reality space and automatically detecting the real floor surface for alignment. By making the imaging apparatus multi-functional, the system avoids adding separate dedicated sensors or devices, thereby reducing overall system complexity while maintaining automated alignment capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the captured images as an intermediary between the real world and the virtual alignment process. Rather than requiring direct user input or complex sensor arrays, the image data serves as a mediator that the system processes to automatically determine floor surface parameters and perform alignment, simplifying the interaction while maintaining automation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10620693B2Apparatus and method for displaying image in virtual space
Publication Date: 2020.04.14 CANON KK
  • US10620693B2 patent drawing
  • US10620693B2 patent drawing
  • US10620693B2 patent drawing

AI summary

An information processing apparatus includes a viewpoint information acquisition unit that acquires viewpoint information concerning a viewer, a data input unit that inputs virtual space data, a specifying unit that specifies a virtual reference surface corresponding to a real reference surface in the virtual space data, a determination unit that determines positional relationship between the virtual reference surface and the real reference surface, a correction unit that corrects the virtual space data based on the positional relationship, and a generation unit that generates a display image based on the corrected virtual space data and the viewpoint information.