Mixed Reality Image System for Immersive CAD Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional three-dimensional CAD systems face challenges in inputting parameters effectively due to two-dimensional graphical user interfaces and provide unsatisfactory simulation results with two-dimensional displays, limiting the immersive recognition of simulation outcomes in mixed reality environments.

Innovation Solution

A mixed reality space image providing system that combines real and virtual elements through a network-connected server and clients, allowing for real-time data sharing and simulation processing, enabling the superimposition of three-dimensional models onto real-space images, thus enhancing the sensory experience by reducing simulation delays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If parameters are input via a two-dimensional graphical user interface in conventional CAD systems, then the system is easy to operate, but it is difficult to input parameters in much the same way users actually use the CAD system and the display is unsatisfactory for feeling simulation results

Engineering Contradiction:
Improveease of parameter inputVSAvoidimmersive recognition of simulation outcomes
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent transitions from two-dimensional GUI parameter input to three-dimensional natural interaction. Users directly manipulate three-dimensional models and parameters through gestures, voice, or other natural interfaces in a virtual reality environment, eliminating the need for traditional 2D menus and forms. This dimensional shift enables more intuitive parameter input while providing immersive simulation visualization.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a virtual reality environment as an intermediary between the user and the CAD system. This VR intermediary captures natural user interactions (gestures, voice commands) and translates them into parameter inputs and simulation controls, bridging the gap between intuitive user behavior and system functionality while providing immersive simulation feedback.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If simulation results are displayed on a two-dimensional display, then the system is simple to implement, but it is unsatisfactory to feel a simulation result

Engineering Contradiction:
Improvesimplicity of display systemVSAvoidsensuous recognition of simulation result
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent replaces two-dimensional display with three-dimensional virtual reality visualization. Simulation results are rendered as immersive 3D models and animations that users can view from multiple angles and interact with directly. This dimensional enhancement provides comprehensive sensory feedback about simulation outcomes including spatial relationships, motion dynamics, and physical interactions that cannot be effectively conveyed on 2D screens.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of manufacture

If conventional CAD systems are used for simulation, then the system is easy to implement, but it is difficult to input parameters effectively and provide immersive simulation experience

Engineering Contradiction:
Improveease of system implementationVSAvoideffectiveness of parameter input
Core Design Contradiction:
Ease of manufactureVSEase of operation

Solution Approach 1:

The patent replaces traditional mechanical interaction methods (mouse clicks, keyboard typing, menu navigation) with natural human behaviors (gestures, voice commands, spatial manipulation). Users directly grab, move, and manipulate virtual components and parameters using hand gestures or voice, eliminating the need to learn complex GUI operations while maintaining system implementability through software-based virtual reality environments.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP2161692B1Mixed reality space image providing apparatus
Publication Date: 2019.11.06 CANON KK
  • EP2161692B1 patent drawingFigure 1
  • EP2161692B1 patent drawingFigure 2
  • EP2161692B1 patent drawingFigure 3

AI summary

A mixed reality space image providing apparatus configured to provide a user with a mixed reality space image in which a virtual object image is superimposed on a real space image is provided includes a selection unit (100) configured to select simulation processing from among a plurality of types of simulation processing based on an instruction from the user, a simulation processing unit (101) configured to perform the simulation processing selected by the selection unit (100) with respect to the virtual object image, and a providing unit (150) configured to generate a mixed reality space image by superimposing the simulation-processed virtual object image on the real space image and to provide the generated mixed reality space image to the user.