Physical Surgical Models for Intuitive Virtual Object Manipulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for manipulating virtual objects in surgical planning systems, such as dental implant procedures, are not intuitive or ergonomically agreeable, particularly when using two-dimensional or three-dimensional interfaces like mice and styluses.

Innovation Solution

A system and method that utilizes a physical control element with six degrees of freedom, which is analyzed by a processor to replicate the same movements in a virtual environment, allowing for intuitive manipulation of surgical apparatuses like dental implants or instruments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional 2D or 3D interfaces (mouse, stylus) are used to manipulate virtual objects, then the system can function with simple hardware, but the ease of operation deteriorates because manipulation is not intuitive or ergonomically agreeable

Engineering Contradiction:
Improveintuitiveness of virtual object manipulationVSAvoidcomplexity of control interface
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent uses a physical scale model (copy) of the surgical apparatus as the control interface. The physical model replicates the geometry, proportions, and key features of the actual surgical device, allowing users to manipulate it in a natural, intuitive way. This physical copy is tracked by optical sensors to determine its position and orientation in 3D space, which then controls the corresponding virtual object in the planning software.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces a physical scale model as an intermediary between the user and the virtual surgical apparatus. This intermediary provides tactile feedback and natural hand-eye coordination, bridging the gap between physical manipulation and virtual control. The model serves as a mediator that translates intuitive physical gestures into precise digital commands without requiring users to learn complex interface conventions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If a physical scale model with six degrees of freedom is used as the control interface, then the ease of operation improves by providing intuitive manipulation, but the device complexity increases due to tracking systems and processors

Engineering Contradiction:
Improveergonomic agreement of control interfaceVSAvoidcomplexity of tracking and processing system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical tracking systems with optical tracking. Instead of using encoders, resolvers, or other mechanical sensors attached to the physical model, the system uses optical markers (reflective or active) that can be tracked by external cameras. This substitution eliminates mechanical complexity while maintaining six-degree-of-freedom tracking capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The physical scale model is designed to be passively tracked through optical markers attached to it. The model itself does not require active sensors, motors, or power sources - it simply reflects or emits light for the tracking cameras to detect. This self-service approach reduces the complexity of the control device while maintaining full tracking functionality.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3267918B1Method for using a physical object to manipulate a corresponding virtual object in a virtual environment, and associated apparatus and computer program product
Publication Date: 2025.08.20 NEOCIS INC
  • EP3267918B1 patent drawingFigure 1
  • EP3267918B1 patent drawingFigure 2A~2C
  • EP3267918B1 patent drawingFigure 3

AI summary

Systems and methods are provided for planning a procedure. A display device is configured to display a first virtual element. A controller device having a processor is configured to be in communication with the display device, and the controller device is further configured to direct the display device to display the first virtual element. A physical control element is in communication with the controller device, and is configured to correspond to the first virtual element such that an actual manipulation of the control element is displayed, via the processor of the controller device and on the display device, as a corresponding response of the first virtual element to the actual manipulation of the control element. Associated systems, methods, and computer program products are also provided.