Surgical Viewing Twin for Interactive Planning and Execution

Solution Overview

Problem

Existing surgical systems lack the ability to interact with static visualizations of radiology data for accurate surgical planning and execution, leading to difficulties in repeatability and precision due to the absence of a digital twin of the real environment.

Innovation Solution

A viewing system that includes a real object detection device to create a digital representation of the real environment, utilizing a processor to generate and store a map, and guiding modules for room setup, anatomy registration, surgical planning, and execution, enabling interaction with virtual objects relative to real objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If static visualizations of radiology data are used for surgical planning, then the surgical planning process can be completed, but the ability to interact with the visualizations for accurate planning and execution is lost

Engineering Contradiction:

Improvesurgical planning interactionVSAvoidsurgical planning accuracy

Core Design Contradiction:

Ease of operationVSManufacturing precision

Solution Approach 1:

The patent creates a digital twin (virtual copy) of the real surgical environment including patient anatomy, surgical tools, and room layout. This virtual copy allows interactive manipulation and precise measurement without affecting the real environment, resolving the contradiction between ease of interaction and planning accuracy.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system introduces a virtual environment as an intermediary between the static radiology data and the real surgical procedure. This intermediary layer enables interactive planning and execution while maintaining fidelity to the real anatomy and environment, thereby improving both ease of operation and manufacturing precision.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Extent of automation

If robots are used to execute surgeries remotely, then surgical procedures can be performed by remote operators, but repeatability and accuracy are difficult to attain without a digital twin

Engineering Contradiction:

Improveremote surgical executionVSAvoidsurgical repeatability and accuracy

Core Design Contradiction:

Extent of automationVSReliability

Solution Approach 1:

The patent creates a digital twin (virtual copy) of the real surgical environment including patient anatomy, surgical tools, and room layout. This virtual copy allows interactive manipulation and precise measurement without affecting the real environment, resolving the contradiction between ease of interaction and planning accuracy.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system continuously updates the virtual environment with real-time data from sensors in the real surgical environment, creating a closed-loop feedback system. This allows remote operators to see the effects of their actions in the virtual twin before executing them in reality, improving repeatability and accuracy of remote surgical execution.

Inventive Principle:

Principle #23Feedback

3Manufacturing precision

If no digital twin of the real environment is created, then the system remains simple, but repeatability and accuracy in setup, anatomy registration, surgical planning, and execution are very difficult to attain

Engineering Contradiction:

Improvesurgical setup and execution accuracyVSAvoidsystem complexity

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent creates a digital twin (virtual copy) of the real surgical environment including patient anatomy, surgical tools, and room layout. This virtual copy allows interactive manipulation and precise measurement without affecting the real environment, resolving the contradiction between ease of interaction and planning accuracy.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The virtual environment serves multiple functions: it is used for room setup planning, anatomy registration, surgical procedure planning, and real-time surgical execution guidance. This multi-functionality justifies the added complexity by providing comprehensive precision across all surgical stages without requiring separate systems for each function.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS12472007B2Viewing system for use in a surgical environment

Publication Date: 2025.11.18 MAGIC LEAP INC

AI summary

The invention relates to a viewing system for use in a surgical environment. Various real object detection devices detect locations of real objects in a real environment, such as a patient and body part of patient, medical staff, robots, a cutting tool on a robot, implant transferred by robot into body part, surgical tools, and disposable items. A map generator generates a map that forms a digital representation or a digital twin of the real environment. Various guiding modules including a room setup module, an anatomy registration module, a surgical planning module, and a surgical execution module make use of the digital representation to guide virtual or real objects based on the digital representation.