Mixed Reality Surgical Suite Head-Up Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques for laparoscopic surgery limit a surgeon's vision, requiring them to look away from the surgical table to view imaging modalities, which can distract and reduce efficiency.

Innovation Solution

A mixed reality imaging surgical suite and device provide a head-up display using augmented reality and holography to visualize a live, intra-operative situational environment with a mixed reality grid or avatar, allowing accurate positioning and alignment of implants and bones without the need to look away from the surgical table.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional imaging techniques are used to provide radiographic views during surgery, then anatomical visualization is achieved, but surgeon attention is distracted from the surgical table requiring them to look away at monitors

Engineering Contradiction:
Improveanatomical visualizationVSAvoidsurgeon focus on surgical table
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent projects radiographic images and 3D anatomical models from traditional 2D monitors into the surgeon's direct field of view using head-up display technology. This dimensional transition allows anatomical information to be visualized in the surgeon's line of sight rather than requiring lateral attention shifts to separate monitors, thereby maintaining focus on the surgical table while preserving complete anatomical visualization.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system introduces a head-up display interface as an intermediary between the surgeon and anatomical information. This mediator presents augmented reality overlays and mixed reality grids that combine radiographic data with the direct view of the surgical field, eliminating the need for the surgeon to switch between separate imaging monitors and the surgical site.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If multiple imaging modalities and monitors are used to provide comprehensive anatomical data, then complete anatomical information is available, but surgeon distraction and reduced surgical efficiency occur

Engineering Contradiction:
Improvecomprehensive anatomical dataVSAvoidsurgical efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent merges multiple imaging modalities (radiographic images, 3D models, anatomical data) into a single integrated head-up display interface. This consolidation presents comprehensive anatomical information through unified augmented reality overlays and mixed reality grids, eliminating the need for multiple separate monitors and allowing the surgeon to access all anatomical data without leaving the surgical field, thereby maintaining high surgical efficiency.

Inventive Principle:
Principle #5Merging (Combining)

3Loss of information

If the surgeon must look away from the surgical table to view imaging modalities, then radiographic and anatomical information can be viewed, but attention is distracted during surgery

Engineering Contradiction:
Improveradiographic and anatomical informationVSAvoidsurgeon attention during surgery
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system transitions anatomical information from external monitors to the surgeon's direct field of view through head-up display projection. This allows radiographic and anatomical data to be overlaid in the surgeon's line of sight, eliminating attention shifts while preserving complete information access, thereby maintaining continuous focus and reliability during surgical procedures.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10258427B2Mixed reality imaging apparatus and surgical suite
Publication Date: 2019.04.16 ORTHOGRID SYSTEMS INC
  • US10258427B2 patent drawing
  • US10258427B2 patent drawing
  • US10258427B2 patent drawing

AI summary

System and method for use of mixed and augmented reality Imaging surgical suite and an augmented reality device are provided. A 2D/3D virtual grid having a head-up display with augmented reality is provided. The head-up display can display a 2D radiographic image or 3D volumetric representation or shape model of image, and can further display an augmented reality grid/indicator which can be depicted as a grid, implant, instrument or bone avatar/figure representing shapes, orientations, and positions relative to an anatomical image or model. The augmented reality indicator can be displayed directly in a surgeon's field of view to provide a live, intra-operative situational environment and navigational guidance for the surgeon. The head-up display can show avatar grids/indicators that are outside of the surgeon's field of view within a patient's body.