Augmented Reality Surgical Guidance for Instrument Identification and Assembly

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Orthopedic surgical procedures face inefficiencies due to the reliance on physical instruments and instructions, which can obstruct the surgical field and require time-consuming assembly, and existing augmented reality solutions lack effective instrument identification and assembly guidance.

Innovation Solution

An augmented reality device that overlays virtual representations of surgical instruments and tools onto the surgical field, allowing real-time identification, assembly, and guidance through AR displays, using cameras and sensors to interact with physical objects and provide step-by-step instructions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If physical instruments and instructions are used during surgery, then surgical guidance is provided, but the surgical field is obstructed and assembly time is required

Engineering Contradiction:
Improvesurgical guidanceVSAvoidsurgical field obstruction
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent uses virtual representations (copies) of physical instruments displayed through augmented reality headsets. Instead of physical instruction booklets or guides that occupy space, the system creates digital replicas of instruments and procedural steps that overlay the surgical field, providing guidance without physical obstruction.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces physical mechanical systems (physical instruments, printed instructions, laser pointers) with an optical-digital system. The augmented reality headset uses cameras to capture the surgical field and displays virtual overlays, substituting the need for physical guidance tools that obstruct the view.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If physical instruments and instructions are used during surgery, then surgical guidance is provided, but time-consuming assembly is required

Engineering Contradiction:
Improvesurgical guidanceVSAvoidassembly time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-assembling and pre-configuring all instrument information in the augmented reality system before surgery begins. The virtual representations and assembly instructions are prepared in advance and loaded into the headset, eliminating the need for time-consuming physical assembly during the surgical procedure.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates virtual copies of instruments and their assembly states, allowing assistants to view and understand instrument configuration without physically assembling the actual instruments. The digital replicas provide complete assembly guidance instantaneously.

Inventive Principle:
Principle #26Copying

3Difficulty of detecting and measuring

If laser pointers are used to identify instruments, then instrument identification is provided, but sterility is compromised

Engineering Contradiction:
Improveinstrument identificationVSAvoidsterility compromise
Core Design Contradiction:
Difficulty of detecting and measuringVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an intermediary system - the augmented reality headset with its integrated camera and display - that mediates between the surgical field and the instrument identification need. The camera captures images of instruments, and the headset processes and displays identification information, eliminating the need for non-sterile laser pointers to be introduced into the sterile field.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Manufacturing precision

If preoperative planning and physical guides are used, then surgical precision is improved, but manufacturing costs and configuration time increase

Engineering Contradiction:
Improvesurgical precisionVSAvoidmanufacturing and configuration
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent creates virtual copies of preoperative planning data and physical guides, displaying them through augmented reality. Instead of manufacturing physical guides and models, the system digitizes and overlays virtual representations of the preoperative plan, maintaining surgical precision while eliminating manufacturing and configuration complexity.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3512452B1Augmented reality surgical technique guidance
Publication Date: 2025.08.27 ZIMMER INC
  • EP3512452B1 patent drawingFigure 1
  • EP3512452B1 patent drawingFigure 2A
  • EP3512452B1 patent drawingFigure 2B

AI summary

A system and method for using augmented reality device for use during a surgical procedure are described. A system may include an augmented reality device to present a virtual indication, such as a virtual indication of a surgical instrument, a force vector, a direction, or the like. The augmented reality device may present a virtual aspect of a procedure, such as a virtual animation of a step of a procedure. The augmented reality device may present a virtual object, indication, aspect, etc., within a surgical field while permitting the surgical field or aspects of the surgical field to be viewed through the augmented reality display (e.g., presenting virtual objects mixed with real objects).