Head-worn AR Visualization System for Surgical 3D Augmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current visualization systems in surgical applications lack the ability to effectively provide three-dimensional augmentation information to surgeons, which can enhance spatial orientation and workflow during medical procedures, as they primarily rely on two-dimensional displays that do not fully utilize the field of view.
Innovation Solution
A method and system that utilize a pose sensor system to capture the position and orientation of a head-worn visualization device relative to a main display device, generating and displaying three-dimensional augmentation information that seamlessly integrates with the two-dimensional image representation, allowing for a unified and contextually accurate extension of the image into a three-dimensional space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a two-dimensional main display device is used to show surgical images, then the system is simple and easy to operate, but the spatial orientation and three-dimensional information are insufficient
Solution Approach 1:
The patent applies dimensionality change by transitioning from a two-dimensional display to a three-dimensional augmented reality display. The head-worn visualization device with AR glasses presents surgical images and augmentation information in three-dimensional space, allowing surgeons to perceive depth and spatial relationships directly in their field of view, thereby recovering the lost three-dimensional information without significantly increasing system complexity.
Solution Approach 2:
The pose sensor system acts as an intermediary between the surgeon's head position and the AR display. It captures head pose data and transmits it to the visualization device, enabling the system to adjust the three-dimensional display according to the surgeon's viewing angle and position, thus facilitating the transition from simple 2D display to intelligent 3D display.
2Loss of information
If a head-worn visualization device with AR glasses is used, then three-dimensional information is provided, but the device complexity increases
Solution Approach 1:
The head-worn visualization device integrates multiple functions into a single system: it displays the surgical video feed from the capturing device, overlays three-dimensional augmentation information (such as anatomical structures, surgical pathways, and measurements), and adjusts the display based on head pose data from the pose sensor system. This multi-functionality provides comprehensive spatial orientation information without requiring separate devices for each function.
Solution Approach 2:
The patent merges the capturing device, main display device, pose sensor system, and AR visualization device into an integrated surgical visualization system. The AR glasses combine the video display and augmentation information display into a single optical path, allowing surgeons to view both the surgical field and three-dimensional information simultaneously without switching between devices, thereby managing complexity through integration.
3Productivity
If augmentation information is displayed only on the main display device, then the display is simple, but the field of view cannot be fully utilized and workflow is not optimized
Solution Approach 1:
The patent places augmentation information directly in the surgeon's field of view using AR technology. Instead of requiring the surgeon to shift attention to a separate main display device, the system projects three-dimensional augmentation information (such as anatomical landmarks, surgical instruments tracking, and measurement data) into the surgeon's visual field, allowing simultaneous viewing of the surgical site and critical information, thereby optimizing workflow efficiency.
Data Source
AI summary
The invention relates to a method for operating a visualization system in a surgical application, wherein at least one image representation of a region to be operated on and/or operated on is captured by means of a capturing device, wherein the at least one image representation is displayed on a main display device, wherein a pose of a visualization device that can be worn on the head relative to a display surface of the main display device is captured by means of a pose sensor system, and wherein at least one three-dimensional augmentation information item corresponding to the at least one image representation displayed is generated and/or provided and is displayed on a display device of the visualization device, wherein the augmentation information item is generated and/or provided in consideration of the captured pose in such a way that the at least one image representation displayed on the main display device is extended into a three-dimensional region by the at least one three-dimensional augmentation information item corresponding to said at least one image representation. Furthermore, the invention relates to a visualization system for a surgical application.