Mixed Reality Field-of-View Overlay for Internal Imaging Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
During operations in confined spaces, imaging devices capturing internal views are often hidden, making it difficult for assistants to accurately insert instruments or supplies without mentally visualizing the device's field of view, which can be cumbersome and inefficient.
Innovation Solution
A mixed reality system that determines device-specific parameters and spatial pose of the imaging device, overlaying a shape indicative of the field of view onto an external view using a display device, allowing users to understand the extent of the field of view dynamically and in real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the imaging device is used to capture internal views in confined spaces, then the ability to visualize internal geometry is improved, but the device itself becomes hidden from external view, making it difficult for assistants to understand the field of view extent
Solution Approach 1:
The system creates a virtual copy of the imaging device and its field of view, displaying it on an external display device. This virtual representation allows assistants to see and understand the field of view extent without interfering with the actual imaging device's function inside the confined space.
Solution Approach 2:
An external display device acts as an intermediary between the hidden imaging device and the assistants. It translates the internal field of view information into a visible external representation, enabling assistants to understand the imaging device's perspective without direct line of sight.
2Productivity
If assistants mentally visualize the imaging device location and orientation, then they can perform actions in the confined space, but this mental visualization process is cumbersome and inefficient
Solution Approach 1:
Instead of requiring assistants to mentally visualize the imaging device's position and field of view, the system provides an accurate visual copy of the field of view on an external display. This eliminates the cognitive burden of mental visualization while maintaining operational efficiency.
Solution Approach 2:
The system provides real-time visual feedback about the imaging device's field of view on the external display. This feedback mechanism allows assistants to immediately understand the current viewing angle and make informed decisions about instrument insertion without relying on mental extrapolation.
3Ease of operation
If a shape overlay indicating field of view extent is displayed on an external display device, then assistants can easily understand the internal geometry, but this requires additional display hardware and processing
Solution Approach 1:
The external display device serves multiple functions: it displays the virtual representation of the imaging device, shows the shape overlay indicating field of view extent, and can potentially display other relevant surgical or procedural information. This multi-functionality justifies the addition of display hardware.
Data Source
AI summary
A mixed reality presentation system determines a device-specific parameter characterizing an extent of a field of view of an active imaging device. The active imaging device captures imagery of an internal view of a body, and the determining of the device-specific parameter is based on data received from the active imaging device. The mixed reality presentation system also determines a spatial pose of the active imaging device as the active imaging device captures the imagery of the internal view of the body. Based on the device-specific parameter and the spatial pose of the active imaging device, the mixed reality presentation system directs a display device to display a shape overlay indicative of the extent of the field of view relative to the body. The shape overlay is displayed together with an external view of the body in a mixed reality presentation. Corresponding systems and methods are also disclosed.