AR Object Positioning for Image-Guided Surgery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current medical imaging and radiation therapy processes face challenges with complex, time-consuming, and inaccurate object positioning, which affects the efficiency and accuracy of imaging and treatment procedures.
Innovation Solution
The use of augmented reality (AR) technology to obtain plan images and 3D images, register them, and adjust the position of objects or tables based on registration results, facilitating precise positioning and guiding medical instruments during procedures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional positioning methods are used, then the positioning process can be completed, but it is complicated, time-consuming, and has low accuracy
Solution Approach 1:
The patent replaces traditional mechanical positioning systems with an optical-based augmented reality system. Capture devices (cameras) capture images of the patient and treatment area, and AR software processes these images to provide visual guidance for positioning. This substitution of mechanical systems with optical and software-based systems enables more accurate and efficient positioning without physical contact or complex mechanical adjustments.
Solution Approach 2:
The patent creates virtual copies of anatomical structures and treatment targets by capturing images with capture devices and processing them through AR software. These virtual representations (overlay images showing target locations, margins, and anatomical landmarks) are then superimposed onto the real-world view, allowing operators to see precise positioning guidance without physically measuring or marking the patient.
2Measurement precision
If traditional positioning methods are used, then the positioning process can be completed, but it is complicated and has low accuracy
Solution Approach 1:
The AR positioning system serves multiple functions through a single integrated platform: capturing images of the patient and treatment area, processing these images to identify anatomical landmarks and target locations, generating virtual overlay images with positioning guidance, and displaying this information in real-time. This multi-functional system replaces multiple separate positioning devices and procedures with one unified AR system.
Solution Approach 2:
The patent introduces an AR software intermediary that processes raw image data from capture devices and translates it into meaningful visual guidance. The software acts as a mediator between the physical patient/treatment area and the operator's decision-making, automatically identifying anatomical structures, calculating target positions, and presenting this information through intuitive overlay images that guide positioning without requiring complex manual measurements or interpretations.
3Loss of information
If operators look back and forth between patient and monitors for guidance, then anatomical information can be viewed, but mental mapping is difficult and inaccurate
Solution Approach 1:
The patent merges the virtual anatomical information from monitors with the physical view of the patient by superimposing AR overlay images directly onto the real-world scene. The capture devices capture images of the patient, and the AR software combines this with treatment plan data to create overlay images showing target locations, margins, and anatomical landmarks that are displayed through monitors or AR glasses in the operator's field of view. This merging eliminates the need to switch between separate views.
Solution Approach 2:
The AR overlay images use color coding to differentiate various anatomical structures and treatment parameters. Different colors represent different margins (e.g., clinical target volume, planning target volume), anatomical landmarks, and target locations. This color-coded visual system allows operators to quickly distinguish between different elements without requiring detailed interpretation, making the information easier to process and act upon.
Data Source
AI summary
A method for positioning an object positioned on a table is provided. The method may include: obtaining a plan image, the plan image illustrating a virtual surface of the object; obtaining, by one or more capture devices, a 3-dimensional (3D) image, the 3D image including a set of elements corresponding to the object; obtaining a registration result by registering the plan image and the 3D image; determining whether the object needs to be moved based on the registration result; and in response to a determination that the object needs to be moved, causing the object to move according to the registration result.