Interactive endoscopy for intra-operative virtual annotation in VATS and minimally invasive surgery

Abstract

A controller (522) for live annotation of interventional images includes: a memory (52220) storing software instructions; and a processor (52210) that executes the software instructions. When executed by the processor (52210), the software instructions cause the controller (522) to perform a process that includes receiving (S210) an intervention image during an intraoperative intervention and automatically analyzing (S220) the intervention image for a detectable feature. A process performed when the processor (52210) executes the software instructions further includes detecting (S230) a detectable feature and determining (S240) that an annotation is to be added to the interventional image for the detectable feature. The process further includes identifying (S250) a location in the interventional image for the annotation as an identified location, and adding (S260) the annotation to the interventional image at the identified location to correspond to the detectable feature. During the intraoperative intervention, a video is output (S270) as a video output based on the intervention image and the annotations, the annotations comprising annotations superimposed on the intervention image at the identified positions.

Description

Background technique [0001] Interventional medicine procedures are invasive procedures that involve entering a patient's body. Surgery is an example of an interventional medical procedure and is the preferred treatment for early stage lung cancer tumors. Also, endoscopy is increasingly being used at different stages of lung cancer surgery. For lung cancer surgery, the basic precursor to resection (removal) of the tumor is the "surgical exploration" phase, in which a medical clinician (such as a surgeon) examines lung tissue to mentally combine anatomical knowledge and preoperative imaging (such as computed tomography ( CT)) is correlated with live endoscopic (eg, thoracoscopy) video of lung tissue. The surgical exploration phase helps ensure that the clinician can remove the entire lung cancer tumor during the resection phase, while avoiding resection of healthy lung tissue that could otherwise lead to compromised lung function. Surgical exploration with thoracoscopy often ...

AI Technical Summary

Problems solved by technology

The surgical exploration involved in VATS is time-consuming, uncertain, and non-quantifiable, making many aspects of the procedure difficult to reproduce

Images