Non-photorealistic rendering of augmented reality

Abstract

A method and system for rendering a captured image of a scene is disclosed which provide see-through vision through the rendered image, for example of an augmented reality object rendered behind the scene, by assigning pixel transparency values in dependence upon captured image pixels. The method and system preserve some structure of the scene in the rendered image without requiring a model of the scene.

Description

Technical field [0001] The present invention relates to a method of rendering images, in particular to provide occlusion hints, for example in medical augmented reality displays. Background technique [0002] Augmented reality (AR) is becoming a valuable tool during surgery. Providing real-time, recorded pre-surgery data during surgical tasks does not require reference to offline images and helps to record these data to real tissues. The visualization of the object of interest becomes possible through the "perspective view" provided by AR. [0003] In recent years, medical remote control devices have been increasingly used in minimally invasive surgery (MIS). With MIS assisted by remote control equipment, the microprocessor-controlled robotic arm enhances dexterity, allows motion adjustments to reduce total hand movement, and allows the execution of micro-scale tasks that would otherwise be impossible. [0004] The unique operating setting of the surgical remote control device pro...

AI Technical Summary

Problems solved by technology

The disadvantage of all these methods, except the last one, is that the 3D model of the volume surface must be known so that the window outline or surface can be drawn according to this 3D model

Images