The application relates to a kind of based on the method and
system of joint learning strategy's lamellar keratoplasty
surgery augmented reality navigation, comprising: based on the acquisition
surgery image of camera unit and conversion into
single frame image, and carry out normalization
processing to construct neural
network model input;Based on frame-by-frame image, utilize joint learning deep neural
network model to obtain
surgery instrument, corneal region segmentation result and corresponding completion
optical flow result;The image and corresponding completion
optical flow result of current frame and forward adjacent frame are combined, and the completion information of current frame is comprehensively calculated, and the area blocked by surgery instrument is recovered by completion calculation;Utilize corneal region segmentation result to realize the
augmented reality navigation result of superimposed surgery
suture line and point position on the completion surgery image by
ellipse fitting and suture point calculation process.The application can realize the construction of
augmented reality navigation information for lamellar keratoplasty surgery, guide surgery related operation, improve surgery efficiency.