Vision-touch fused augmented reality oral surgery skill training simulator

Abstract

The invention relates to a vision-touch fused augmented reality oral surgery skill training simulator. The vision-touch fused augmented reality oral surgery skill training simulator comprises a simulation training platform based on construction of a simulation head model, an oral cavity operation training system based on force feedback equipment and an observation system based on an augmented reality helmet. A virtual oral cavity model is generated based on patient oral cavity CBCT data and scanning data, and a virtual oral cavity environment is constructed; based on feature points on the virtual oral cavity model and the simulation head model, space matching for a virtual oral cavity and an oral cavity model is carried out; in a virtual oral cavity surgery simulation method, force sense information and vision information are output with the frequency of not lower than 1000 Hz and 60 Hz respectively; a simplified vision information processing method is carried out on gridding data; anda force sense-vision space calibration method for calibrating output force direction is carried out based on the head information of an operator. The system solves the problems of material consumption and single practice case in traditional oral cavity training; and compared with an existing digital training scheme, the system strengthens operation immersion by means of augmented reality technology, and accords with clinic operation habit preferably.

Description

technical field [0001] The invention relates to the field of oral surgery training simulation, which is based on augmented reality technology, force sense rendering technology, computer graphics technology, kinematics and other related disciplines to simulate the operation process of oral surgery and perform simulation training on related oral surgery operations. Background technique [0002] With the improvement of people's awareness of tooth protection, the demand for oral treatment such as periodontal and implantation is increasing. However, the reality of long training period and high cost for stomatologists greatly limits the opportunities for people to obtain oral treatment. Based on new technologies such as computer graphics and augmented reality, the present invention proposes a vision-tactile fusion augmented reality oral surgery skill training simulator construction scheme, which provides a new way for the training of stomatologists. [0003] Stomatology is a disci...

AI Technical Summary

Problems solved by technology

The main problem of this solution is that the training platform built on the principle of mirror reflection has a big difference in appearance from the simulation head model. Not only does the user need to spend more time getting familiar with the operating environment, but also lacks finger support, making it difficult to transfer the training effect.

In addition, in order to realize the spatial calibration of the virtual visual environment and the virtual force sense environment, the images generated on the screen need to be observed after being reflected by the mirror, so the operator cannot be observed during the operation, and the sense of immersion in the operation is poor.

Images