Superficial venous image augmented reality method and device based on perspective projection

Abstract

The invention relates to a medical image augmented reality method and a device based on a projection technology, belongs to the field of wisdom medical treatment, and provides a means capable of assisting a doctor in performing diagnosis and treatment. The device is mainly characterized in that an infrared light source, an infrared camera and a projector constitute a light path, perspective transformation model parameters of target points before and behind a projection are determined by a calibration technology, and then a superficial image to be augmented is directly projected on the surface of patient skin after augmented transformation. According to the method and the device, geometrical model parameters of the projector and the infrared camera are obtained during calibration, the augmented image can be coincided with a real affected part accurately after the perspective transformation, and the augmented reality of the superficial image is realized. According to the method and the device, since only a placement relationship between the projector and the infrared camera is required to be determined, the transformation operation can be conducted in real time after a single calibration operation in a specific environment. Therefore, a hardware framework is simple and easy to realize, and the method and the device have good instantaneity and practicability.

Description

technical field [0001] The invention relates to a medical image augmented reality method based on projection technology, belongs to the field of smart medical care, and is a means capable of assisting doctors in performing diagnosis and treatment. Background technique [0002] Medical augmented reality (AR) technology is becoming an important tool. In the process of disease consultation and diagnosis, doctors can communicate with patients more accurately to obtain more realistic diagnosis results. Images such as subcutaneous tissue and veins are directly displayed on the surface of the patient's skin, improving the quality of surgical treatment. At present, medical augmented reality technology has been applied in many fields, especially in the very significant growth of surgical applications. In particular, the continuous improvement of the optical structure of the infrared camera and the miniaturization design of the projector make the future development of this technology...

AI Technical Summary

Problems solved by technology

However, the projection system has not been put into commercial production due to the high cost of the night vision device and the fuzzy image boundary observed by the night vision device, which is difficult to judge.

Although the reflective projection system (Chinese Patent No. CN1621889A) can directly display the image on the skin surface, the optical design is very complicated and it is not easy to miniaturize

Images