Remote surgery system using augmented reality and virtual reality platform

Abstract

The present invention relates to a remote surgery system comprising: an augmented reality device that can be used by a surgeon; a virtual reality device that can be used by a collaborating surgeon; and a network and server that enable the augmented reality device and the virtual reality device to communicate with each other. According to the present invention, the remote surgery system can be helpfully used not only for education but also when emergency surgery needs to be performed in a remote area where there is no specialist, such as a military unit. Furthermore, the remote surgery system can be used if a doctor at a local hospital receives support from a doctor at a higher-level hospital when performing surgery or if a doctor in a developing country receives support from a doctor in a developed country.

Description

Remote surgery system using augmented reality and virtual reality platforms

[0001] The present invention relates to a remote surgery system using an augmented reality and virtual reality platform, and more specifically, to a remote surgery system using an augmented reality and virtual reality platform that can be applied not only to remote surgery by an operating surgeon (trainee) and a collaborating surgeon (trainer) but also to education.

[0002] Herein, background information regarding the present disclosure is provided, which does not necessarily imply prior art.

[0003] Recently, Augmented Reality (AR), which superimposes a 3D virtual image on a real image or background to create a single image, and Virtual Reality (VR), which provides an environment indirectly allowing users to experience a specific location or situation in 3D computer graphics, have been developed and are being applied in many fields.

[0004] As the special law for residents reduced working hours, training time also decreased. Furthermore, with the rise of personal information protection and proxy surgery issues, training for residents has become increasingly limited, making it even more crucial to improve the quality of education.

[0005] The present invention can be useful not only for education, but also in cases where emergency surgery must be performed in remote areas such as military bases where there are no specialists. It also aims to provide a remote surgery system that can be used when receiving support from a doctor at a higher level hospital during surgery at a local hospital, or even when a doctor in a developing country receives support from a doctor in a developed country.

[0006] However, the purposes of the present invention are not limited to the purposes mentioned above, and other purposes not mentioned will be clearly understood by those skilled in the art from the description below.

[0007] In the operating room, the surgeon (trainee) wears an AR (Augmented Reality) headset and performs the surgery. A co-trainer (trainer) outside the operating room watches the surgeon's video using VR (Virtual Reality) and observes the surgery. The co-trainer can record necessary information on the surgeon's video. This can help guide the correct surgical procedure by drawing the location and shape of skin incisions or marking the location of cranial punctures. Furthermore, by highlighting areas with important functions, such as motor or language centers, the trainee can ensure a safe surgical experience.

[0008] This system can be useful not only for the training mentioned above, but also in cases where emergency surgery is required in remote areas such as military bases where there are no specialists. It can also be used when receiving support from doctors at higher-level hospitals when performing surgery at local hospitals, or even when doctors in developing countries receive support from doctors in developed countries.

[0009] All technical and scientific terms used in this specification have the same meaning as commonly understood by one of ordinary skill in the art, unless otherwise stated. Furthermore, throughout this specification and the claims, unless otherwise stated, the terms "comprise," "comprises," and "comprising" are intended to encompass a stated object, step, or group of objects, and steps, but not to exclude any other object, step, or group of objects, or groups of steps.

[0010] Before describing the present invention in detail below, it is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the present invention which is limited only by the scope of the appended claims.

[0011] Meanwhile, the various embodiments of the present invention may be combined with any other embodiments unless explicitly stated otherwise. Any feature indicated as particularly desirable or advantageous may be combined with any other feature or features indicated as desirable or advantageous. Hereinafter, embodiments of the present invention and their resulting effects will be described with reference to the accompanying drawings.

[0012] A remote surgical system according to one embodiment of the present invention includes an augmented reality (AR) device usable by a surgeon (trainee); a virtual reality (VR) device usable by a cooperating surgeon (trainer); and a network and server that enable communication between the augmented reality device and the virtual reality device.

[0013] The above augmented reality equipment is equipment used by the surgeon (trainee). The surgeon (trainee) performs the surgery while filming the image using the augmented reality equipment, and the surgical image of the surgeon is transmitted in real time to the virtual reality equipment worn by the collaborating surgeon (trainer).

[0014] The above-mentioned virtual reality equipment is used by the attending physician (educator) to record necessary information on the surgical image. For example, it records guidance information for the attending physician that can assist in conducting a correct and safe surgery, such as drawing the location and shape of skin incisions, marking the location of cranial perforations, or highlighting areas with important functions such as motor or language centers. This guidance information is transmitted in real time to the augmented reality equipment worn by the attending physician (educator).

[0015] The above augmented reality equipment displays the guide information of the collaborative surgery on top of the surgical image of the surgeon, so that the surgeon can perform the surgery while checking the guide information of the collaborative surgery in real time, thereby enabling the surgery to be performed correctly and safely.

[0016] The above network and server enable information to be provided through data transmission and reception between the augmented reality equipment and the virtual reality equipment.

[0017] The features, structures, effects, etc. exemplified in each of the aforementioned embodiments can be combined or modified to implement other embodiments by those skilled in the art. Therefore, the contents related to such combinations and modifications should be construed as being included within the scope of the present invention.

Claims

1. Augmented reality equipment available to surgeons; Virtual reality equipment available to the collaborating physician; and A remote surgery system including a network and a server that enable communication between the augmented reality equipment and the virtual reality equipment.

2. In paragraph 1, The above augmented reality equipment includes a device capable of capturing images, A remote surgery system characterized by transmitting a surgical image taken by the surgeon through the augmented reality equipment in real time to the virtual reality equipment.

3. In paragraph 2, The above virtual reality equipment includes a device capable of recording information on the surgical image of the surgeon, A remote surgery system characterized by transmitting in real time the guide information of the collaboration recorded through the virtual reality equipment to the augmented reality equipment.

4. In paragraph 3, A remote surgery system characterized in that the augmented reality equipment displays the guide information of the collaboration on the surgical image of the surgeon.