Control method based on mixed reality, mixed reality equipment and surgical robot

Abstract

The invention discloses a control method based on mixed reality, mixed reality equipment and a surgical robot. A virtual console is rendered and projected on mixed reality equipment worn by a user executing an operation to be displayed to the user, gesture operation of the user on the virtual console is monitored, a controller identifier in the virtual console operated by the user is determined, and a control instruction is sent to a surgical robot according to the controller identifier and the gesture operation, so that the surgical robot operates according to the control instruction to execute surgery. According to the method, the virtual console rendered by the mixed reality equipment can be controlled through a non-contact method with the mixed reality equipment serving as control equipment, control over the surgical robot is achieved, the situation that control over the virtual console is not flexible due to limitation of a sterile membrane is avoided, the situation that the sterile membrane is damaged due to manual operation is avoided, and the safety of the operation process is ensured.

Description

technical field [0001] This description relates to the field of medical technology, and in particular to a mixed reality-based control method, mixed reality equipment, and surgical robot. Background technique [0002] At present, surgical robots are widely used in the medical field. In surgical scenarios, because surgical robots perform operations related to surgery (such as suturing, nail placement, etc.) are more stable than manual operations, and can reduce the workload of doctors, Therefore, the application of surgical robots in surgery has become a hot spot. [0003] In traditional surgical scenarios, it is necessary to configure the console of the surgical robot in the operating room, and the doctor controls the movement of the surgical robot and performs related surgical operations on the patient by manually operating the console. Since the operation needs to be performed in a sterile environment, in order to reduce the risk of infection of the patient, the console i...

AI Technical Summary

Problems solved by technology

[0004] However, the sensitivity of the console covered with a sterile film will be poor, especially when the console includes a controller that needs to be moved, such as a joystick, the sterile film will restrict the movement of the controller, making the doctor less able to control the surgical robot. restricted

In addition, when doctors manually operate the console covered with sterile film, if unfortunately the sterile film is damaged, the console will be exposed, making the effect of the sterile film invalid and increasing the risk of infection for patients

Images