Robot vision servo control device of binocular three-dimensional video camera and application method of robot vision servo control device

Abstract

The invention relates to the technical field of medical robots, in particular to a robot vision servo control device of a binocular three-dimensional video camera and an application method of the robot vision servo control device. The robot vision servo control device comprises a robot subsystem and a vision control subsystem. The robot subsystem comprises a robot controller and a knuckle type six-freedom-degree robot. The vision control subsystem comprises the binocular three-dimensional video camera and a vision controller. The output end of the robot controller is electrically connected with the input end of the knuckle type six-freedom-degree robot. The robot controller and the vision controller are connected through both-way communication. The output end of the binocular three-dimensional video camera is electrically connected with the input end of the vision controller. The relative position of the robot and a target is detected in real time through the fixed type binocular three-dimensional video camera, the position error is calculated, and following rapidness and accuracy of the robot are guaranteed. Collisions are avoided, the target tracking accuracy of the robot in the medical surgery is effectively improved, the surgery safety is ensured, and the risk coefficient of the surgery is lowered.

Description

technical field [0001] The invention relates to the technical field of medical robots, and relates to a binocular stereo camera robot visual servo control device and a use method thereof. Background technique [0002] At the present stage, the vision sensor is one of the most important sensors in the robot system. Its introduction has changed the requirement of the robot to accurately model the operating objects and the environment. Relying on the feedback of visual information, the robot can operate under dynamic conditions. [0003] In the medical field, visual servoing technology assists doctors in complex surgical operations by obtaining the relative positional relationship between surgical instruments and patients. For example, when performing thoracic surgery and brain surgery, with the help of the characteristics of machine vision, ray fluoroscopy and MRI images can be used to analyze and locate the lesion in detail, and control the surgical knife at the end of the...

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a binocular stereo camera robot visual servo control device and usage method, which overcomes the above-mentioned deficiencies in the prior art, and can effectively solve the problems of the prior art. Using the hand-eye system to collect target images with a large field of view can easily lead to target loss, and more effectively solves the problem of large amount of image processing calculations due to the fact that the camera imaging depth needs to continuously change with the robot's movement to collect targets.

Images