Industrial man-machine interaction system and method based on vision and inertial navigation positioning

Abstract

The invention relates to an industrial man-machine interaction system and method based on vision and inertial navigation positioning. The system comprises at least one manipulator, at least one mechanical arm, at least four industrial cameras, at least four cameras, at least one set of somatosensory wearable equipment and at least one computer, wherein the manipulators are used for grabbing and machining target workpieces; the bottom of each mechanical arm is provided with a base, and each manipulator is installed at the tail end of one mechanical arm; the industrial cameras are used for acquiring color images of arms, finger joints and the manipulators in a working area of an operator; the cameras are used for stereoscopically positioning the mechanical arms and the manipulators in a space; the somatosensory wearable equipment is worn at the arm position of the operator and used for acquiring displacement, speed and acceleration information in the moving direction; and the computers are used for acquiring information and judging whether the operator collides with the mechanical arms and the manipulators or not by acquiring the information of the wearable equipment and image information of the cameras in a small view field of the working area of the operator.

Description

technical field [0001] The invention relates to an industrial human-computer interaction system and method based on vision and inertial navigation positioning, belonging to the fields of human-computer interaction and industrial measurement. Background technique [0002] At present, there are many human-computer interaction methods to ensure human-machine safety in industrial sites, including using hand-held controllers to ensure that people are within the safe range, guardrails to ensure personal safety, and operators to ensure personal safety outside the working range of robots. These human-computer interaction methods are large. Most of them are serial, and there is no real contact between man and machine. In the existing human-computer interaction system, the main work of the operator is loading the robot's working materials, supervising the operation of the robot at a safe distance, and inspecting the finished product. The human-computer interaction process of the exis...

AI Technical Summary

Problems solved by technology

The human-computer interaction process of the existing scheme is still limited by space, and it cannot make the human-computer interaction free from space constraints and walk with people, and the recognition image processing process is complicated

Images