A Human-Computer Interaction Safety Early Warning and Control Method Based on Digital Twin

Abstract

The present invention proposes a human-computer interaction safety early warning and control method based on digital twins, the steps of which are as follows: based on a deep learning algorithm, identify the staff and the key points of the staff's human body in the image captured by the binocular camera; paste the label on At the joints of the robot, the position of the label in the image is recognized by the Canny edge detection and Hough circle detection algorithms; based on the binocular vision ranging principle, the key points of the human body and the spatial coordinates of the label are measured, and the staff and the robot are calculated. The distance between human-computer interaction security early warning twin system is built to realize the interaction and integration of physical scene and virtual scene of human-computer interaction, iterative optimization, and real-time online visual monitoring of the safety of human-computer interaction process. The present invention uses real-time data to drive the human-computer interaction safety warning twin system, which can optimize the optimal work space, ensure the safety of the interaction process between human and robot, and improve the efficiency of human-machine collaborative work.

Description

technical field [0001] The present invention relates to the technical field of intelligent manufacturing, human-computer interaction and safety control, in particular to a method for human-computer interaction safety early warning and control based on digital twins, especially to realize the digital twin environment based on deep learning and multi-eye vision. A security control method for human-computer interaction. Background technique [0002] Smart manufacturing will bring a new manufacturing model, which requires a high degree of automation to achieve fast and low-cost production, as well as highly flexible and intelligent production. By combining the performance of the robot system with the flexibility, agility and intelligence of humans, the flexibility and intelligence of the production line can be significantly improved in some production processes, thereby improving production efficiency. However, when humans and robots work in the same working environment, the sa...

AI Technical Summary

Problems solved by technology

[0009] Aiming at the technical problems of poor adaptability, large amount of calculation, and high cost in the existing human-computer interaction control in a dynamic environment, the present invention proposes a human-computer interaction safety early warning and control method based on digital twins, based on deep learning and multi-eye vision Combined, the distance between man-machine is calculated, the model of man-machine distance measurement is simplified, the real-time performance of detection is improved, the efficiency of man-machine collaboration is improved, and the whole process of man-machine interaction can be monitored online in real time. process safety

Images