Crane operation monitoring method based on monocular depth estimation and three-dimensional restoration

Abstract

The application discloses a kind of based on monocular depth estimation and three-dimensional restoration's boom operation monitoring method, comprising the following steps: S1, monocular depth estimation model is constructed;S2, monocular depth estimation model is trained;S3, obtains calibration plate image and depth control point;Real-time acquisition crane operation scene photo and video;S4, based on calibration plate image, obtain internal and external parameter matrix to photo and video are calibrated and corrected, obtain crane arm position plane coordinate and railway position annotation file;S5, photo and video are input monocular depth estimation model to obtain disparity prediction graph, obtain depth prediction graph;S6, to depth prediction graph geometric correction;S7, generate three-dimensional point cloud;S8, based on crane arm position plane coordinate and railway position annotation file, utilize three-dimensional point cloud to obtain crane arm and railway real world position, the posture of crane boom operation is monitored and risk early warning.The method of the application is high in precision, low in cost.

Images