The invention relates to the technical field of
intelligent control of a fully mechanized
coal mining face of a
coal mine, and discloses a large
coal tracking
processing method and device based on an image and a
radar, and the method comprises the following steps: building a data
package containing
time synchronization information; resolving a real-
time transformation matrix of a camera coordinate
system relative to a mechanical arm base coordinate
system based on the characteristics of a fixed calibration reference object in the data packet to realize dynamic external parameter calibration; a large coal target is recognized,
point cloud depth information is combined, a real-
time transformation matrix is called, and the real-
time transformation matrix is mapped into static position coordinates under a mechanical arm base coordinate
system; combining the speed of the scraper chain with a system
response time window, and calculating predicted position coordinates of the large coal at the interception moment; and the motion track of the mechanical arm is planned, and the
tail end executor is driven to execute
processing operation on the target through closed-loop dynamic error correction. According to the method, the problems of coordinate system drifting and dynamic target tracking
lag in a strong vibration environment are effectively solved, and accurate interception and efficient treatment of large coal are realized.