Video splicing system and method for binocular robot

Abstract

The invention provides a video splicing system and method for a binocular robot, and belongs to the technical field of robot visual images. The system comprises a robot video frame acquisition module,an image splicing system processing module, a wireless transmission module and a terminal display module, wherein the image splicing system processing module comprises an overlapping area positioningmodule, a feature point parallel directional registration module, an image color correction module, an image deformation module, a dynamic planning suture line module and an image smooth fusion module; the system can carry out system, video frame coincidence area positioning, feature point directional registration, image color correction, image deformation, dynamic suture line planning and imagesmooth fusion processing on an image frame collected by a robot in a binocular mode to obtain high-quality spliced video; the visual field of the robot is greatly expanded, purposes of movement, positioning, identification and the like can be better completed, and the image frame splicing speed and the splicing efficiency are improved.

Description

[0001] 【Technical field】 [0002] The invention relates to the field of robot vision images, in particular to a binocular robot video splicing system and method. [0003] 【Background technique】 [0004] Video splicing is a key technology in the field of machine vision and digital image processing. It solves the problem that the monocular vision system is limited by its small field of view. Using image splicing technology to splice the image frames collected by the robot's binoculars can make the robot detect A wider world, access to richer information. The usual stitching method is to perform image registration and alignment through feature matching and homography matrix mapping, and to find the optimal stitching line of the image by constructing the energy function of the overlapping area of ​​the image to achieve the fusion of image frames. At present, there are still many shortcomings in the video stitching technology of robots, which restrict complex tasks such as target r...

AI Technical Summary

Problems solved by technology

[0008] The purpose of the present invention is to provide a video splicing system and method for a binocular robot to solve the problem of limited visual range, low efficiency of feature point registration, and low error rate in existing machine vision technology. High, video image frame splicing speed is slow, poor robustness, with splicing seams, video quality is not high and many other problems

Images