Method and system for binocular fish-eye image splicing and unfolding correction

Abstract

The invention relates to a method and system for binocular fish-eye image splicing and unfolding correction. The method for binocular fish-eye image splicing and unfolding correction includes the steps: utilizing a binocular fish-eye camera to obtain an original binocular fish-eye image, and extracting the left and right two effective circular imaging areas from the original binocular fish-eye image; extracting the characteristic points of the overlapped part in the two effective areas, and matching the characteristic points in pairs; respectively mapping the two effective area images to obtain two space coordinate unit spherical surface images, performing matrix singular value decomposition on the three dimensional space spherical surface, obtaining the rotation relation, that is, the rotation matrix, between the two images through calculation, and correcting one of the space coordinate unit spherical surface images through the rotation matrix; and finally respectively mapping the twospace coordinate unit spherical surface images to obtain two panoramic coordinate images, and splicing the two panoramic coordinate images into a complete 360 DEG panoramic image. The method and system for binocular fish-eye image splicing and unfolding correction can solve the problem that the fish-eye imaging sensors are not in parallel during the assembling process, thus causing errors, and have the advantages of being good in the splicing effect after correction, being high in processing timeliness, and being easy to implement.

Description

technical field [0001] The invention belongs to the field of image processing, in particular to the field of fisheye image processing, and specifically refers to a method and system suitable for splicing and unfolding correction of binocular fisheye images. Background technique [0002] In recent years, panoramic cameras have become more and more popular in the fields of computer vision and virtual reality. Traditional virtual reality creates a virtual environment through 3D image technology, which is composed of geometric figures and texture maps, which looks very unreal. The virtual environment created by using panoramic images can truly present the indoor and outdoor environments, and the sense of immersion is stronger. Due to the wide viewing angle of fisheye cameras, it has become an industry trend to use fisheye lenses to realize panoramic cameras. [0003] The fisheye lens is an ultra-wide-angle camera with a field of view approaching or even exceeding 180°, and the...

AI Technical Summary

Problems solved by technology

The stitching of binocular fisheye images is one of the difficulties in realizing a panoramic vision system. It takes a long time to stitch panoramic images and cannot achieve real-time performance; ghosting and other problems will occur in panoramic image stitching

[0005] The binocular fisheye image stitching technology in the prior art is mainly to stitch photos with small viewing angles and small distortions, and cannot correct image errors caused by assembly problems, and lacks an accurate, easy-to-implement, and fully automatic method for generating panoramic images

Images