Panoramic video system with real-time distortion-free imaging

Abstract

A panoramic annular lens system (PAL), a unitary video camera and a PCbased software system that unwraps a 360 DEG video image into a seamless, distortion free horizontal image in real time. The PAL system of the preferred embodiment has a 360 DEG horizontal field of view and a 90 DEG vertical field of view in a 40mm diameter compact package. The invention is not limited to any particular type of lens system. In fact, there are numerous lens systems for providing a 360 DEG panoramic view. The video camera may be a CCD or CMOS based device having a pixel resolution of either 1280 x 1024 (high resolution) or 720 x 480 (NTSC). The unwrapping system is a radiometric ray tracing program carried out using a computer's graphics card capabilities to produce highly efficient regional transformation while minimizing software overhead. The result is real time, high resolution 30 fps conversion from a spherical distorted image to a flat panoramic image in Cartesian coordinates.

Description

[0001] Work on this invention was performed under USMA Contract No. M67854-03-C-1006, and the contractors elect to retain rights as set forth in Publication Code Section 96-517 (35 USC 202). technical field [0002] The present invention relates generally to the field of special camera systems, and more specifically, to a real-time 360° panoramic video system using panoramic loop mirrors, cameras and unique deployment software, providing a seamless, undistorted horizontal view of the panoramic image. [0003] This application claims priority to Provisional Application Serial No. 60 / 485,336, filed July 3,2003. Background technique [0004] Panoramic optical systems are known which can be used to provide a 360° viewing angle. As an example, U.S. Patent No. 6,459,451 discloses a catadioptric lens that provides a 360° viewing angle. Such optical systems can be advantageously used with cameras to provide a system capable of imaging a full 360° view of eg an entire room or a view...

AI Technical Summary

Problems solved by technology

The image of the 360° viewing angle lens is circular or ring-shaped and therefore distorted, and it is not easily discernible by a human observer

The unwrapping process involves mathematical transformations such as conversions of each picture element or pixel, and is preferably done in a manner that produces little or no distortion that would otherwise degrade the quality of the resulting planar image

Typically, this pixel-by-pixel conversion is very complex and requires complex and time-consuming computer programs, especially for images with reasonable levels of resolution and large numbers of pixels

Therefore, it is not possible to use panoramic lens technology to provide real-time unwrapped video images with desirable resolution

Images