Local image warping in image processor using homography transform function

Abstract

A feature extractor determines reference feature locations from a portion of a reference image and corresponding feature locations from a portion of a warp image. A transform module determines a homography transform function that transforms versions of the corresponding feature locations to the reference feature locations. The homography transform function has an error below a threshold level, where the error represents a difference between the transformed corresponding feature locations and the reference feature locations. The local transform module generates transform parameters by processing the homography transform function. A warper circuit warps the portion of the warp image by at least applying the transform parameters to generate a portion of a warped image.

Description

BACKGROUND1. Field of the Disclosure[0001]The present disclosure relates to warping an image and more specifically to warping groups of pixels in the image differently than other groups of pixels.2. Description of the Related Arts[0002]Image data captured by an image sensor or received from other data sources is often processed in an image processing pipeline before further processing or consumption. For example, raw image data may be corrected, filtered, or otherwise modified before being provided to subsequent components such as a video encoder. To perform corrections or enhancements for captured image data, various components, unit stages or modules may be employed.[0003]Such an image processing pipeline may be structured so that corrections or enhancements to the captured image data can be performed in an expedient way without consuming other system resources. Although many image processing algorithms may be performed by executing software programs on central processing unit (CP...

AI Technical Summary

Benefits of technology

The patent describes a method for warping an image by adjusting the pixel locations in different parts of the image. The method uses a feature extractor to determine reference feature locations in a reference image and corresponding feature locations in the warp image. A local transform module then generates a homography transform function to transform the corresponding feature locations to the reference feature locations. A warper circuit then warps the image based on the transformed feature locations. The method can also include a global adjustment module to determine global transform parameters that represent a global translation between the reference image and the warp image. The homography transform function can be determined using an optimization algorithm, such as least squares. The technical effect of the patent is to provide a way for warping images with precise control over the pixel locations, which can be useful in various applications such as image processing and computer vision.

Problems solved by technology

Although many image processing algorithms may be performed by executing software programs on central processing unit (CPU), execution of such programs on the CPU would consume significant bandwidth of the CPU and other peripheral resources as well as increase power consumption.

Since the images for fusion are often captured at different times and / or or locations, these images do not completely match.

Images