According to teachings of the present invention, a system and method for a sharpness filter for picture-smoothing architectures are provided. In one embodiment, the method includes applying a finite impulse response filter to a brightness channel of an image prior to applying a picture-smoothing algorithm to the image, determining a local variance estimate for the image, and varying a gain of the finite impulse response filter based upon the local variance estimate, wherein the finite impulse response filter is an inverse of a filter that approximates the picture-smoothing algorithm.