Described herein is a video decoder for decoding macroblock adaptive field / frame coded video data with spatial prediction. In one embodiment, there is presented a spatial predictor for processing a macroblock pair. The spatial predictor comprises a first buffer, a second buffer, a third buffer, and arithmetic logic. The first buffer stores pixels from a first portion of the picture, the first portion neighboring the portion. The second buffer stores pixels from a second portion of the picture, the second portion neighboring the portion. The third buffer stores one or more pixels from a third portion of the picture, the third portion neighboring the portion. The arithmetic logic processes the portion from at least one of the pixels from the first buffer, at least one of the pixels from the second buffer, and at least one of the pixels from the third buffer.