A method, program product and apparatus for decoding from a scalable bit stream the binarization results of a video sequence by selectively decoding syntax elements and avoiding redundancy in coding. The result is a decrease in the size of the compressed bit stream of an enhancement layer bit stream. One method includes determining whether a skipping flag in the base layer macro block of the video data is set, and decoding a skipping flag from an enhancement layer macro block of the video data, corresponding to the base layer macro block, only if the base layer macro block skipping flag is set. Another method includes determining which of a plurality of blocks in a base layer macro block contain zero coefficients, decoding an abbreviated coded block pattern (CBP) of an enhancement layer macro block, where the CBP includes a number of digits equal to the number of blocks in said base layer macro block containing only zero coefficients, and then generating a complete CBP for the enhancement layer based on the results of said decoding. Yet another method includes decoding a CBP value of a base layer macro block and differentially decoding a CBP value for an enhancement layer macro block relative to the CBP of the base layer macro block. An additional method includes determining the zero-value coefficients in a block of a base layer, decoding a coded block flag for a corresponding block in an enhancement layer, and determining, based on the value of said encoded block flag, whether any of the zero-coefficients become non-zero coefficients in said enhancement block.