A color image encoding and/or decoding system, medium, and method using inter-color-component prediction in a frequency domain. To encode an original image, including at least two or more image components, frequency domain transform may be performed with of each component of a color image, color component transform of the frequency domain transform coefficients, in frequency domain, may be performed based on the relationship between transform coefficients of the color image components in order to remove redundant information between color components, performing, and entropy encoding the removed redundant information data. According to the method, medium, and system, a color image or video data can be directly compressed effectively without a conventional color transform process. Furthermore, by using the relationship between image components, redundant information between color components varying with respect to the encoding mode may be removed so that the encoding efficiency can be enhanced.