A black/white stretching system using R, G, B information and a method thereof. The black/white stretching system includes a first transformer to transform a luminance value and a color difference value of an input image to R, G, B values of each pixel, a histogram estimator to estimate a histogram distribution by accumulating each of the transformed R, G, B values of each pixel of the input image with a same weight, a mapper to generate mapped R′, G′, B′ values by mapping the transformed R, G, B values according to a mapping function generated based on the estimated histogram distribution, and a second transformer to generate an output image by reverse-transforming the mapped R′, G′, B′ values from the mapper to an updated luminance signal and an updated color difference signal. Therefore, the black/white stretching system prevents color distortion generated in a primary color image using only luminance information.