A color night vision system based on infrared and low light level image fusion technology is disclosed. The invention relates to a color night vision system and particularly relates to the technology with the fusion of infrared and low light night vision image fusion imaging. At present, main night-vision equipment is divided into an infrared thermal imager and a low light night-vision instrument. However, the infrared thermal imager has the disadvantages of blurred outline of an infrared image, low resolution and poor sense of depth and does not meet a human eye visual characteristic, and the eye observation is not facilitated. The low light night-vision instrument is easily affected by the environment conditions of light, weather and the like, in the bad conditions of rain, rain and smoke, the image detail loss is serious. The invention provides a color night vision system which is not affected by weather, light and smoke and has the advantages of high resolution, good real-time performance, rich details, the accordance with human eye visual characteristic, and easy reading understanding by people. According to the system, an image pyramid method is used, the two paths of night vision images of infrared and low light in the same scene and same visual angle are fused, then a color rapid transfer algorithm is used, and the tone in a day natural scene is transferred to a fused night vision image.