The invention discloses an engine combustion system and a control method thereof. The system comprises an engine body, an air inlet and exhaust system, a gasoline air channel injection system, an ethanol cylinder direct injection system, an ignition system, a variable valve system, an exhaust gas recirculation system and an electronic control unit; the engine body is connected with the air inlet and exhaust system, the ethanol cylinder inner direct injection system, the ignition system and the variable valve system, the air inlet and exhaust system is connected with the gasoline gas channel injection system and the waste gas recirculation system, the gasoline air channel injection system, the ethanol cylinder direct injection system, the ignition system, the variable valve system and the exhaust gas recirculation system are connected with the electronic control unit, and a high-geometric compression ratio is adopted by the engine body. Therefore, the gasoline and ethanol dual-fuel composite combustion is realized through the corresponding combustion mode, and the early combustion and detonation tendency of a large-load working condition region are inhibited, the low-speed torque and the power density of an engine are improved, and the combustion efficiency and the heat efficiency are improved.