The invention discloses a self-adaptive vision-aided driving device and relates to aided driving of vehicles. The self-adaptive vision-aided driving device is provided with a vehicle-mounted power supply, a voltage-reducing and voltage-stabilizing circuit, a vehicle-mounted display panel, an FPGA (Field Programmable Gate Array) core board, a digital camera and a steering control interface, wherein the FPGA core board is provided with a power module, a crystal oscillator, an FPGA chip and an input/output interface, the input end of the voltage-reducing and voltage-stabilizing circuit is connected with the output end of the vehicle-mounted power supply, the output end of the voltage-reducing and voltage-stabilizing circuit is respectively connected with the input end of the power module of the FPGA core board and the input end of the digital camera, an output interface of the FPGA core board is connected with the input end of the vehicle-mounted display panel, the output end of the digital camera is connected with an input interface of the FPGA core board, the output end of the digital camera is connected with the input interface of the FPGA core board, and the output end of the steering control interface is connected with the input interface of the FPGA core board.