The invention provides a system and a method for determining an obstacle by using aerial view images, relates to technology for determining the obstacle around a vehicle by aerial view image technology. A plurality of image acquisition devices which are arranged at different positions are used for acquiring a plurality of images around a vehicle body respectively, and the plurality of images are at least provided with an overlapping region; an image processor performs independent aerial view image conversion on the images; and an obstacle calculating unit compares the correlation of repeat regions of two independent aerial view images and judges whether the obstacle exists or not according to the size of the correlation. In addition, a mapping table of a group of space conversion data is constructed and comprises driving state data such as the steering wheel angle, gear or speed of the vehicle, and the like, so when the driving state is changed, a panoramic aerial view image at an appropriate viewing angle is quickly converted through the mapping table, and the position of the obstacle measured by the obstacle calculating unit is marked on the panoramic aerial view image; therefore, the safe driving of a user is facilitated.