The invention discloses a collecting method of driver's driving behavior data and a collecting device of driver's driving behavior data. The method includes steps of collecting image of a driver in a car or/and outside of the car, performing grey and binarization processing on the image and forming multiple gray pictures; performing Fourier transform, orthogonal transformation and picture segmentation operation on the gray picture, and extracting target information; identifying vehicles, road lines, passengers and traffic signboard information by a fuzzy mode identification method and a statistical pattern recognition method; according to the well set alarm level, judging the alarm, and finally sending the analysis result to a sever through the network, classifying and summarizing by the server; integrating the vehicle running state and the driver's driving behavior, and using the data as basis for the third party to analyze the driver's driving behavior, or sending to the driver or insurance company. The invention can provide comprehensive dynamic information, complete data for insurance company, related O2O of automobile, traffic management and other industries, and well use big data to optimize traffic and improve safety.