The invention discloses a dangerous goods recognition system and method thereof. According to the system, firstly, goods needing to be recognized is obtained through a camera on an intelligent terminal, and transmits image information to a goods recognition server, a server management module sends the image information to an inference module for image recognition, the inference module performs goods recognition on learned data through an offline training module, when it is read that the goods are dangerous, the inference module transmits the information to an alarm for risk prompts, and when it is read that the goods are not dangerous, the inference module transmits the information to the intelligent terminal for goods information display. The recognition scheme is offline learning, an offline training model is built, a user does not depend on the network, according to the requirement of the user, secondary development can be performed, the period is short, debugging and optimizing are performed according to the application scenarios, and the effect is better.