The invention provides a system for preventing phone and short message frauds. The system comprises a mobile client side and a server and is characterized in that the server comprises a recording fraud detection module, a fraud identity retrieval module, a speech recognition module, an intelligent analysis module, a voice frequency and fingerprint database, a fraud criminal vocal print database and a fraud information database. According to the system and method for preventing the phone and short message frauds, the technologies of voice frequency and fingerprints, vocal print authentication, speech recognition, natural language comprehension and the like are comprehensively utilized, comprehensive intelligent speech analysis is provided, speech is analyzed from the aspects of incoming call numbers, speech content, incoming call identities, recording data sources and the like, fraud prevention detection is provided, calls/short messages which are suspected by a user are detected comprehensively, suspicious calls are detected in time, and the user is reminded and effectively prevented from being deceived.