The invention discloses a speech content extracting method and a speech content extracting device based on a cloud platform. The speech content extracting method is characterized in that audio materials and video materials of a speech are acquired, and are cached in a PC for a pretreatment; the pretreated audio materials, the pretreated video materials, related data including speech slides, and related reading materials are transmitted to a server; the server is used for voice segmentation of the received audio materials, and is used for segmenting the audio materials according to speakers; automatic voice identification is used for converting the segmented audio materials into words, and adopts acoustic self-adaption and language model self-adaption; key words are extracted from texts after the voice identification, and content notes are generated. By adopting the speech content extracting method, the audio materials are converted into the text form, which can be read repeatedly, by the audio identification, and the language model self-adaption and the acoustic model self-adaption are used to improve the identification accuracy. Because of knowledge integration, time for reading redundant information is saved. The invention also discloses the speech content extracting device based on the cloud platform. The s speech content extracting device comprises a speech recording module, a material transmitting module, a voice segmenting module, a voice identifying module, and a key word and a content note extracting module.