The invention provides a video review method and device and a server. The method comprises the following steps of intercepting a multimedia fragment of a to-be-reviewed video according to a scene in the to-be-reviewed video; detecting whether a content of the multimedia fragment belongs to a prohibited category or not; and if yes, sending prompt information of the to-be-reviewed video to the prohibited category, wherein the multimedia fragment comprises an image frame, an audio fragment, a speech fragment and/or a text fragment. The method can be realized by intercepting the multimedia fragment of the to-be-reviewed video according to the scene in the to-be-reviewed video and detecting whether the content of the multimedia fragment belongs to the prohibited category or not, wherein the multimedia fragment comprises the image frame, the audio fragment, the speech fragment and a character fragment, the to-be-reviewed video is cut into the multimedia fragment according to the scene, and when one fragment has relatively strong characteristic performance, the to-be-reviewed video can be determined to belong to the prohibited category, and the technical scheme can greatly improve the review efficiency under a condition that the video is longer.