The invention relates to an orthogonal vision detection system for detecting the wear condition of an end mill and belongs to the technical field of optical measurement and mechanical engineering. The orthogonal vision detection system comprises top surface and lateral surface CCD (Charge Coupled Device) cameras, top surface and lateral surface lenses, top surface and lateral surface ring-shaped light sources, an X-directional guide rail, a Z-directional guide rail, an X-directional sliding block, a Z-directional sliding block, a bracket, handwheels, a rotating table, a marble base, an image acquisition card and a computer. According to the invention, the double CCD cameras which are arranged in the orthogonal directions are adopted, an image analog signal of a wear region is acquired by the image acquisition card and is converted into a digital signal, computer-vision software is applied, the digital signal is processed by the computer and the width and the area of a wear zone of a rear tool face of the end mill are accurately measured, so that the detection of the wear condition of the end mill is implemented. The orthogonal vision detection system has the characteristics of non contact, high resolution, high automation degree and high speed. The fault-free operating time of machine tool equipment an be effectively prolonged and the product quality is improved. The orthogonal vision detection system has very important significance and practical value in application of an automatic machine tool.