The invention discloses an imaging-free moving object detection and three-dimensional tracking device and method. The method comprises the following steps of controlling the spatial light modulator togenerate a set of sine stripe pattern for modulation illumination by using control equipment, dividing the generated structured light into two beams of polarized light through an imaging system and abeam splitting device, reflecting the light by the reflection device and projecting the light to a scene to be measured from two orthogonal directions, generating two beams of transmission light passing through a scene, then receiving the two beams of transmission light by a photoelectric detector, obtaining a signal amplitude by a data acquisition card, and judging whether a moving object existsin the scene and obtaining a three-dimensional space coordinate and a moving track of the moving object by control equipment according to the change of the signal amplitude. The device is simple in structure and low in cost, the method does not need to acquire, reconstruct or process the image of the object, the amount of data required to be acquired for spatial positioning is small, the data acquisition time is short, the calculation complexity is low, the consumed time is short, and long-time real-time detection and tracking of a moving object and even a high-speed moving object can be realized.