Multi-person real-time tracking device and method for 360-degree suspension optical field three-dimensional display system

Abstract

The invention discloses a multi-person real-time tracking device and method for a 360-degree suspended optical field three-dimensional display system and belongs to the technical field of image processing and computer vision. The multi-person real-time tracking device comprises a pair of panorama cameras which are set at an edge of a diffuse screen, and a processor which is in communication connection with the panorama cameras. Lenses of the panorama cameras are set upward vertically. The processor comprises a transmission unit and a processing unit. The transmission unit is used for transmitting video data photographed by the panorama cameras in real time. The processing unit is used for carrying out single frame processing on the video data to obtain single frame images, expanding validareas of the single frame images into rectangular images, carrying out face detection in the rectangular images and moreover, carrying out face matching on the rectangular images converted from the single frame images between the two cameras at the same time, thereby obtaining position information of observers relative to a display center. The whole device is simple in setting, is portable, is convenient for carrying and is good in implantation performance. The device and the method can be applied to man-machine interaction modules of various optical field three-dimensional display systems.

Description

technical field [0001] The present invention relates to the technical fields of image processing and computer vision, and in particular to a full parallax display device and method for a 360° suspended light field three-dimensional display system. Viewpoint fitting. Background technique [0002] Display technology is developing towards high-definition, three-dimensional panoramic display. The difference between three-dimensional display and traditional two-dimensional display is to bring visual depth perception to the viewer through various methods, so that it can naturally or unnaturally obtain the third-dimensional information in the picture. [0003] With the development of computer science and projection technology, three-dimensional display has developed rapidly in recent years. A true 3D image means that the viewer can see the display in space, looking around the scene with the correct field of view and occlusion relationships. The naked-eye three-dimensional displa...

AI Technical Summary

Problems solved by technology

For the current ordinary cameras, the field of view is too small to meet the needs of 360-degree wide-angle

With a common camera like this, not all observers within 360 degrees can be detected at the same time

If you use the stitching of multiple cameras, you need to solve multiple problems such as the calibration of multiple cameras and the overlap of 3D scenes between the cameras, which will make the system and algorithm very complicated, and bring difficulties to the determination of the position of multiple viewpoints.

Images