A mixed reality fish tank system and generation method in a stereoscopic display environment

Abstract

The present disclosure provides a mixed reality fish tank system and a generation method in a stereoscopic display environment, which acquires the real fish position and the user's head position in real time; compensates the acquired real fish position, and obtains the real position of the real fish in the Kinect camera space; Using the obtained real fish position information, map it to the virtual scene, place a virtual real fish tag near the real fish, and perform real-time collision detection between the real fish and the virtual object, so that the virtual object can effectively avoid the collision of the real fish, At the same time, it detects whether the real fish blocks the virtual scene to effectively obtain scene information; using the imaging principle of stereoscopic display, the virtual fish is accurately placed in the fish tank environment, and the virtual fish and the fish tank environment are integrated. The disclosure realizes the virtual-real fusion of the MR fish tank content, and the generated three-dimensional picture is more vivid and real, so as to provide users with a realistic mixed reality experience.

Description

technical field [0001] The disclosure belongs to the field of virtual reality interaction technology, and relates to a mixed reality fish tank system and a generation method in a stereoscopic display environment. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and do not necessarily constitute prior art. [0003] Fish tanks and fish have positive effects on people's physical and mental health. O'Haire et al. found that fish tanks have a soothing effect, and observing fish has a relaxing effect and attracts people's attention, which is a suitable way to simulate nature. In addition, the fish tank is a common ornamental device in Chinese families. It has a relatively simple structure and low cost. Therefore, using mixed reality (MR) technology and using the fish tank as a carrier, a simple and vivid platform for ability training and quality development can be designed. [0004] Virtual reali...

AI Technical Summary

Problems solved by technology

[0006] The back and forth swimming of the real fish in the fish tank causes a certain occlusion to the virtual scene, so that the user cannot effectively obtain the information of the virtual scene; the virtual environment is superimposed on the real environment without considering the effective integration of the real object and the virtual environment. Achieving Mixed Reality Effects

Therefore, virtual and real occlusion not only weakens the visual immersion of the mixed reality fish tank, but also further affects the user's interactive experience

Images