Multi-interaction method and device based on kinect and unity3d

Abstract

The invention relates to a multi-interactive method based on Kinect and Unity 3D. The method comprises the following steps: S1: adjusting the camera parameter in the Unity 3D to be in accordance with the effective detection range of the Kinect; S2: utilizing the Kinect to determine a user coordinate and a ground equation; S3: determining a virtual simulate coordinate according to the relative position, and registering a virtual model; S4: designing interactive pose and voice; S5: determining Unity 3D control model displacement animation and a multimedia effect; S6: fusing and displaying an image obtained by a camera of the Unity 3D and an image obtained by a camera of the Kinect. The multi-interactive method utilizes support on voice recognition and positioning on human skeleton by the Kinect to add the trigger mode of the virtual model three-dimensional registration, provides more interactive modes for users through the recognition function of limb motion, improves the user experience, utilizes a three-dimensional engine of the Unity 3D to conduct automatic processing on the model pose, and greatly simplifies the needed step of the three-dimensional registration. The invention further discloses a multi-interactive device based on the Kinect and the Unity 3D.

Description

technical field [0001] The invention relates to the technical field of computer augmented reality, in particular to a multi-interaction method and device based on Kinect and Unity3D. Background technique [0002] Augmented Reality technology (Augmented Reality) was first proposed in the 1990s, and now it has been widely used in many aspects such as medical care, education, industry, and commerce. A more general definition of augmented reality was proposed by Ronald Azuma of the University of North Carolina in 1997, including three main aspects: Combines real and virtual, Interactive in real time, Registered in 3D ). The technology superimposes a virtual scene on top of the real one on the screen and allows participants to interact with the virtual scene. At present, the implementation process of augmented reality is generally as follows: 1) Obtain the scene image through the image acquisition device; 2) Identify and track the calibration image or text in the scene, calcula...

AI Technical Summary

Problems solved by technology

[0003] However, the current commonly used technologies have the following defects: 1) The interaction method is simplistic, and the registration of the virtual model can only be triggered by the calibration image or text, and after registration, the model can only be translated and rotated, and the model can only follow the movement of the calibration object , less interaction methods and more restrictions; 2) The 3D registration algorithm is cumbersome, it is necessary to determine the position and posture of the model according to the feature point coordinate system, and then convert it to the camera coordinate system, and finally integrate the virtual model and the real scene and align it according to the coordinates of the display screen. it displays

It can be seen that the current technology requires more calculation steps in the 3D registration stage of the virtual model, and the operation is not simple and automatic enough

Images