Method and device for building 3D control space based on RGBD image

Abstract

The invention provides a method and a device for building a 3D control space based on an RGBD image. The method comprises the following steps: collecting a continuous frame RGBD image of a user, wherein the RGBD image includes color information and depth information; acquiring a 3D control space building instruction based on the continuous frame RGBD image; building a 3D coordinate system with a specific point in the RGBD image as the origin; building a control boundary plane with the specific point as the center, and acquiring the position information of the points of the control boundary plane on the 3D coordinate system; and dividing the control boundary plane into multiple instruction areas, and identifying instructions according to pass-through information of a hand of the user passing through the instruction areas. The device comprises a collecting module, an instruction acquiring module, a coordinate building module, a boundary plane building module, and an instruction dividing module. According to the invention, a 3D control space is built based on the color information and depth information of an RGBD image, user's spatial gesture control can be more convenient, more accurate and faster, and the user experience can be improved.

Description

technical field [0001] The present invention relates to the technical field of spatial gesture manipulation, in particular to a method and device for establishing a three-dimensional manipulation space based on RGBD images. Background technique [0002] The RGBD image is acquired by an RGBD camera, and the pixel information in the image includes color information and depth information, and the color information corresponds to the depth information one by one. Tracking the target area in the RGBD image can automatically obtain its color information according to the depth information of the target area, and vice versa. [0003] The RGBD image acquired by the RGBD camera is processed, and each pixel value of the depth image corresponds to the distance from the object reflected by the pixel to the depth camera in physical space. For the target area in the depth image, its spatial position information can be directly obtained, and further functions such as 3D object reconstructi...

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a method and device for establishing a three-dimensional control space based on RGBD images, which can solve the problems existing in the prior art that the three-dimensional control of the space needs to be mapped to the control interface, resulting in inconvenient control and poor experience.

Images