Coordinate matching method, control method using coordinate matching method, and terminals

Abstract

Embodiments of the present invention disclose a coordinate matching method, a control method using the coordinate matching method, and terminals. The method comprises the steps of acquiring two-dimensional coordinates of a reference pattern center on a screen and pixel coordinates and a depth value of the reference pattern center in a depth image; calculating values f / dx and f / dy in pixels of a focal length f of a depth camera in an x direction and a y direction of an image plane coordinate system; according to the f / dx, f / dy, the pixel coordinates and the depth value, and a relationship between the pixel coordinate system and a depth camera coordinate system, calculating three-dimensional coordinates of the reference pattern center in the depth camera coordinate system, and determining a correspondence between the three-dimensional coordinates and the two-dimensional coordinates of the reference pattern center; and according to the correspondence, when three-dimensional coordinates of a controlled object are obtained, calculating two-dimensional coordinates of the controlled object on the screen. According to the method and terminals, conversion between the three-dimensional coordinates in the depth camera coordinate system and the two-dimensional coordinates on the screen is realized, so that screen touch control is realized, and the control accuracy is improved.

Description

technical field [0001] The present invention relates to the field of virtual technology, in particular to a coordinate matching method, a manipulation method and a terminal using the coordinate matching method. Background technique [0002] Various displays based on touch screens have been widely used in various industries. During operation, you can directly click on the screen to pick up the information you need, and you can directly complete various touches such as clicking, double-clicking, dragging, and zooming without using tools such as mouse and keyboard. Control actions to operate the playback of various display contents, which is very convenient to use. But for some devices, such as screens, projection walls, LED walls, DLP walls, TVs, etc., the cost of adding a touch screen is relatively high or impossible, and a variety of other control methods are required, such as infrared sensing methods, Ultrasonic methods, etc., in terms of cost, installation method, precisi...

AI Technical Summary

Problems solved by technology

But for some devices, such as screens, projection walls, LED walls, DLP walls, TVs, etc., the cost of adding a touch screen is relatively high or impossible, and a variety of other control methods are required, such as infrared sensing methods, Ultrasonic methods, etc., in terms of cost, installation method, precision, etc., various other control methods have their own shortcomings

Considering the control accuracy alone, the control accuracy of various other control methods needs to be improved

Images