Processing method and device

Abstract

The invention relates to a processing method and device, and the method comprises the following steps:obtaining an environment image of an environment where electronic equipment is located at present, and obtaining point features and / or line features on the environment image; determining three-dimensional space position information of the point features and / or the line features; and determining plane information in the current environment of the electronic equipment at least based on the three-dimensional space position information. The processing method provided by the embodiment of the invention can accurately and comprehensively detect the plane information in the current environment of the electronic equipment without depending on a depth camera, and is wide in application range and relatively low in cost. According to the method, the plane information in the current environment of the electronic equipment can be determined by adopting a universal monocular or multi-view camera, the operation is convenient, a depth camera does not need to be used, and the universality is high; and meanwhile, the plane information of the current environment of the electronic equipment can be accurately and comprehensively detected, the plane information can also be accurately determined in the environment with few textures, and good robustness is achieved.

Description

technical field [0001] The present disclosure relates to the technical field of image processing, and in particular to a processing method and device. Background technique [0002] In augmented reality AR applications, a typical application scenario is to detect planes in the physical world, such as horizontal desktops and floors, vertical walls, etc., for displaying virtual models, such as virtual dinosaurs or airplane models. Therefore, how to detect and output plane information on mobile devices such as mobile phones and AR glasses in real time and accurately is an urgent problem to be solved in augmented reality AR applications. [0003] In the prior art, a monocular or binocular camera is generally used to cooperate with a depth camera to detect a plane, wherein the monocular or binocular camera is used to run the SLAM algorithm to solve the 6dof attitude data, and the depth camera is used to obtain the depth information of the surrounding environment In order to obtai...

AI Technical Summary

Problems solved by technology

[0003] In the prior art, a monocular or binocular camera is generally used to cooperate with a depth camera to detect a plane, wherein the monocular or binocular camera is used to run the SLAM algorithm to solve the 6dof attitude data, and the depth camera is used to obtain the depth information of the surrounding environment To obtain the three-dimensional dense point cloud information of the surrounding environment, so as to detect the geometric plane of the surrounding environment, because the depth camera is required, the cost is high, and it cannot be applied to mobile phones and other devices without depth cameras, and the versatility is not strong

Another RGB camera-based plane detection scheme, such as Google's ARcore, does not need to use a depth camera, but its detection is not accurate enough, especially in places where the texture is not rich, only part of the plane can be detected, such as the plane that cannot detect the edge area of ​​​​the desktop , in addition, the scheme is not easy to extend to AR glasses based on binocular fisheye cameras

Images