Method and equipment for remote guidance based on augmented reality

Abstract

The invention aims to provide a method and equipment for remote guidance based on augmented reality, and the method comprises the steps: obtaining and storing a three-dimensional object model of a current operation object of a second user, and enabling the second user to carry out the operation of the current operation object according to the guidance of a first user; in response to a trigger event for guiding based on the three-dimensional object model, presenting the three-dimensional object model through the first user equipment; in response to a guidance operation of the first user based on the three-dimensional object model, generating guidance information corresponding to the guidance operation; and sending the guidance information to augmented reality equipment used by the second user. According to the method, the requirement for the network is low, the network bandwidth can be saved, the refresh rate can be increased, and compared with a remote cooperative processing mode in the prior art when the network is poor, a guiding party can obtain more details on site, and the efficiency and accuracy can be improved.

Description

technical field [0001] The present application relates to the communication field, and in particular to a remote guidance technology based on augmented reality. Background technique [0002] In the existing technology, remote collaboration is based on audio and video communication. Through the display mode of augmented reality, the remote instructor provides remote technical guidance (such as marking and graffiti) to the local operator. Audio and video communication occupies network bandwidth, and video The frame rate is generally between 15-24 frames, which may affect the stability of the video image. When the network is poor, the existing remote collaboration methods will reduce the video frame rate, resolution, video quality, etc., or directly turn off the video and use audio for remote assistance. This method cannot accurately grasp the guidance. The on-site environment brings obstacles to the guidance, which reduces the efficiency of guidance, and even fails to achieve...

AI Technical Summary

Problems solved by technology

[0002] In the existing technology, remote collaboration is based on audio and video communication. Through the display mode of augmented reality, the remote instructor provides remote technical guidance (such as marking and graffiti) to the local operator. Audio and video communication occupies network bandwidth, and video The frame rate is generally between 15-24 frames, which may affect the stability of the video screen

When the network is poor, the existing remote collaboration methods will reduce the video frame rate, resolution, video quality, etc., or directly turn off the video and use audio for remote assistance. This method cannot accurately grasp the guidance. The on-site environment brings obstacles to the guidance, which reduces the efficiency of guidance, and even fails to achieve the effect of guidance. Alternatively, the on-site image is sent to the remote end, and the remote instructor can use graffiti, annotations, etc. based on the on-site image. Guide the front, cooperate with voice guidance, which can improve efficiency and accuracy, and have lower requirements on the network. However, in remote collaboration, this method of remote collaboration based on a single image on the spot lacks the grasp of the site of the guided party

Images