Auxiliary image generation method, remote control method and device for work machine

Abstract

The invention provides an auxiliary image generation method, a remote control method and a remote control device for a working machine, and the working machine comprises a camera used for collecting a first environment image, a plurality of execution mechanisms capable of moving relatively, and a sensor used for collecting posture features of the execution mechanisms. The auxiliary image generation method comprises the following steps: acquiring attitude features of an execution mechanism; obtaining a first environment image collected by a camera; and based on the attitude features and the first environment image, generating an auxiliary image, wherein the auxiliary image is used for representing the environment information of the working machine and the attitude information of the working machine. According to the invention, the auxiliary image is generated based on the attitude feature and the first environment image and is used for simultaneously representing the environment information of the working machine and the attitude information of the working machine on the same image, so that an operator can be accurately assisted and guided to operate the working machine in a scene of manually operating the working machine, the misjudgment risk of the operator is reduced, moreover, the number of uploaded video paths is small, network resources can be saved, and the image quality is improved.

Description

technical field [0001] The invention relates to the technical field of operating machines, in particular to an auxiliary image generation method, a remote control method and a device for an operating machine. Background technique [0002] Operation machinery is widely used in tunnel construction, emergency rescue and other operation scenarios. With the commercialization and popularization of 5G communication, operation machinery has begun to realize the remote control function. Operators can perceive the operation status of the operation machinery by observing the video of the operation machinery on-site operation. And according to the operation status, the operation machine can be operated remotely. [0003] In the prior art, in order to realize the remote operation of the operation machinery, multiple cameras are usually installed on the operation machinery to collect the environmental video of the operation site, and after uploading it back to the monitoring center, based...

AI Technical Summary

Problems solved by technology

[0004] The present invention provides an auxiliary image generation method, a remote control method and a device thereof for an operating machine, which are use

Images