2results about How to "Enhanced presence" patented technology

The embodiment of the invention provides an excavator handle control system for remote operation, a handle control method based on a Hall sensor is adopted, non-contact rocker data sensing is achieved, the influence of contact and movement abrasion on the service life of a handle is reduced, and the excavator handle control system has the advantages of being high in sensitivity and good in performance; the handle mechanism is more flexible to operate, and the service life of the handle is prolonged; a two-hand cooperative control mode is adopted, and two three-degree-of-freedom handles are used for simulating the driving environment of a real excavator, so that a good remote control effect is achieved, and the feeling of presence of an operator in the remote operation process is improved; the operation habits of a driver are fully considered, the walking and working of the excavator are respectively controlled through combination of different degrees of freedom of the left hand handle and the right hand handle, an operating lever of the real excavator is simulated in the aspects of structure, motion degree of freedom and working range, and the man-machine interaction environment of excavator driving is restored.

The application discloses a kind of robot teleoperation systems based on visual positioning and virtual reality technology, including robot located in remote space, depth camera and scene reconstruction system, robot includes robot control system and robot execution system;Virtual reality device and virtual engine located in local operating space;Scene reconstruction system generates remote robot work scene;Virtual engine is connected with virtual reality head-mounted display and handheld controller, it generates virtual robot according to actual robot size, and generates initial virtual robot work space based on the three-dimensional point cloud information of remote robot work scene and the initial pose data of robot work object;It changes virtual robot pose and virtual robot work space according to the control signal of handheld controller.The application realizes the three-dimensional reconstruction of remote environment based on point cloud and 6D pose estimation algorithm, and feeds back to operator by virtual reality device, avoids the delay of point cloud continuous transmission.