4results about How to "Enhanced presence" patented technology

The embodiment of the invention provides an excavator handle control system for remote operation, a handle control method based on a Hall sensor is adopted, non-contact rocker data sensing is achieved, the influence of contact and movement abrasion on the service life of a handle is reduced, and the excavator handle control system has the advantages of being high in sensitivity and good in performance; the handle mechanism is more flexible to operate, and the service life of the handle is prolonged; a two-hand cooperative control mode is adopted, and two three-degree-of-freedom handles are used for simulating the driving environment of a real excavator, so that a good remote control effect is achieved, and the feeling of presence of an operator in the remote operation process is improved; the operation habits of a driver are fully considered, the walking and working of the excavator are respectively controlled through combination of different degrees of freedom of the left hand handle and the right hand handle, an operating lever of the real excavator is simulated in the aspects of structure, motion degree of freedom and working range, and the man-machine interaction environment of excavator driving is restored.

The application relates to the technical field of brain-computer interfaces, in particular to a proxy existence type robot control system and method. The system comprises a multi-modal brain and electromyography acquisition and analysis module, which is used for acquiring brain electrical signals and electromyography signals of a user, and performing data processing and intention recognition on the brain electrical signals and electromyography signals to generate a control intention; a control execution module, which is used for mapping the control intention into a control instruction executable by a robot to drive the robot to execute a corresponding action; an extended reality perception feedback module, which is used for acquiring environment perception data of a first visual angle of the robot and a first visual angle of the user to construct a two-way spatial mapping of a remote physical environment where the user and the robot are located, and provide immersive visual feedback to the user; and a communication interface module, which is used for realizing two-way data communication. The application can realize high-immersion, low-delay and high-reliability proxy existence type robot operation in a complex, dynamic or dangerous environment.

The application discloses a kind of robot teleoperation systems based on visual positioning and virtual reality technology, including robot located in remote space, depth camera and scene reconstruction system, robot includes robot control system and robot execution system;Virtual reality device and virtual engine located in local operating space;Scene reconstruction system generates remote robot work scene;Virtual engine is connected with virtual reality head-mounted display and handheld controller, it generates virtual robot according to actual robot size, and generates initial virtual robot work space based on the three-dimensional point cloud information of remote robot work scene and the initial pose data of robot work object;It changes virtual robot pose and virtual robot work space according to the control signal of handheld controller.The application realizes the three-dimensional reconstruction of remote environment based on point cloud and 6D pose estimation algorithm, and feeds back to operator by virtual reality device, avoids the delay of point cloud continuous transmission.

This application discloses a video frame processing method, apparatus, and storage medium, belonging to the field of video processing technology. The method may include: acquiring a first video frame and its depth information; determining a target object region in the first video frame; determining the content attributes of each sub-region in the region other than the target object region in the first video frame; determining a depth reference plane based on the depth information, wherein the spatial position of the depth reference plane corresponds to the depth position of the target object region in the first video frame; performing differential blurring on the region other than the target object region in the first video frame to obtain a processed first video frame; and outputting the processed first video frame. In the differential blurring, sub-regions in the region that have the same depth distance to the depth reference plane but different content attributes are subjected to different degrees of blurring. In the differential blurring, the degree of blurring of each sub-region is jointly determined by the depth distance of the sub-region to the depth reference plane and the content attributes of the sub-region.