Non-contact robot human-robot interaction system based on multi-sensor integration

Abstract

The invention provides a non-contact robot human-robot interaction system based on multi-sensor integration. The non-contact robot human-robot interaction system comprises a multi-channel surface myoelectricity sensor, an inertia measurement unit, a microprocessor measurement control device, a data communication device, Kinectsomatosensory equipment, vibration feedback equipment and a PC terminal.Multiple sensors are integrated, a robot can be directly controlled through motions of the arm and the hand of an operator, requirements of space constraint and operating techniques of the operator are effectively lowered, and naturalness of human-robot interaction is effectively improved; a robot virtual scene based on a Unity3D game engine is constructed, the motion state of the robot can be rendered in real time, and the operator is assisted in quickly adjusting the motions, so that the operator visually senses the remote operating process; the vibration feedback equipment is added, vibration feedback is provided for the operator in a key time point of the remote operating process, the human-robot efficacy of the system can be improved, and meanwhile, the safety and reliability of a remote operation are improved.

Description

technical field [0001] The invention belongs to the technical field of robots, and relates to a non-contact robot human-computer interaction system based on multi-sensor fusion. Background technique [0002] With the increasing desire of human beings to explore a wider range of unknown nature, and the concept of protecting their own safety is gradually increasing, in a series of operating environments such as aerospace, satellite remote sensing and telemetry, deep sea exploration, and nuclear energy development, the operating environment is harsh or must be manipulated at a long distance. In all fields of operation, a system for remotely controlling robots to perform operations is required. The realization of robot teleoperation system greatly changes the way of robot operation and expands the operation ability of robot, so that people can control it locally without directly appearing in the robot operation environment. [0003] The main function of the robot teleoperation ...

AI Technical Summary

Problems solved by technology

Traditional interactive devices (such as keyboards and hand controllers, etc.) generally require the operator to adapt to the device, the operation method is mechanical, the range of motion is limited, and the interaction process is unnatural

Images