3868 results about "Human–robot interaction" patented technology

The invention discloses a mechanical equipment state monitoring method and system based on multiple sensors, and the method comprises the five core steps: multi-modal data collection and preprocessing, dynamic feature fusion, adaptive threshold diagnosis, digital twin fault tracing and predictive maintenance decision. All-domain coverage of equipment is realized through a three-layer sensor network architecture, the problems of data synchronization and interference resistance are solved by utilizing a temperature and vibration integrated sensor, deep fusion and anomaly detection of multi-source data are realized in combination with an attention mechanism, a Gaussian mixture model, a three-dimensional convolutional neural network and the like, and finally a precise maintenance strategy is generated through digital twinning and reinforcement learning. The multi-sensor-based mechanical equipment state monitoring system comprises a sensor network layer, an edge computing layer, a cloud platform layer and a man-machine interaction layer, supports federated learning to protect data privacy, improves real-time diagnosis capability through edge-cloud collaboration, and enhances a reality interface to realize intelligent operation and maintenance interaction.

The invention relates to the technical field of man-machine interaction, in particular to a robot behavior mode dynamic adjustment method based on multi-mode perception, which comprises the following steps: S1, collecting a visual image, a voice signal and an environment parameter of a target scene in real time; s2, extracting each modal feature; s3, dynamically allocating weights, and generating a fusion feature vector; s4, identifying a current scene type and a user attribute; s5, matching a corresponding interaction mode from a preset strategy library based on the scene type and the user attribute identified in the step S4; and S6, executing the matched interaction mode in the S5, and updating the weight distribution rule according to the feedback data. According to the method, vision, voice and environment characteristics are fused through a multi-mode perception technology, the behavior mode of the robot is dynamically adjusted based on a self-adaptive weighted fusion algorithm, and the interaction strategy is optimized in combination with user feedback, so that the interaction accuracy and the intelligent level of the robot under different scenes and user attributes are improved.

The invention discloses a robot anthropomorphic interaction method based on multi-modal emotion recognition and customized portrait generation. The method comprises the following steps: S1, dynamically fusing multi-modal emotions; the method comprises the following steps: S1, synchronously acquiring voice, visual and text signals through a multi-source heterogeneous sensor, capturing a user voice stream by a high-fidelity microphone array, and extracting acoustic characteristics such as intonation and speed, S2, performing cross-modal reasoning; s3, synchronously generating contents; step S4: style migration; step S5, anthropomorphic voice and expression generation; according to the method, man-machine interaction emotion is analyzed and generated by utilizing a large language model and multi-modal information fusion, the singleness of interaction emotion and the deficiency of emotional sharing ability are avoided, a strong emotion interaction characteristic is achieved, the image of the robot is obtained through a generative technology and can be migrated to any image, the limitation that a specific image is independently made is broken through, and the interaction effect of the robot is improved. The advantage that one robot can be suitable for different scenes is achieved.

The invention discloses a multi-screen voice interaction system and method applied in an automobile cabin, and relates to the technical field of vehicle-mounted intelligent interaction, and the system comprises a voice collection unit which is used for carrying out sound source positioning and collection, carrying out the noise reduction processing of a collected voice signal, extracting features from the processed voice signal, and generating a voice feature vector; the multi-modal sensing unit is used for collecting behavior information and physiological state data of a driver and passengers through multi-sensor fusion, so as to extract multi-modal information; the man-machine interaction unit is used for carrying out space-time modeling on the multi-modal information to generate a scene state vector; and the cooperative scheduling unit is used for realizing multi-screen intelligent distribution and cooperative control. According to the invention, voice instructions of a driver and passengers can be accurately identified, the safety and experience of the driver are improved, changes in different driving environments are dynamically adapted, the operation efficiency and user experience of a vehicle-mounted system are improved, and the intelligence and adaptability of the system are improved.

The invention relates to the technical field of artificial intelligence rescue, and discloses an unmanned aerial vehicle and robot dog rescue emergency system and method, and the system comprises an unmanned aerial vehicle cluster module which is used for air data collection, communication guarantee and emergency material distribution; the robot dog cluster module is used for ground environment detection, sample collection and special task execution; the communication cooperation module is used for ensuring information intercommunication and task cooperation between air-ground equipment; the central control module provides task instructions for the unmanned aerial vehicle cluster and the robot dog cluster; the human-computer interaction interface module is used for realizing effective communication between rescue workers and the system; the modules work cooperatively, multi-source data acquisition, three-dimensional scene reconstruction, semantic segmentation, risk assessment, fire spreading prediction and decision support information generation of a disaster site are realized, and a reliable basis is provided for rescue command decision.

The invention relates to the technical field of tunnel engineering construction, and discloses an intelligent material transportation and safety monitoring system and method for shield construction, and the system comprises a visual perception unit, a sensor network module, an AI analysis center module, a safety decision module and a human-computer interaction interface. According to the invention, data acquisition is carried out through the visual perception unit and the sensor network module, multi-target detection operation is carried out on image frames through the AI analysis center module after target identification and track prediction, target types, space coordinates, contour boundaries and confidence coefficients are identified and extracted, and safety judgment and early warning output are carried out. According to the invention, by integrating the multi-view camera equipment and the UWB, GNSS and other sensors and adopting a deep learning target detection algorithm, high-precision identification and continuous tracking can be carried out on construction site personnel, equipment, segments and other key objects, and accurate input is provided for subsequent risk analysis.

The invention relates to the technical field of unmanned aerial vehicle cluster control, and particularly discloses an intelligent cooperative flight path planning method and system for an unmanned aerial vehicle cluster system, and the method comprises the steps: firstly constructing a dynamic environment perception model, collecting data through all unmanned aerial vehicle sensors, and carrying out the preprocessing, attention feature extraction and federal learning fusion, and generating a global environment situation map; planning and screening a candidate track set by adopting a particle swarm-genetic hybrid optimization algorithm for adaptive weight adjustment on the basis of the image; a global optimal track consensus is achieved through an improved consensus algorithm and conflict resolution through a distributed collaborative negotiation mechanism and no human-computer interaction evaluation indexes; and finally, monitoring the environment in real time during execution, triggering dynamic re-planning when the environment is abnormal, and ensuring track adaptation through multi-level threshold and incremental planning. According to the method, the unmanned aerial vehicle cluster can quickly respond to the environment change and adjust the flight path, so that the task execution efficiency and success rate of the unmanned aerial vehicle cluster in the complex dynamic environment are improved.

The invention relates to the technical field of medical rehabilitation, and discloses a lower limb weight-bearing gait rehabilitation training system which comprises a data acquisition module, a data processing and analysis module, a patient individualized modeling module, an intelligent decision and control module, a rehabilitation execution module and a man-machine interaction and medical information interface module which are in communication connection through a network. The data acquisition module is used for acquiring multi-modal data of a patient in real time, and the multi-modal data comprises static sign data, dynamic physiological parameters, kinematics and dynamics parameters and non-motion physiological and psychological state data; and the data processing and analysis module is used for carrying out preprocessing, feature extraction and deep analysis on the original data, and outputting a structured patient individualized feature vector and an evaluation result. According to the invention, a patient three-dimensional skeletal muscle digital twinborn model is constructed through the patient individualized modeling module, and in combination with a continuous learning intelligent model library, body sign differences of different patients can be accurately adapted.

The invention relates to the field of man-machine interaction training, virtual reality and intelligent evaluation, and particularly discloses a psychological exercise ability training method and system based on mixed reality and behavior analysis. The method comprises the steps that a multi-scene psychological training environment is constructed and presented in mixed reality equipment, action behavior data, eye movement path data and operation response time data of a pilot in the training process are collected, multi-modal original behavior characteristics are constructed, and then a psychological exercise ability label set is constructed; and realizing capability-task modeling through matching of a capability label and a task structure, generating a personalized training path and a capability difference atlas based on difference analysis with a preset capability standard, adjusting task parameter configuration data, dynamically updating a training scene, generating a capability evolution trajectory, and outputting a training analysis result. In this way, accurate ability modeling, task dynamic adaptation and visual tracking of the training effect can be achieved, and the individuation and intelligence level of psychological exercise ability training is remarkably improved.

The invention provides an interaction method, system and device and a medium, and relates to the technical field of man-machine interaction, and the method comprises the steps: obtaining an interaction process of a main control agent and a target user in a current round of interaction process according to the intention information and state information of the target user in the current round of interaction process; according to the interaction process, controlling an execution agent to perform response operation on current input information to obtain a response operation result of the current input information; the current input information is information input by the target user in a current round of interaction process; and outputting response information corresponding to the current input information according to the response operation result. According to the method, the interaction process and the dialogue content are flexibly adjusted according to the real-time intention and the real-time state of the user, and the fluency, naturalness and adaptability of interaction, the efficiency and real-time performance of interaction processing and the user experience feeling are remarkably improved.

The invention provides an intelligent interactive question and answer method and system based on multi-modal large model intention recognition, and relates to the technical field of intelligent question and answer, and the method comprises the steps of feature extraction, cross-modal semantic mapping, intention matching, key information extraction and response generation, achieves the unified processing of multi-modal information, can accurately recognize the intention of a user, and improves the user experience. And the association network is dynamically constructed to extract key information, so that the accuracy and semantic coherence of intelligent questions and answers are improved, and the man-machine interaction experience is enhanced.

The invention discloses an industrial robot intelligent control system which comprises a master control terminal, the master control terminal is provided with an industrial-grade multi-core processor and is integrated with a motion control subsystem and an environment sensing subsystem, the motion control subsystem is connected with the master control terminal through a first communication interface, and the environment sensing subsystem is connected with the master control terminal through a second communication interface. According to the motion control subsystem, a distributed axis controller array and reinforcement learning strategy switching algorithm is adopted, so that the trajectory tracking precision and the energy consumption efficiency are improved; and the environment sensing subsystem realizes real-time anomaly detection through multi-mode sensor fusion and an LSTM-GAN fault prediction model. The system supports containerized deployment and edge computing collaboration and integrates AR human-computer interaction, and the adaptive capacity and safety of the industrial robot are remarkably improved.

The invention discloses a lower limb exoskeleton gait track prediction method based on an LSTM-KAN fusion model, and the method comprises the steps: collecting human motion data through a sensor assembly, and carrying out the filtering, missing value processing and normalization of the human motion data; then constructing an overall architecture of a prediction model based on an LSTM-KAN network, optimizing parameters of the prediction model by using a particle swarm optimization (PSO) algorithm, extracting key features in the preprocessed data as a training data set, and inputting the training data set into the prediction model for training; and finally, collecting current human body motion data, pre-processing the current human body motion data, inputting the pre-processed current human body motion data into the trained prediction model, and outputting future human body gaits and tracks by the prediction model. And the controller takes a future gait track generated by the prediction model as a reference track to generate a driving signal and sends the driving signal to the actuator so as to realize accurate control of the actuator. By adopting the gyroscope sensor, the acceleration sensor and the pressure sensor for gait estimation, exoskeleton motion control can be effectively improved, and man-machine interaction experience is effectively improved.

The invention relates to the technical field of intelligent man-machine interaction, and discloses a customized virtual pet interactive simulation method, which comprises the following steps: S1, perceiving the emotional state of a user, S2, analyzing the behavior and emotion of the user, S3, establishing a virtual pet behavior model, and S4, establishing a virtual pet interaction model. The invention provides a customized virtual pet interactive simulation system, which comprises a sensing module, a decision-making module, an execution module and a feedback module. The method comprises the following steps: S1, selecting a virtual pet behavior, S2, selecting an optimal behavior, S5, carrying out deep reinforcement learning optimization, S6, executing the virtual pet behavior, and S7, feeding back and adjusting a behavior strategy. The invention also provides the customized virtual pet interactive simulation system, which comprises a sensing module, a decision-making module, an execution module and a feedback module. Through long-term emotional state tracking, personalized behavior pattern recognition and long-term reward correction of reinforcement learning, the virtual pet can continuously optimize a behavior strategy, dynamically adapt to long-term emotional changes of a user, and improve the personalized matching degree and long-term stability of interaction.

The embodiment of the invention provides an excavator handle control system for remote operation, a handle control method based on a Hall sensor is adopted, non-contact rocker data sensing is achieved, the influence of contact and movement abrasion on the service life of a handle is reduced, and the excavator handle control system has the advantages of being high in sensitivity and good in performance; the handle mechanism is more flexible to operate, and the service life of the handle is prolonged; a two-hand cooperative control mode is adopted, and two three-degree-of-freedom handles are used for simulating the driving environment of a real excavator, so that a good remote control effect is achieved, and the feeling of presence of an operator in the remote operation process is improved; the operation habits of a driver are fully considered, the walking and working of the excavator are respectively controlled through combination of different degrees of freedom of the left hand handle and the right hand handle, an operating lever of the real excavator is simulated in the aspects of structure, motion degree of freedom and working range, and the man-machine interaction environment of excavator driving is restored.

The invention relates to the technical field of computer vision, and discloses a high-speed human motion trail motion mode recognition system. Through multi-modal sensor fusion and an adaptive space-time attention network (ASTAN), the problems that a traditional optical system depends on mark points and IMU accumulative errors exist are effectively solved, and the high-speed movement track reconstruction precision and the environmental adaptability are remarkably improved; self-supervised data enhancement and dynamic model compression technologies are combined, so that the dependence on labeled data is greatly reduced, lightweight edge deployment is realized, and the real-time requirement is met; the system can synchronously output multi-mode feedback instructions, supports multi-scene application such as sports action correction, medical rehabilitation evaluation, security and protection anomaly detection and man-machine interaction control, and solves the core pain points of insufficient precision, real-time performance, robustness and generalization ability in the prior art. And an efficient, reliable and low-cost comprehensive solution is provided for high-speed motion analysis.

The invention provides an intelligent spraying composite robot system based on a large language model and a method thereof, and relates to the field of intelligent robots and automatic spraying, the intelligent spraying composite robot system comprises a chassis, a mechanical arm, a spraying gun, a camera, an instruction receiver and a controller; a mechanical arm and an instruction receiver are carried on the chassis; spray guns and cameras are mounted on the mechanical arms; the instruction receiver receives a natural language voice instruction, analyzes semantics through a large language model, and generates an action instruction; the controller comprises a motion control module, a three-dimensional point cloud data acquisition module, a feature point extraction module, a track planning module and a spraying operation module; the method improves the man-machine interaction, reduces the use threshold of the robot, is easy to operate, gives play to the spraying advantages of the composite robot, does not need to program in mainstream offline simulation software, can generate a spraying path with adjustable and controllable parameters only by collecting the point cloud template of the workpiece and selecting the feature points, and can be widely applied to furniture, furniture and the like. And spraying operation in the fields of automobiles, aerospace and the like.

The invention discloses a depression risk screening optimization method based on large and small model linkage. The method comprises the following steps: selecting depression related indexes, obtaining interviewee questionnaire data, and preprocessing the data to obtain a scale source database; a depression risk prediction model is constructed, and PHQ-9 measurement results are compared for model training and verification; training a dialogue strategy module of a semantic analysis enhanced fine-tuning training large language model, constructing answer mapping through dynamic question generation and dialogue flow control, and converting a natural language of a user into standardized data required by a small model; training a man-machine interaction reinforcement learning model, generating a depression risk screening result based on a small model, inviting a user to carry out recognition degree evaluation, and dividing feedback into two types of recognition and question; for different feedbacks, strengthening or correcting the current interaction strategy and prediction logic, and storing the audited data as high-quality data to a training database by the system for subsequent large model fine tuning; and outputting a result and performing result interpretation and suggestion by using the semantic analysis reinforced fine-tuning large language model. Hierarchical early screening of depression risks is carried out based on large and small model linkage.

The invention relates to the technical field of medical rehabilitation, and particularly discloses an anorectal postoperative rehabilitation nursing evaluation method and system based on a sensor. According to the scheme, the system comprises a multi-source physiological information sensing module, a data preprocessing and feature extraction module, a multi-modal data fusion analysis module, a dynamic risk assessment and early warning module and a man-machine interaction and decision support module, multi-dimensional physiological signals are continuously collected, a rehabilitation state index is generated through fusion, the complication risk is assessed in real time, and the rehabilitation effect is improved. Early warning and accurate nursing decision support are realized, and comprehensiveness and timeliness of rehabilitation evaluation are improved.

The invention provides a robot control method, computer equipment and a computer readable storage medium, and the method comprises the steps: obtaining multi-modal data of a user, the multi-modal data comprising attitude data, sound data and force control data; performing feature extraction and fusion processing on the multi-modal data to obtain multi-modal fusion features; according to the environment information of the area where the robot is located and historical interaction data of the robot, context information of man-machine interaction is determined; and according to the multi-modal fusion features and the context information, a response strategy is generated, and the robot is controlled to move according to the response strategy, so that the naturalness and accuracy of man-machine interaction are improved.

The invention relates to the technical field of physical training intellectualization and man-machine interaction, in particular to an interactive physical education method and system based on augmented reality driving, and the method comprises the following steps: S1, collecting three-dimensional motion track data and muscle activation time sequence data; s2, generating kinematic deviation parameters and physiological deviation parameters; s3, generating an AR correction instruction set containing a joint pose correction vector and a muscle activation intensity adjustment suggestion based on the kinematics deviation parameter and the physiology deviation parameter; s4, projecting the AR correction instruction set to the field of view of the trainee in real time through AR display equipment; and S5, generating a physical education efficiency report containing the action precision improvement index and the neuromuscular control optimization scheme. According to the intelligent physical education system, by fusing multi-source motion perception, deviation analysis and AR visual correction, synchronous optimization of motion precision and neuromuscular control ability is realized, and an intelligent physical education system with real-time interaction characteristics is constructed.

The invention relates to the technical field of multi-modal posture recognition, and relates to a multi-modal posture recognition system based on Transform fusion, which fully excavates the complementary advantages of visual information in spatial detail representation and inertial information in time sequence dynamic capture through space-time alignment of multi-modal data and deep fusion based on an attention mechanism. The accuracy and the stability of attitude estimation under the conditions of visual occlusion, rapid movement and complex illumination are obviously improved; posture optimization is carried out by introducing physical constraints such as bone length constancy and joint movement range limitation, and time domain smoothing and contact state correction are applied, so that the precision of the generated three-dimensional posture sequence is ensured, a solid technical foundation is laid for improving the naturalness, safety and intelligent level of man-machine interaction, and the method is suitable for popularization and application. And meanwhile, reliable application and deep development of the intelligent robot in key fields of service robots, virtual reality, remote cooperation and the like are powerfully promoted.

The invention relates to the technical field of medical equipment, in particular to an ultrasonic soft tissue operation accessory intelligent recognition and energy regulation and control system and method.The ultrasonic soft tissue operation accessory intelligent recognition and energy regulation and control system comprises an intelligent recognition module used for recognizing the type, specification and real-time use state of an operation accessory to serve as an output result; the energy regulation and control module is connected with the intelligent identification module and dynamically adjusts the output parameters of the ultrasonic energy according to the output result of the intelligent identification module; and the man-machine interaction module is respectively connected with the intelligent identification module and the energy regulation and control module and is used for displaying the identification result, the energy parameters and the early warning information. According to the result of the intelligent recognition module, dynamic adjustment of ultrasonic energy output parameters is achieved through the energy regulation and control module, and smooth operation is ensured; when it is detected that the accessory temperature exceeds the preset threshold value or the impedance abnormally and suddenly rises, energy supply is rapidly cut off, the surgical risk caused by energy abnormity is effectively prevented, and the safety of a patient is guaranteed.

The invention provides a multichannel gas ultrasonic flowmeter, which relates to the technical field of flow measurement and comprises a hardware layer and a software layer, the hardware layer comprises a pipeline, a connecting mechanism, a multichannel ultrasonic transducer, a pressure sensor, a temperature sensor, a wiring terminal box and a control box with an LCD display screen; the software layer comprises a data acquisition module, a preprocessing module, a multichannel speed measurement module, a data fusion module, a dynamic parameter compensation module, a flow calculation module, a man-machine interaction module, a communication module and a storage module. Pipeline section flow velocity information is collected through a multichannel ultrasonic transducer array, and a complex flow state is fitted in combination with a weighted fusion algorithm; the flow is dynamically compensated and corrected based on pressure and temperature; reliable operation of the system is guaranteed by means of hardware redundancy and a software verification diagnosis mechanism, the problems that a traditional flowmeter is low in measurement precision and poor in working condition adaptability are solved, and high-precision and stable gas flow measurement is achieved.

The invention discloses an Android system user interface interaction method and device based on a large language model, and relates to the technical field of intelligent man-machine interaction, and the method comprises the steps: receiving a natural language instruction of a user, and synchronously capturing a real-time interface state of a current Android screen to generate a structured context containing semantic information of interactive elements; inputting the instruction and the context into a large language model, and generating a hierarchical task plan formed by a plurality of atomic operations with a logic dependency relationship; based on a dynamic adaptation mechanism, converting the atomic operation sequence into an operation instruction which can be executed by the Android system; receiving interface change information after instruction execution, and feeding back the interface change information as a new round of context to the large language model to determine a task execution state; and finally generating natural language feedback information to the user according to the execution state. By means of the mode, complex cross-application tasks can be understood and executed, and interaction intelligence of the Android system is remarkably improved through real-time interface perception and dynamic planning adjustment.

The invention discloses a heterogeneous robot control method and system based on an extensible command library, electronic equipment and a storage medium, and the method comprises the steps: dividing a plurality of different types of commands from the angle of robot commands, and defining a unique code for the commands; constructing a hardware-independent command library on the to-be-executed command queue according to the unique code of each command; constructing a command mapping table according to the code of each command under the to-be-executed command queue, and expanding according to the command codes based on the commands to form a command library related to the robot; based on man-machine interaction of a large model, a specific command to be executed by a user is recognized through semantic understanding and command recognition, and then the recognized command is sent to a to-be-executed command queue from a hardware-independent command library through command execution management; and monitoring a to-be-executed command independent of the robot in real time, mapping a command irrelevant to hardware into a specific command of the robot through a robot related command library, and executing the specific command of the robot at the same time.

The invention discloses a surgical operation system with a training or auxiliary function, particularly relates to the field of intelligent surgical operation systems, and cooperatively works through five modules including multi-modal sensing, layered AI decision making, dynamic feedback, closed-loop learning and an expansion interface. MEMS pressure sensing and biological signal fusion sensing are adopted, strategic layer three-dimensional navigation and execution layer magneto-rheological damping control are combined, and an operation whole-process optimization system is constructed; a multi-source data persistent evolution model is integrated through federal learning, and precise man-machine interaction is realized by matching eye movement tracking AR and a variable stiffness touch glove. According to the system, the intraoperative risk identification accuracy is improved, the operation efficiency is improved, third-party equipment extension and doctor skill quantitative evaluation are supported, and the operation safety and the training standardization level are remarkably improved.

The invention provides a robot social adaptive navigation knowledge learning and migration method and system, and relates to the field of mobile robot navigation. Aiming at the problems that an existing path planner lacks time sequence memory and neglects pedestrian social intent, a man-machine co-fusion scene is constructed, a training set containing an expert demonstration path is made, and a recursive generation model is input; designing a recurrent neural network embedded RRT, generating an RNN-RRT planner, and fusing historical information and pedestrian convergence probability in training; new scene loading training parameters are finely adjusted to realize knowledge migration, loss convergence or output RNN final parameters after reaching a preset round number. According to the method, the path anthropomorphism and generalization ability are improved, and the method is suitable for complex human-computer interaction scenes.

The invention relates to the technical field of robot control and somatosensory interaction, and particularly discloses a knee joint exoskeleton robot control system based on somatosensory interaction. The system comprises a somatosensory signal acquisition and fusion module, a personalized dynamic model construction module, an adaptive intention decision module, a variable impedance compliance control module and a rehabilitation process evaluation and parameter self-tuning module. Through cooperative work of the modules, precise recognition of the motion intention of a wearer, online construction of an individualized biomechanical model and flexible and adaptive motion control are achieved, control parameters can be automatically adjusted according to the rehabilitation process, and therefore the flexibility and individuation level of man-machine interaction and the effectiveness of rehabilitation training are improved.

The present invention relates to the field of robotic arm teleoperation technology, and specifically to a construction method and system for real-time teleoperation of a dual arm and hand robot based on vision guidance, which includes setting up a first experimental platform, acquiring pose information of the dual arm and hand robot and a homogeneous transformation matrix of an end joint and transforming a first coordinate system; setting up a second experimental platform; performing calibration by a plurality of cameras and transforming a second coordinate system; obtaining spatial transformation pose information of the end joint of the robotic arm under a tracking state, reading finger pose data, and performing real-time following. The real-time teleoperation system of the present disclosure includes a control system host, an operation glove, an optical locator, a positioning coordinate plate, a marker ball tool, and a dual arm and hand robot. The present disclosure introduces a method of identifying the marker ball tool by the optical locator into the teleoperation control of the dual arm and hand robot, which is more accurate and faster. Meanwhile, the method of remotely controlling the robotic arm by an operator wearing the operation gloves can provide better human-machine interaction function.