420 results about "Tele operation" patented technology

A system comprises a processor and a memory having computer readable instructions stored thereon, which, when executed by the processor, cause the system to display an image of a surgical environment. The image includes an information icon corresponding to an instrument in the surgical environment. The instructions further cause the system to display an image of a body part of a user. The image of the body part is used to interact with the information icon. The instructions further cause the system to receive a gesture of the body part, via a gesture-based input device registering movement of the body part, to cause the image of the body part to interact with the information icon. The instructions further cause the system to display an information menu in the image of the surgical environment based on the interaction between the image of the body part and the information icon.

The invention discloses a device capability distributed cooperation method and system based on an open source gap system, and the method comprises the steps: building a discovery mechanism in a target main device with the open source gap system, and detecting peripheral devices through the built-in discovery mechanism in the target main device, based on the distributed capability of the open-source gap-Mongolia system, a galaxy network is established by a plurality of devices; identifying a preset operation mode of a user, pulling up an atomization service according to an identification result, supporting seamless circulation of the atomization service among different devices through the galaxy network, and performing real-time sharing of data; images or information from different devices are displayed on a distributed screen, and remote operation is carried out on the robot in the galaxy network through a distributed control technology; and monitoring the equipment state and the service operation condition in real time, automatically scheduling resources according to a preset rule so as to respond to an abnormal condition, and taking corresponding recovery measures. According to the invention, efficient collaboration and data sharing among equipment are realized.

Systems and methods that allow robots to perform tasks for users are provided. A robot may comprise one or more robotic arms and / or a mobile base. The arms may be controlled by electric actuators and may have six or more degrees of freedom. The robot may have sensors which can be accessed remotely. Robots may have varying levels of autonomy, including, for example, full teleoperation (in which a human can have detailed control over the robot) or full autonomy (in which the robot can complete a task without any human intervention). Various entities can interact with individual robots or groups of robots over a network, locally, directly or in person, or any combination thereof. A management system can allow entities to control and / or monitor the robots.

A teleoperations system may be used to generate virtual paths of travel for an autonomous vehicle based upon teleoperations system-provided suggestions, and virtual path suggestion constraints, e.g., based upon physical constraints associated with an autonomous vehicle such as minimum turning radius, trailer sweep, and the like, may be used assist in guiding a teleoperations system operator during generation of virtual path suggestions.

The invention provides a robot system based on self-adaptive cruise and remote operation and a control method thereof, and belongs to the field of robot inspection, the system comprises a six-axis mechanical arm, an intelligent inspection robot, an automatic inspection task module and a remote teleoperation control unit; the intelligent inspection robot carries a six-axis mechanical arm and an automatic inspection task module, the automatic inspection task module comprises a preset inspection task, the remote teleoperation control unit sends a control instruction of an operator to the intelligent inspection robot through wireless communication, and the control instruction comprises inspection path planning and operation tasks. The intelligent inspection robot performs an inspection task according to a preset inspection task of the automatic inspection task module or a control instruction sent by the remote operation control unit, and the six-axis mechanical arm is used for executing a target operation task. Through integration of advanced sensor technology, image processing technology, artificial intelligence algorithm and wireless communication technology, efficient, accurate and safe inspection of a complex environment is realized.

The invention discloses a flexible robot motion control system and method based on a visual language action model, and the system comprises visual sensors which are disposed at a plurality of joints of a flexible robot, and are used for observing the multi-joint sensing information of the flexible robot; the remote voice input unit is installed on the flexible robot body and used for inputting a voice instruction of remote operation to the flexible robot; the motion control module based on the VLA framework is mounted in the flexible robot and used for controlling the flexible robot to act based on a visual language action model according to the multi-joint sensing information and the voice instruction; through the design of the intelligent control system, the complexity of the system is remarkably reduced, the control precision and flexibility are optimized, the coordination control problem of complex body segment units is solved, high-performance autonomous motion control is achieved, the system cost is reduced, the adaptability of the robot in diversified environments is enhanced, and the robot can be widely deployed in complex application scenes.

The invention provides an interactive tactile glove system for astronaut training. The interactive tactile glove system comprises an upper computer virtual environment, a lower computer tactile perception glove and a tactile representation glove. The touch sensing glove is used for collecting temperature, humidity and pressure information of a hand and transmitting the information to the upper computer for processing through Bluetooth. The upper computer virtual environment is built based on a Unity 3D platform, various task scenes can be simulated, and corresponding tactile feedback signals are generated and transmitted. The tactile representation glove receives data transmitted by a virtual environment or the tactile perception glove, and real-time representation of temperature, force feedback and motion postures is achieved through an integrated semiconductor cooler, a vibration element, a bending sensor and other assemblies. According to the system, multi-modal tactile feedback can be provided in single astronaut fine operation training and cooperative operation of multiple astronauts, and the training effect and team adaptability are improved. The system not only has high integration level and stability, but also can provide multi-level and multi-mode tactile simulation according to task requirements, and is suitable for accurate training and remote operation in a complex task environment.

Automatic bond on techniques for remote operations on energized power lines are disclosed. A remote assembly may comprise a robot unit and a jib. The jib may have an end effector at a distal end, a proximal end coupled to the robot unit, and an insulating section between the distal end and the proximal end. The end effector may couple to the energized power line, and the insulating section may electrically isolate the robot unit from the energized power line. An actuator at the proximal end may be selectively actuatable to electrically connect to the end effector, thereby electrically bonding the robot unit to the energized power lines to enable operations on energized power line components. The jib may toggle the robot unit between the electrically bonded and grounded or floating states to allow the robot unit to operate on both grounded and energized components.

The invention relates to the technical field of humanoid robot control. The invention provides a humanoid robot bilateral force feedback teleoperation method of a force compensation mechanism. According to the method, a 5G private network is used for deployment, the characteristics of low delay, high reliability and large bandwidth of the 5G private network are utilized, real-time interaction of high-dimensional haptic data in a remote and cross-domain environment is effectively supported, cross-domain teleoperation can be achieved, high-fidelity feedback transmission of environment contact force is effectively achieved, and the real-time interaction of the high-dimensional haptic data in the remote and cross-domain environment is achieved. The precision, the operation efficiency and the overall safety of remote operation of the humanoid robot in complex industrial scenes such as nuclear power maintenance, precise assembly and high-risk environment operation are remarkably improved, the gap between traditional automation and low-efficiency remote operation is filled up, and reliable technical support is provided for advanced industrial application needing man-machine cooperation fine force control.

The disclosure provides devices, systems, and methods for physical therapy. Electrical signals are applied to a subject via electrodes in a device worn on the body part receiving the therapy. The device can be operated remotely. The device can use artificial intelligence to evaluate and design physical therapy routines using the electrodes.

Surgical robot systems for remote manipulation having robotic telemanipulators are provided. The surgical robot systems are well adapted for use by the surgeon, seamlessly integratable into the operation room, allow for a surgeon to work between the robot and the patient throughout a surgery in a sterile manner, are relatively low cost, and / or permit integrated laparoscopy. The system preferably includes a master console having a plurality of master links interconnected by a plurality of master joints, and a handle coupled to the master console for operating the telemanipulator. The system further includes a slave console operatively coupled to the master console and having a plurality of slave links interconnected by a plurality of slave joints that move responsive to movement at the master console to permit an end-effector to perform surgery.

Provided herein is a control system and methods thereof for controlling operation of a robot. The control system comprises: a robot, including a plurality of sensors wherein each generating a stream of raw sensor data having a data type, size, and frequency, and a plurality of actuators cause movement of the robot; an autonomous control subsystem configured to receive the sensor data and output autonomous actuator data; and a teleoperation control subsystem configured to receive the sensor data, transmit the sensor data to a human operator, and output teleoperation actuator control signals, wherein the autonomous control subsystem and the teleoperation control subsystem receive, from the robot, sensor data having the same data type, size, and frequency, and wherein the autonomous actuator data and the teleoperation actuator data have the same data type, size, and frequency; and a control-determining subsystem configured to switch between autonomous and teleoperation control.

Teleoperative, partially automated, and fully automated robotic surgery systems and methods are described herein. These systems and methods relate to at least improvement of robotic movements, three dimensional tracking and pose correction for robots interacting with deformable objections, controlling and optimizing the redundant axis of a seven degree of freedom robotic arm, virtual robotic surgery and simulation, and task coordination and optimization for multi-robot surgery.

The invention relates to the technical field of 3D printing control, and discloses a 3D remote printing control system and method based on the Internet of Things, and the 3D remote printing control method based on the Internet of Things comprises the steps: collecting multi-dimensional data in a printing process through a multi-modal sensor network; constructing a digital twinborn body of a printing environment by adopting a mixed reality technology; constructing a tactile signal model and a sound feature model, and cooperatively transmitting multi-sensory feedback matched with a real printing process to a user with the digital twinborn body; calculating the cognitive load level of the user in real time, and dynamically adjusting the information presentation density of each sensory channel according to the load level; the system converts the user intention into a printing equipment control command according to the user cognitive load state and the printing state information flow, and provides execution confirmation information through multi-sensory feedback; and the control experience is adaptively optimized according to printing task characteristics and user preferences, so that the remote operation effect is close to that of field operation.

The invention discloses a teleoperation robot auxiliary system and method based on vision and imitation learning, the system comprises a teleoperation module, a skill learning module, a vision processing module and a virtual force auxiliary module, the teleoperation module realizes remote operation of a robot through an external control device; the skill learning module learns an expert operation track through a dynamic motion primitive algorithm to generate a generalization reference path, the visual processing module combines a three-dimensional target positioning technology of a Kinect depth camera to realize environment perception, and the virtual force auxiliary module constructs a self-adaptive virtual clamp force field based on a position error. A force selector mechanism is employed to dynamically adjust the haptic feedback intensity, guide force is applied to correct when the operation deviates from a reference trajectory, and the operation autonomy is maintained when the trajectory is fitted. Through the synergistic effect of expert track guidance and a visual constraint force field, the operation precision is remarkably improved.

The invention relates to the technical field of three-dimensional modeling, in particular to a modeling method and system based on a dynamic 3D target, electronic equipment and a storage medium, and the method comprises the steps that a three-dimensional modeling operation instruction is generated, and the operation instruction at least comprises an operation type, a target object identifier and a space action range parameter; constructing an operation semantic tree based on the operation instruction; by comparing the local operation semantic tree with the received remote operation semantic tree, detecting a space action range overlapping region; when an overlapping region is detected, applying a space-time dimension priority merging rule; executing the combined operation instruction, and generating a binary log containing an operation semantic tree hash value; when an operation conflict is detected, local rollback is performed based on a differential CRC check value that computes only overlap region data blocks. According to the method, the problems of semantic understanding deficiency, logic inconsistency and low recovery efficiency during three-dimensional space operation are effectively solved.

The invention discloses a power plant remote monitoring and fault diagnosis system based on a 5G network, and belongs to the technical field of remote monitoring, fault diagnosis and operation control. Comprising an on-site intelligent sensing and control terminal, a cloud intelligent operation and maintenance platform and a remote operation and display terminal. According to the invention, the characteristics of high bandwidth and ultra-low delay of the 5G network are fully utilized, and real-time acquisition, edge early warning analysis and high-speed transmission of multi-dimensional data of the power plant are realized; fusion of big data and artificial intelligence of a cloud intelligent operation and maintenance platform is provided, and accurate monitoring of the operation state of the power plant equipment, intelligent early warning of abnormity, rapid diagnosis of a fault source, real-time closed-loop execution of a remote control instruction and continuous optimization of a full-life-cycle predictive maintenance strategy can be realized. According to the invention, the safety, the stability and the operation and maintenance management efficiency of power plant operation are obviously improved, and the operation cost is effectively reduced.

The invention discloses a mechanical arm teleoperation control method and system based on incremental mapping, and the method comprises the steps: carrying out the noise reduction processing of the position and posture of a handle through adaptive low-pass filtering, and achieving the position and posture consistency mapping from a handle space to a mechanical arm working space after coordinate system axis rearrangement and similar transformation mapping; the system provides two kinds of control output of a pose tracking mode and a speed tracking mode, real-time inverse kinematics solution is carried out through a Jacobian matrix and a damping least square method in the speed mode, and resolution scaling and exponential moving average / spherical linear interpolation smooth filtering are carried out on a target pose in the pose mode. And then the handle motion instruction is mapped into a Cartesian instruction or a joint space instruction at the tail end of the mechanical arm, closed-loop execution is conducted through a real-time state feedback link, and the method can be used for scenes such as robot service, teaching, remote operation and data collection.

An example method of displaying windows in a remote desktop system, includes: obtaining, by a remote desktop client executing on a local computer having a local operating system (OS), information relating a first window to a first virtual desktop generated by the local OS; sending the information from the remote desktop client to a remote desktop server; setting, by the remote desktop server, a tag in a remote window object representing a remote window that corresponds to the first window based on the information, the remote window generated by a remote OS on a remote computer; receiving, at the remote desktop client, at least a portion of the remote window object including the tag; and displaying, by the remote desktop client in cooperation with the local OS based on the tag, the first window on the first virtual desktop.

Disclosed is a safety shared control system based on performance of teleoperator, including a master teleoperation system, a slave robotic manipulator system and a communication module; where the master teleoperation system includes EEG signal measurement of a teleoperator, hand controller operation input, and upper computer software, and the upper computer software includes a graphical user interface (GUI), safety simulation for protecting the safety of a robot, and a PoT model; and the slave robotic manipulator system includes a robotic manipulator, a vision camera and lower computer software, and the lower computer software includes a target recognition algorithm, an autonomous controller, and a shared controller for dynamically allocating human-robot control weights. A safety control system coefficient of the teleoperator is identified through safety simulation prior to actual operation, such that a safety control method for different operating experience is implemented, and safety operation of a teleoperation robot is realized.

An autonomous robotic vehicle is capable of detecting, identifying, and locating the source of gas leaks such as methane. Because of the number of operating components within the vehicle, it may also be considered a robotic system. The robotic vehicle can be remotely operated or can move autonomously within a jobsite. The vehicle selectively deploys a source detection device that precisely locates the source of a leak. The vehicle relays data to stakeholders and remains powered that enables operation of the vehicle over an extended period. Monitoring and control of the vehicle is enabled through a software interface viewable to a user on a mobile communications device or personal computer.

Methods and systems to remotely operate robotic devices are provided. A number of embodiments allow users to remotely operate robotic devices using generalized consumer devices (e.g., cell phones). Additional embodiments provide for a platform to allow communication between consumer devices and the robotic devices. Further embodiments allow for training robotic devices to operate autonomously by training the robotic device with machine learning algorithms using data collected from scalable methods of controlling robotic devices.

To provide a robot remote control system, a robot remote control method and a program which can improve controllability of a robot, while reducing communication volumes (traffic) of data during remote control of the robot.SOLUTION: A robot remote control system comprises a control device that controls a robot, and a terminal device that is utilized by an operator when remote controlling the robot. The control device makes communication with the terminal device and transmits a video of a space where the robot exists to the terminal device. The terminal device displays, on a display, the video received from the control device, and transmits operation data showing an operation instruction by the operator to the robot to the control device. Further, the control device identifies an area of interest on the video, on the basis of the operation data, and sets a video quality of the area of interest to be higher than a video quality of an area of non-interest.SELECTED DRAWING: Figure 7

A medical system may include a first haptic interface device, one or more input sensors, one or more processors, and memory storing instructions. When executed by the one or more processors, the instructions can cause the one or more processors to: receive a first input signal from the one or more input sensors; send to the first haptic interface device a kinesthetic haptic feedback signal based at least on the first input signal for a kinesthetic haptic feedback; receive a second input signal from the one or more input sensors; and send to the first haptic interface device a vibrational tactile feedback signal based at least on the second input signal for a vibrational tactile feedback.

An operator selection method according to the present disclosure is an operator selection method for selecting, from among a plurality of operators, an operation execution operator who remotely operates a robot that can autonomously move. A terminal device used for each of the plurality of operators displays prediction information for predicting the generation of a remote operation request for requesting a remote operation for the robot, and receives a preliminary preparation operation for remotely operating the robot. When the remote operation request is generated, an information processing device selects any one of the plurality of operators as the operation execution operator on the basis of an execution state of the preliminary preparation operation in each of the plurality of operators. The information processing device causes the operation execution operator to perform the remote operation on the robot by using the terminal device.

The arrangements disclosed herein relate to receiving a data stream of a medical procedure performed with a robotic medical system; identifying, using the data stream and with one or more models trained with machine learning, a type of an anatomical structure on which the medical procedure is performed, and a type of an interaction with the anatomical structure; and determining an amount of force to be applied to the anatomical structure based at least in part on the type of the anatomical structure and the type of the interaction with the anatomical structure. Arrangements also relate to providing an indication of the amount of force to control performance of the medical procedure with the robotic medical system.

The invention relates to the technical field of mine filling operation remote monitoring, and discloses a mine filling operation remote monitoring and virtual debugging system based on digital twinning, which comprises a sensing acquisition module, an intrinsic safety type edge computing gateway, a cloud service platform, a digital twinning module, a decision module, a virtual debugging module and a remote interaction terminal, according to the invention, through the digital twin module, the dynamic model synchronous with the filling goaf is generated by using the driving of the current state data, so that the three-dimensional visual transparent monitoring of the goaf in the filling process is realized, and a remote operator can intuitively master the implementation working condition; through the virtual debugging module, the digital twin module is called to carry out physical simulation on filling process parameters, automatic optimization and iterative verification on the process parameters are realized, and finally an optimal process scheme subjected to simulation verification is output. The debugging cost and risk are greatly reduced, and the debugging period can be shortened.

The invention discloses a gecko-imitating intelligent robot, and relates to the technical field of biological bionic intelligent robots, the gecko-imitating intelligent robot comprises a gecko-imitating front body and a gecko-imitating rear body, and the gecko-imitating front body and the gecko-imitating rear body are connected through a body connecting part; light-weight mechanical structure design is adopted, 3D modeling is carried out, all parts are manufactured in combination with the 3D printing technology, a multi-joint driving system composed of an STM32F103C8T6 main control chip and an SC90 steering engine is carried, multi-foot gait control is achieved, water-based polyacrylate pressure-sensitive adhesive is adopted for the feet, gaps of the feet are filled, the feet of the gecko are covered, and the gecko gait control effect is achieved. The robot can be stably adhered to the surfaces of various materials such as glass and concrete, in addition, Bluetooth / Wi-Fi wireless control is supported, advancing, steering and obstacle crossing actions of the robot can be remotely operated through a mobile device APP, and the robot can be suitable for high-risk scenes such as urban pipeline flaw detection, high-rise building cleaning and earthquake ruin search and rescue.

The invention provides a mechanical arm teleoperation system adaptive to a quadruped robot and a control method, and relates to the technical field of robot control. According to the method, firstly, a far-end main mechanical arm is introduced on the basis of a mechanical arm of the quadruped robot to form a main-end mechanical arm system and a slave-end mechanical arm system, and a remote operator remotely maps an action instruction to the slave-end mechanical arm system by controlling the main-end mechanical arm; then, a clamping jaw module with an image and tail end contact force sensor is installed at the tail end of the slave end mechanical arm, and image data collection and tail end contact force collection on a working site are achieved; secondly, the image information and the tail end contact force are remotely transmitted to a remote operator in real time through a wireless transmission module and a remote man-machine interaction module; and finally, a remote operator controls the main end mechanical arm in real time according to the real-time image information and the tail end contact force, remote operation of the quadruped robot mounting mechanical arm in a complex scene is achieved, and the operation efficiency and the operation precision are improved.

A system for controlling a user interface of a teleoperated surgical system, the system comprises a first master controller communicatively coupled to the teleoperated surgical system; and a display device communicatively coupled to the teleoperated surgical system and configured to display a graphical user interface; and wherein the first master controller is configured to transmit a first input signal to an interface controller, the first input signal caused by manual manipulation of the first master controller, the interface controller to use the first input signal to update a graphical user interface presented by the display device.