324 results about "Tele operation" patented technology

Systems and methods that allow robots to perform tasks for users are provided. A robot may comprise one or more robotic arms and / or a mobile base. The arms may be controlled by electric actuators and may have six or more degrees of freedom. The robot may have sensors which can be accessed remotely. Robots may have varying levels of autonomy, including, for example, full teleoperation (in which a human can have detailed control over the robot) or full autonomy (in which the robot can complete a task without any human intervention). Various entities can interact with individual robots or groups of robots over a network, locally, directly or in person, or any combination thereof. A management system can allow entities to control and / or monitor the robots.

A teleoperations system may be used to generate virtual paths of travel for an autonomous vehicle based upon teleoperations system-provided suggestions, and virtual path suggestion constraints, e.g., based upon physical constraints associated with an autonomous vehicle such as minimum turning radius, trailer sweep, and the like, may be used assist in guiding a teleoperations system operator during generation of virtual path suggestions.

The invention discloses a flexible robot motion control system and method based on a visual language action model, and the system comprises visual sensors which are disposed at a plurality of joints of a flexible robot, and are used for observing the multi-joint sensing information of the flexible robot; the remote voice input unit is installed on the flexible robot body and used for inputting a voice instruction of remote operation to the flexible robot; the motion control module based on the VLA framework is mounted in the flexible robot and used for controlling the flexible robot to act based on a visual language action model according to the multi-joint sensing information and the voice instruction; through the design of the intelligent control system, the complexity of the system is remarkably reduced, the control precision and flexibility are optimized, the coordination control problem of complex body segment units is solved, high-performance autonomous motion control is achieved, the system cost is reduced, the adaptability of the robot in diversified environments is enhanced, and the robot can be widely deployed in complex application scenes.

The invention relates to the technical field of humanoid robot control. The invention provides a humanoid robot bilateral force feedback teleoperation method of a force compensation mechanism. According to the method, a 5G private network is used for deployment, the characteristics of low delay, high reliability and large bandwidth of the 5G private network are utilized, real-time interaction of high-dimensional haptic data in a remote and cross-domain environment is effectively supported, cross-domain teleoperation can be achieved, high-fidelity feedback transmission of environment contact force is effectively achieved, and the real-time interaction of the high-dimensional haptic data in the remote and cross-domain environment is achieved. The precision, the operation efficiency and the overall safety of remote operation of the humanoid robot in complex industrial scenes such as nuclear power maintenance, precise assembly and high-risk environment operation are remarkably improved, the gap between traditional automation and low-efficiency remote operation is filled up, and reliable technical support is provided for advanced industrial application needing man-machine cooperation fine force control.

The disclosure provides devices, systems, and methods for physical therapy. Electrical signals are applied to a subject via electrodes in a device worn on the body part receiving the therapy. The device can be operated remotely. The device can use artificial intelligence to evaluate and design physical therapy routines using the electrodes.

Surgical robot systems for remote manipulation having robotic telemanipulators are provided. The surgical robot systems are well adapted for use by the surgeon, seamlessly integratable into the operation room, allow for a surgeon to work between the robot and the patient throughout a surgery in a sterile manner, are relatively low cost, and / or permit integrated laparoscopy. The system preferably includes a master console having a plurality of master links interconnected by a plurality of master joints, and a handle coupled to the master console for operating the telemanipulator. The system further includes a slave console operatively coupled to the master console and having a plurality of slave links interconnected by a plurality of slave joints that move responsive to movement at the master console to permit an end-effector to perform surgery.

Provided herein is a control system and methods thereof for controlling operation of a robot. The control system comprises: a robot, including a plurality of sensors wherein each generating a stream of raw sensor data having a data type, size, and frequency, and a plurality of actuators cause movement of the robot; an autonomous control subsystem configured to receive the sensor data and output autonomous actuator data; and a teleoperation control subsystem configured to receive the sensor data, transmit the sensor data to a human operator, and output teleoperation actuator control signals, wherein the autonomous control subsystem and the teleoperation control subsystem receive, from the robot, sensor data having the same data type, size, and frequency, and wherein the autonomous actuator data and the teleoperation actuator data have the same data type, size, and frequency; and a control-determining subsystem configured to switch between autonomous and teleoperation control.

Teleoperative, partially automated, and fully automated robotic surgery systems and methods are described herein. These systems and methods relate to at least improvement of robotic movements, three dimensional tracking and pose correction for robots interacting with deformable objections, controlling and optimizing the redundant axis of a seven degree of freedom robotic arm, virtual robotic surgery and simulation, and task coordination and optimization for multi-robot surgery.

The invention relates to the technical field of 3D printing control, and discloses a 3D remote printing control system and method based on the Internet of Things, and the 3D remote printing control method based on the Internet of Things comprises the steps: collecting multi-dimensional data in a printing process through a multi-modal sensor network; constructing a digital twinborn body of a printing environment by adopting a mixed reality technology; constructing a tactile signal model and a sound feature model, and cooperatively transmitting multi-sensory feedback matched with a real printing process to a user with the digital twinborn body; calculating the cognitive load level of the user in real time, and dynamically adjusting the information presentation density of each sensory channel according to the load level; the system converts the user intention into a printing equipment control command according to the user cognitive load state and the printing state information flow, and provides execution confirmation information through multi-sensory feedback; and the control experience is adaptively optimized according to printing task characteristics and user preferences, so that the remote operation effect is close to that of field operation.

The invention discloses a teleoperation robot auxiliary system and method based on vision and imitation learning, the system comprises a teleoperation module, a skill learning module, a vision processing module and a virtual force auxiliary module, the teleoperation module realizes remote operation of a robot through an external control device; the skill learning module learns an expert operation track through a dynamic motion primitive algorithm to generate a generalization reference path, the visual processing module combines a three-dimensional target positioning technology of a Kinect depth camera to realize environment perception, and the virtual force auxiliary module constructs a self-adaptive virtual clamp force field based on a position error. A force selector mechanism is employed to dynamically adjust the haptic feedback intensity, guide force is applied to correct when the operation deviates from a reference trajectory, and the operation autonomy is maintained when the trajectory is fitted. Through the synergistic effect of expert track guidance and a visual constraint force field, the operation precision is remarkably improved.

The invention relates to the technical field of three-dimensional modeling, in particular to a modeling method and system based on a dynamic 3D target, electronic equipment and a storage medium, and the method comprises the steps that a three-dimensional modeling operation instruction is generated, and the operation instruction at least comprises an operation type, a target object identifier and a space action range parameter; constructing an operation semantic tree based on the operation instruction; by comparing the local operation semantic tree with the received remote operation semantic tree, detecting a space action range overlapping region; when an overlapping region is detected, applying a space-time dimension priority merging rule; executing the combined operation instruction, and generating a binary log containing an operation semantic tree hash value; when an operation conflict is detected, local rollback is performed based on a differential CRC check value that computes only overlap region data blocks. According to the method, the problems of semantic understanding deficiency, logic inconsistency and low recovery efficiency during three-dimensional space operation are effectively solved.

The invention discloses a power plant remote monitoring and fault diagnosis system based on a 5G network, and belongs to the technical field of remote monitoring, fault diagnosis and operation control. Comprising an on-site intelligent sensing and control terminal, a cloud intelligent operation and maintenance platform and a remote operation and display terminal. According to the invention, the characteristics of high bandwidth and ultra-low delay of the 5G network are fully utilized, and real-time acquisition, edge early warning analysis and high-speed transmission of multi-dimensional data of the power plant are realized; fusion of big data and artificial intelligence of a cloud intelligent operation and maintenance platform is provided, and accurate monitoring of the operation state of the power plant equipment, intelligent early warning of abnormity, rapid diagnosis of a fault source, real-time closed-loop execution of a remote control instruction and continuous optimization of a full-life-cycle predictive maintenance strategy can be realized. According to the invention, the safety, the stability and the operation and maintenance management efficiency of power plant operation are obviously improved, and the operation cost is effectively reduced.

The invention discloses a mechanical arm teleoperation control method and system based on incremental mapping, and the method comprises the steps: carrying out the noise reduction processing of the position and posture of a handle through adaptive low-pass filtering, and achieving the position and posture consistency mapping from a handle space to a mechanical arm working space after coordinate system axis rearrangement and similar transformation mapping; the system provides two kinds of control output of a pose tracking mode and a speed tracking mode, real-time inverse kinematics solution is carried out through a Jacobian matrix and a damping least square method in the speed mode, and resolution scaling and exponential moving average / spherical linear interpolation smooth filtering are carried out on a target pose in the pose mode. And then the handle motion instruction is mapped into a Cartesian instruction or a joint space instruction at the tail end of the mechanical arm, closed-loop execution is conducted through a real-time state feedback link, and the method can be used for scenes such as robot service, teaching, remote operation and data collection.

An example method of displaying windows in a remote desktop system, includes: obtaining, by a remote desktop client executing on a local computer having a local operating system (OS), information relating a first window to a first virtual desktop generated by the local OS; sending the information from the remote desktop client to a remote desktop server; setting, by the remote desktop server, a tag in a remote window object representing a remote window that corresponds to the first window based on the information, the remote window generated by a remote OS on a remote computer; receiving, at the remote desktop client, at least a portion of the remote window object including the tag; and displaying, by the remote desktop client in cooperation with the local OS based on the tag, the first window on the first virtual desktop.

An operator selection method according to the present disclosure is an operator selection method for selecting, from among a plurality of operators, an operation execution operator who remotely operates a robot that can autonomously move. A terminal device used for each of the plurality of operators displays prediction information for predicting the generation of a remote operation request for requesting a remote operation for the robot, and receives a preliminary preparation operation for remotely operating the robot. When the remote operation request is generated, an information processing device selects any one of the plurality of operators as the operation execution operator on the basis of an execution state of the preliminary preparation operation in each of the plurality of operators. The information processing device causes the operation execution operator to perform the remote operation on the robot by using the terminal device.

The arrangements disclosed herein relate to receiving a data stream of a medical procedure performed with a robotic medical system; identifying, using the data stream and with one or more models trained with machine learning, a type of an anatomical structure on which the medical procedure is performed, and a type of an interaction with the anatomical structure; and determining an amount of force to be applied to the anatomical structure based at least in part on the type of the anatomical structure and the type of the interaction with the anatomical structure. Arrangements also relate to providing an indication of the amount of force to control performance of the medical procedure with the robotic medical system.

The invention relates to the technical field of mine filling operation remote monitoring, and discloses a mine filling operation remote monitoring and virtual debugging system based on digital twinning, which comprises a sensing acquisition module, an intrinsic safety type edge computing gateway, a cloud service platform, a digital twinning module, a decision module, a virtual debugging module and a remote interaction terminal, according to the invention, through the digital twin module, the dynamic model synchronous with the filling goaf is generated by using the driving of the current state data, so that the three-dimensional visual transparent monitoring of the goaf in the filling process is realized, and a remote operator can intuitively master the implementation working condition; through the virtual debugging module, the digital twin module is called to carry out physical simulation on filling process parameters, automatic optimization and iterative verification on the process parameters are realized, and finally an optimal process scheme subjected to simulation verification is output. The debugging cost and risk are greatly reduced, and the debugging period can be shortened.

The invention discloses a gecko-imitating intelligent robot, and relates to the technical field of biological bionic intelligent robots, the gecko-imitating intelligent robot comprises a gecko-imitating front body and a gecko-imitating rear body, and the gecko-imitating front body and the gecko-imitating rear body are connected through a body connecting part; light-weight mechanical structure design is adopted, 3D modeling is carried out, all parts are manufactured in combination with the 3D printing technology, a multi-joint driving system composed of an STM32F103C8T6 main control chip and an SC90 steering engine is carried, multi-foot gait control is achieved, water-based polyacrylate pressure-sensitive adhesive is adopted for the feet, gaps of the feet are filled, the feet of the gecko are covered, and the gecko gait control effect is achieved. The robot can be stably adhered to the surfaces of various materials such as glass and concrete, in addition, Bluetooth / Wi-Fi wireless control is supported, advancing, steering and obstacle crossing actions of the robot can be remotely operated through a mobile device APP, and the robot can be suitable for high-risk scenes such as urban pipeline flaw detection, high-rise building cleaning and earthquake ruin search and rescue.

The invention provides a mechanical arm teleoperation system adaptive to a quadruped robot and a control method, and relates to the technical field of robot control. According to the method, firstly, a far-end main mechanical arm is introduced on the basis of a mechanical arm of the quadruped robot to form a main-end mechanical arm system and a slave-end mechanical arm system, and a remote operator remotely maps an action instruction to the slave-end mechanical arm system by controlling the main-end mechanical arm; then, a clamping jaw module with an image and tail end contact force sensor is installed at the tail end of the slave end mechanical arm, and image data collection and tail end contact force collection on a working site are achieved; secondly, the image information and the tail end contact force are remotely transmitted to a remote operator in real time through a wireless transmission module and a remote man-machine interaction module; and finally, a remote operator controls the main end mechanical arm in real time according to the real-time image information and the tail end contact force, remote operation of the quadruped robot mounting mechanical arm in a complex scene is achieved, and the operation efficiency and the operation precision are improved.

A system for controlling a user interface of a teleoperated surgical system, the system comprises a first master controller communicatively coupled to the teleoperated surgical system; and a display device communicatively coupled to the teleoperated surgical system and configured to display a graphical user interface; and wherein the first master controller is configured to transmit a first input signal to an interface controller, the first input signal caused by manual manipulation of the first master controller, the interface controller to use the first input signal to update a graphical user interface presented by the display device.

The invention relates to the technical field of robots, in particular to a mobile robot remote operation system and method based on mixed reality, and the method comprises an operator end and a robot end, the operator end completes a complex remote operation task based on visual feedback provided by a man-machine cooperation interaction interface, and the robot end completes a remote operation task based on visual feedback provided by the man-machine cooperation interaction interface. The virtual reality controller integrates a motion state and an operation mode of the mobile robot, and the mixed reality server generates visual feedback according to visual information of a remote operation visual angle of the mobile robot; the robot end comprises a mobile robot, a collection device on the mobile robot and a robot server, and after the mobile robot receives a remote control instruction sent by the virtual reality controller to the robot end, posture and button information of the mobile robot are input into the robot server to drive the mobile robot to move. Therefore, the problems of low real-time performance and accuracy of remote control, poor operation efficiency and flexibility and the like caused by limitation of bandwidth and system time delay in related technologies are solved.

The embodiment of the invention discloses an energy storage control system information transmission and index evaluation method and system. The method comprises the following steps: acquiring signal data of a lower computer of a hydropower station unit and transmitting the signal data to a remote centralized control target center; obtaining the integrity of unit lower computer signal data received by the target center; obtaining the availability of unit lower computer signal data received by the target center; acquiring the transmission safety of the acquired hydropower station unit lower computer signal data to a target center; and based on integrity, availability and transmission security, determining evaluation information of the acquired hydropower station unit lower computer signal data. According to the method, by comprehensively considering integrity, usability and safety, powerful support can be provided for a remote centralized control operation on-duty mode, an operator can accurately monitor the operation state of a unit in a remote centralized control center in real time and perform remote operation and control, centralized management and optimal scheduling of a hydropower station are achieved, and the production efficiency and the management level are improved.

The invention relates to an A I cloud intelligence fun memorial screen for religious cultural inheritance, which comprises a wall-mounted display terminal and a mobile terminal connected with the display terminal by utilizing the Internet, an APP connected with the display terminal is installed on the mobile terminal, the display terminal comprises a base and a display terminal fixed on the base, and the display terminal is connected with the mobile terminal. A power management module is arranged in the base, a display screen, a high-definition camera and a plurality of control keys are embedded in the front surface of the display terminal, and a network connection module, a timing startup and shutdown module, a cloud storage module, a user authority management module, a remote management module, a management module and an AI compatible module are arranged in the display terminal. Ai learning is utilized to enable the sound and the image of the digital human to reach an expression mode close to that before birth, an A I technology, cloud storage, element universe application and intelligent management are combined, multi-terminal access, two-dimensional code scanning and remote operation are achieved, and use is convenient and fast.

The invention discloses a robot whole body control method and system based on real-time inertia motion capture and reinforcement learning, and belongs to the field of robot control. The system comprises a motion capture module, a data processing and forward kinematics module, a motion redirection and optimization module, a general motion strategy control module and a real-time control and driving module which are connected in sequence, and an end-to-end closed-loop control assembly line is formed through a shared memory and a high-speed communication protocol. According to the method, human body joint data are collected through inertia motion capture equipment, high-quality mapping from a human body posture to a robot model is achieved through posture calculation, non-uniform scaling and two-stage differential inverse kinematics optimization, and a stable joint instruction is generated in combination with a reinforcement learning strategy trained by a PPO algorithm. The method solves the problems of lack of feedback closed loop, joint deadlock, contradiction between fidelity and stability and the like in the prior art, has the characteristics of high robustness and high expansibility, and can be widely applied to scenes of remote operation, action reproduction and the like.

The invention discloses a multi-machine cooperative engineering intelligent construction system, and belongs to the technical field of multi-machine cooperative construction. The system comprises the following modules: a multi-dimensional sensing module for collecting and processing multi-dimensional data of a construction site in real time; the task planning and scheduling module is used for dynamically generating an optimal task plan and resource allocation scheme and executing intelligent scheduling to improve the construction efficiency; the intelligent management module is used for overall planning and managing the whole construction process and ensuring coordination and high efficiency of the construction process; the multi-machine cooperative control module is used for coordinating a plurality of construction robots through a distributed control algorithm to realize cooperative execution of complex tasks; the self-adaptive quality control module monitors the construction quality in real time, automatically optimizes construction parameters through self-adaptive adjustment and an intelligent deviation correction mechanism, and ensures that the construction quality reaches an expected standard; and the man-machine interaction interface provides a visual system monitoring and control platform, supports manual intervention and remote operation, and enhances the control and adjustment capability of the construction process.

A system and method for robotic teleoperation enable a teleoperated robotic element to perform a sequence of actions based on intention estimation, eliminating the need for continuous human control. The system includes a robotic teleoperation input that receives motion inputs and gaze data from a human operator performing a robotic teleoperation task. A robotic teleoperation feature extractor analyzes and processes the motion inputs and the gaze data into sequential input data. A multi-window model assigns hierarchical prediction windows to the input data, generating windowed sequential data. A hierarchical neural network processes the windowed sequential data to determine low-level action intentions and high-level task intentions, and generates an intention estimation based on the low-level action intentions and the high-level task intentions. A hierarchical dependency model incorporates hierarchical dependent loss to refine the intention estimation.

A manual drive adapter for a robotic instrument comprises an adapter housing configured to be releasably coupled to a force transmission mechanism of the robotic instrument. The force transmission mechanism comprises a robotic input drive member configured to engage with a robotic drive output of a teleoperated surgical system. An adapter output drive member is coupled to the adapter housing. The adapter housing is configured to be releasably coupled to the force transmission mechanism of the robotic instrument such that the adapter output drive member is engageable with the robotic input drive member of the robotic instrument. The adapter output drive member includes a first plurality of splines configured to matingly engage a second plurality of splines on the robotic input drive member such that movement of the adapter output drive member causes the robotic input drive member to operate one or more degrees of freedom of the robotic instrument.

A manual drive adapter for a robotic instrument includes an adapter housing configured to be releasably coupled to a force transmission mechanism of the robotic instrument. The force transmission mechanism includes a drive member interface and an input drive member configured to engage with a robotic drive output of a teleoperated surgical system. The adapter includes an output drive interface that includes an output drive member and is coupled to the adapter housing. The output drive interface is configured to be releasably coupled to the drive member interface of the robotic instrument such that the output drive member is engageable with the input drive member of the robotic instrument. A manual actuator of the adapter is operably coupled to the output drive member such that movement of the manual actuator by a user causes the output drive member to operate one or more degrees of freedom of the robotic instrument.

The utility model relates to an intelligent crown block system. The intelligent crown block system comprises a terminal module, a network module and a platform module, the terminal module comprises a crown block, a camera and a PLC (Programmable Logic Controller), the camera is used for acquiring the running state and peripheral information of the crown block, and the PLC is used for controlling the intelligent crown block; the network module is connected with the terminal module and the platform module, so that the terminal module and the platform module are in data intercommunication; the platform module comprises a crown block control platform, and the crown block control platform is connected with the PLC through a network module and used for operating a crown block. According to the intelligent crown block system disclosed by the utility model, the crown block and the control platform are remotely and wirelessly connected by building the special 5G network, the running image of the crown block is acquired in real time by virtue of the characteristics of high bandwidth and low time delay of the 5G network, the crown block is remotely operated, and the production safety and efficiency are effectively improved.

The invention relates to the technical field of remote operation, in particular to a parent-child safety monitoring method based on artificial intelligence emotion synchronization and positioning guarding, which comprises the following steps: acquiring bracelet positioning, heart rate and acceleration, performing time alignment and integration, generating a child real-time state record, and storing the child real-time state record; the method comprises the following steps: acquiring a risk according to a positioning mapping geo-fence, forming a continuous emotional state, recognizing an emotional consistent section and positioning residence in combination with a track, calculating a continuous time difference, determining a concerned section according to a threshold value, and writing start-stop information according to a time axis to form a guard record. Spatial risks and emotion levels are fused to form a stable time sequence state, a concernable section is recognized by combining emotion consistency and positioning residence, quantitative judgment is carried out according to a continuous time difference value, guard attention is converted into traceable section record from instantaneous alarm, and monitoring judgment accuracy and continuous reference value are improved.