145 results about "Tele operation" patented technology

The invention relates to the technical field of mine filling operation remote monitoring, and discloses a mine filling operation remote monitoring and virtual debugging system based on digital twinning, which comprises a sensing acquisition module, an intrinsic safety type edge computing gateway, a cloud service platform, a digital twinning module, a decision module, a virtual debugging module and a remote interaction terminal, according to the invention, through the digital twin module, the dynamic model synchronous with the filling goaf is generated by using the driving of the current state data, so that the three-dimensional visual transparent monitoring of the goaf in the filling process is realized, and a remote operator can intuitively master the implementation working condition; through the virtual debugging module, the digital twin module is called to carry out physical simulation on filling process parameters, automatic optimization and iterative verification on the process parameters are realized, and finally an optimal process scheme subjected to simulation verification is output. The debugging cost and risk are greatly reduced, and the debugging period can be shortened.

The invention provides a mechanical arm teleoperation system adaptive to a quadruped robot and a control method, and relates to the technical field of robot control. According to the method, firstly, a far-end main mechanical arm is introduced on the basis of a mechanical arm of the quadruped robot to form a main-end mechanical arm system and a slave-end mechanical arm system, and a remote operator remotely maps an action instruction to the slave-end mechanical arm system by controlling the main-end mechanical arm; then, a clamping jaw module with an image and tail end contact force sensor is installed at the tail end of the slave end mechanical arm, and image data collection and tail end contact force collection on a working site are achieved; secondly, the image information and the tail end contact force are remotely transmitted to a remote operator in real time through a wireless transmission module and a remote man-machine interaction module; and finally, a remote operator controls the main end mechanical arm in real time according to the real-time image information and the tail end contact force, remote operation of the quadruped robot mounting mechanical arm in a complex scene is achieved, and the operation efficiency and the operation precision are improved.

The invention relates to the technical field of robots, in particular to a mobile robot remote operation system and method based on mixed reality, and the method comprises an operator end and a robot end, the operator end completes a complex remote operation task based on visual feedback provided by a man-machine cooperation interaction interface, and the robot end completes a remote operation task based on visual feedback provided by the man-machine cooperation interaction interface. The virtual reality controller integrates a motion state and an operation mode of the mobile robot, and the mixed reality server generates visual feedback according to visual information of a remote operation visual angle of the mobile robot; the robot end comprises a mobile robot, a collection device on the mobile robot and a robot server, and after the mobile robot receives a remote control instruction sent by the virtual reality controller to the robot end, posture and button information of the mobile robot are input into the robot server to drive the mobile robot to move. Therefore, the problems of low real-time performance and accuracy of remote control, poor operation efficiency and flexibility and the like caused by limitation of bandwidth and system time delay in related technologies are solved.

The embodiment of the invention discloses an energy storage control system information transmission and index evaluation method and system. The method comprises the following steps: acquiring signal data of a lower computer of a hydropower station unit and transmitting the signal data to a remote centralized control target center; obtaining the integrity of unit lower computer signal data received by the target center; obtaining the availability of unit lower computer signal data received by the target center; acquiring the transmission safety of the acquired hydropower station unit lower computer signal data to a target center; and based on integrity, availability and transmission security, determining evaluation information of the acquired hydropower station unit lower computer signal data. According to the method, by comprehensively considering integrity, usability and safety, powerful support can be provided for a remote centralized control operation on-duty mode, an operator can accurately monitor the operation state of a unit in a remote centralized control center in real time and perform remote operation and control, centralized management and optimal scheduling of a hydropower station are achieved, and the production efficiency and the management level are improved.

The invention discloses a robot whole body control method and system based on real-time inertia motion capture and reinforcement learning, and belongs to the field of robot control. The system comprises a motion capture module, a data processing and forward kinematics module, a motion redirection and optimization module, a general motion strategy control module and a real-time control and driving module which are connected in sequence, and an end-to-end closed-loop control assembly line is formed through a shared memory and a high-speed communication protocol. According to the method, human body joint data are collected through inertia motion capture equipment, high-quality mapping from a human body posture to a robot model is achieved through posture calculation, non-uniform scaling and two-stage differential inverse kinematics optimization, and a stable joint instruction is generated in combination with a reinforcement learning strategy trained by a PPO algorithm. The method solves the problems of lack of feedback closed loop, joint deadlock, contradiction between fidelity and stability and the like in the prior art, has the characteristics of high robustness and high expansibility, and can be widely applied to scenes of remote operation, action reproduction and the like.

A system and method for robotic teleoperation enable a teleoperated robotic element to perform a sequence of actions based on intention estimation, eliminating the need for continuous human control. The system includes a robotic teleoperation input that receives motion inputs and gaze data from a human operator performing a robotic teleoperation task. A robotic teleoperation feature extractor analyzes and processes the motion inputs and the gaze data into sequential input data. A multi-window model assigns hierarchical prediction windows to the input data, generating windowed sequential data. A hierarchical neural network processes the windowed sequential data to determine low-level action intentions and high-level task intentions, and generates an intention estimation based on the low-level action intentions and the high-level task intentions. A hierarchical dependency model incorporates hierarchical dependent loss to refine the intention estimation.

The invention relates to the technical field of remote operation, in particular to a parent-child safety monitoring method based on artificial intelligence emotion synchronization and positioning guarding, which comprises the following steps: acquiring bracelet positioning, heart rate and acceleration, performing time alignment and integration, generating a child real-time state record, and storing the child real-time state record; the method comprises the following steps: acquiring a risk according to a positioning mapping geo-fence, forming a continuous emotional state, recognizing an emotional consistent section and positioning residence in combination with a track, calculating a continuous time difference, determining a concerned section according to a threshold value, and writing start-stop information according to a time axis to form a guard record. Spatial risks and emotion levels are fused to form a stable time sequence state, a concernable section is recognized by combining emotion consistency and positioning residence, quantitative judgment is carried out according to a continuous time difference value, guard attention is converted into traceable section record from instantaneous alarm, and monitoring judgment accuracy and continuous reference value are improved.

A teleoperations system may be used to selectively override conditions detected by an autonomous vehicle to enable the autonomous vehicle to effectively ignore detected conditions that are identified as false positives by the teleoperations system. Furthermore, a teleoperations system may be used to generate commands that an autonomous vehicle validates prior to executing to confirm that the commands do not violate any vehicle constraints for the autonomous vehicle. Still further, an autonomous vehicle may be capable of dynamically varying the video quality of one or more camera feeds that are streamed to a teleoperations system over a bandwidth-constrained wireless network based upon a current context of the autonomous vehicle.

The invention relates to the technical field of remote single-hole robot operation guidance and demonstration, and discloses a system and a method for remote single-hole robot operation guidance and demonstration, which realize efficient, stable and secure transmission of remote force feedback signals and control instructions through a low-delay secure communication link based on SRv6 + TSN and a national password SM9 encryption technology. The problem that transparency and real-time performance are difficult to consider in remote operation is effectively solved, experts can seamlessly perceive interaction force of local instruments and tissues and carry out accurate remote intervention, and through dynamic modeling of a cloud twinning service module and Transformer and graph neural network algorithms, the interaction force between the local instruments and the tissues can be accurately and remotely intervened. Real-time prediction of risks such as bleeding and perforation in the operation and accurate matching of tissue deformation are achieved, a visual and fused AR guidance interface is provided for experts in combination with a mixed reality guidance engine, and the accuracy of remote guidance and operation safety are remarkably improved.

A system for controlling a first machine that is remotely operable to perform a first task, comprises one or more processors collectively configured to: i) create a first node graph for the first task, the first node graph comprising a plurality of execution nodes, each execution node defining verb logic that is to be performed on data obtained from the first machine, to process said data, and wherein the output of the first node graph is an action to be performed by the first machine to perform the first task; ii) propagate the data received from the first machine in real-time, through the first node graph to determine a first action to be performed by the first machine; and iii) send a control message to the first machine to instruct the first machine to perform the first action.

Systems and methods of automated task planning in a remotely operated device system are provided. The method includes storing a domain model for modeling a domain of the remotely operated device system and a task library including a plurality of subgoals each mapped to a corresponding subtask or set of subtasks that achieves the subgoal, the task library being filterable by subgoal, and receiving, through a human-machine interface, a user input including at least one goal and initial conditions. The method further includes performing, with a task planner module: automatically decomposing the at least one goal into subgoals; querying the task library for matching subtasks using the subgoals; generating a sequence of actions using the initial conditions, the domain model, and the matching subtasks returned by the task library; returning the sequence of actions as a task to the human-machine interface; and displaying the task in the human-machine interface.

A method for loading and / or unloading vehicle transport cargo vessels is provided. The method (100) comprises providing (110) port sensor data to capture the current situation in an area of ​​the port relevant for loading and / or unloading vehicle transport cargo vessels, and providing (120) vehicle sensor data to capture the current environment of a vehicle to be loaded. The method (100) further comprises transmitting (130) vehicle sensor data and port sensor data to a teleoperation station (14) for teleoperated control of the vehicle, and teleoperated (140) control of the vehicle to be loaded at least partially based on the captured current environment of the vehicle and on the current situation in the area of ​​the port relevant for loading and / or unloading vehicle transport cargo vessels. Furthermore, a system (10) for loading and / or unloading vehicle transport cargo vessels is provided.

Disclosed is a safety shared control system based on performance of teleoperator, including a master teleoperation system, a slave robotic manipulator system and a communication module; where the master teleoperation system includes EEG signal measurement of a teleoperator, hand controller operation input, and upper computer software, and the upper computer software includes a graphical user interface (GUI), safety simulation for protecting the safety of a robot, and a PoT model; and the slave robotic manipulator system includes a robotic manipulator, a vision camera and lower computer software, and the lower computer software includes a target recognition algorithm, an autonomous controller, and a shared controller for dynamically allocating human-robot control weights. A safety control system coefficient of the teleoperator is identified through safety simulation prior to actual operation, such that a safety control method for different operating experience is implemented, and safety operation of a teleoperation robot is realized.

A tetherless magnetic impact needle robot (MINRob) based on a triple-magnet system with reversible and repeatable magnetic collisions to overcome this constraint on output force. The working procedure of the system is divided into several states, and a mathematical model is developed to predict and optimize the force output. These force values in magnetic impact and penetration are obtained from a customized setup, indicating a 10-fold increase compared with existing miniature robots that only utilize magnetic attractive force. Eventually, the MINRob is integrated with a teleoperation system, enabling remote and precise control of the robot's position and orientation. The triple-magnet system offers promising locomotion patterns and penetration capacity via the notably increased force output, showing great potential in robot-assisted tissue penetration in minimally invasive healthcare.

An operation control method according to an embodiment includes: acquiring sensor data generated when an operator remotely operates an end effector that is able to grasp or operate an object and in which a plurality of fingers are disposed; determining the role of each of the plurality of fingers on the basis of the sensor data; and generating a command for operating the end effector on the basis of the determined role of each of the plurality of fingers and the sensor data.

The utility model relates to the technical field of spraying vehicles, in particular to an intelligent spraying vehicle suitable for tunnel operation, which comprises a movable vehicle main body, a water tank and a high-pressure water pump capable of being remotely controlled are arranged in the movable vehicle main body; the at least one rotary supporting seat is rotatably arranged on the upper surface of the vehicle main body; each spraying device is arranged on the corresponding rotary supporting seat and is indirectly connected with the water tank through a high-pressure water pump; through a system control or handheld remote control mode, free movement of the vehicle body and starting and stopping of the high-pressure water pump can be remotely operated, intelligent operation is achieved, the labor intensity of workers is reduced, and meanwhile the problem that in the prior art, safety risks are caused to operators in an operation area is solved; and moreover, the working posture of the spraying device can be flexibly changed according to different working conditions by adjusting the postures of the telescopic unit and the folding unit, so that the environmental adaptability is remarkably enhanced, and the working efficiency is improved.

A control shell, that is an accessory to a surgical instrument control device of a teleoperated surgical system, includes: a body, formed to overlay onto a user input console of the surgical instrument control device, that includes: a cutout region disposed to allow a first preexisting control element of the surgical instrument control device to remain accessible through the control shell to an operator of the surgical instrument control device; a shell control element for controlling a function of the teleoperated surgical system, and a communication interface; a memory that includes instructions for integrating the shell control element into the surgical instrument control device and controlling robotic movement of an instrument; and a processor configured to: communicate with the surgical instrument control device via the communication interface, and integrate the shell control element into the surgical instrument control device based on the instructions stored in the memory.

A robotic surgery system includes an orienting platform, a manipulator, and a set-up linkage. The manipulator includes an instrument holder, a pitch linkage, and a yaw linkage. The instrument holder is operable to translate the surgical instrument along an insertion axis to insert the surgical instrument through a remote center of manipulation (RC). The pitch linkage is operable to rotate the instrument holder around a pitch axis that intersects the RC. The yaw linkage is operable to rotate the pitch linkage around a yaw axis. The set-up linkage is connected between the yaw linkage and the orienting platform. The set-up linkage is operable to reposition the manipulator relative to the orienting platform with a motion that maintains the RC in a fixed position relative to the orienting platform.

The application provides a U-shaped arm and an endoscope seat for an ERCP surgical robot, which comprises a U-shaped arm and an endoscope seat, the endoscope seat is arranged on one side of the U-shaped arm, the endoscope seat is used for mounting an endoscope, a connecting rod and a wire passing hole are arranged on any side wall of the U-shaped arm, and the connecting rod is used for connecting a cantilever; a control handle is arranged on the side of the U-shaped arm away from the connecting rod, the control handle is used for controlling locking or unlocking of the cantilever, and an optoelectronic sensor for sending or detecting signals is arranged on the control handle. An operation table formed by the U-shaped arm and the endoscope seat is used for integrally mounting the endoscope on the operation table and integrating a guide groove, a water vapor suction control module, a forceps lifter driving module, a knob driving module and the forceps lifter, when surgery is performed, the operation table formed by the U-shaped arm and the endoscope seat can be remotely operated, which is helpful to reduce the harm caused by long-term radiation of surgery to operators and avoid hand tremor of a doctor during operation.

The primary interface system may include a primary display and a primary input device. The system may also include a secondary interface system. The secondary interface system may include a secondary display and a secondary input device. The system may also include a control system in communication with the primary interface system and the secondary interface system. The control system may include a processing unit including one or more processors. The processing unit may be configured to receive a plurality of teleoperational kinematic constraints for the primary input device and generate a plurality of simulated kinematic constraints, mimicking the teleoperational kinematic constraints, for the secondary input device. The processing system may also be configured to receive guidance information from the secondary input device and provide haptic guidance through the primary input device based on the guidance information.

This system allows for easy recovery of work machinery that has become unstable during autonomous operation. [Solution] The automated driving system 1 comprises a work machine 10 and an information processing device 40. The work machine 10 is capable of automated driving. The information processing device 40 is connected to the work machine 10 in a communicative manner. The information processing device 40 comprises a display unit 42, an input unit 41, and a control unit 43. The display unit 42 displays information related to the work machine 10. The input unit 41 receives operations from the operator. The control unit 43 controls the display image G to be displayed on the display unit 42 and the information related to the input of the input unit 41. The control unit 43 performs automated driving processing and remote operation processing. In the automated driving processing, information related to automated driving is displayed on the display unit 42. In the automated driving processing, the input unit 41 receives input related to automated driving. In the remote operation processing, the work machine 10 is remotely operated based on the operations received by the input unit 41.

A management server according to an embodiment includes a communication part, an acquisition part, an intention estimation part, and a motion control part. The communication part communicates with one or more robot devices and one or more operation terminals that remotely operate at least one of the one or more robot devices via a network. The acquisition part acquires an operation content inputted by the operation terminal. The intention estimation part estimates an intention of an operator of the operation terminal based on the operation content acquired by the acquisition part. The motion control part controls a motion of the robot device based on an intention result estimated by the intention estimation part.

The application discloses a wireless remote control method and system based on multi-modal feedback, comprising: generating a VR real-time picture after fusing real-time images, target detection information, target tracking information, voxel information and early warning information collected at a control terminal; real-time analyzing head data, hand data and chassis motion data for controlling a robot according to an ordering task of a user side and the VR real-time picture; determining an upper limb motion trajectory of the robot through the hand data; and controlling the robot to perform a control action of the ordering task according to the upper limb motion trajectory, the head data, the hand data and the chassis motion data. The application can generate a highly realistic VR real-time picture by fusing real-time images, target detection information, target tracking information, voxel information and early warning information collected by a robot, so that the immersion and the sense of presence of an operator are significantly improved, and remote operation is similar to on-site operation.

The present disclosure relates to a method for operating a scanner in a non-face-to-face manner, and the method may comprise the steps of: transmitting, to one or more user terminals, information about a page for instructing about starting of a scan for at least one book; determining whether a command instructing to start the scan is received from the user terminals; in response to a determination that the command instructing to start the scan has been received, instructing one or more scanners to wait for a first execution; while the scanners are waiting for the first execution, determining whether feeding of first sheet into the scanners for a first book from among the at least one book is performed; and in response to a determination that the feeding of the first sheet has been performed, instructing the scanners to start a first scan with respect to the feeding of the first sheet.

The application discloses a high-altitude arbitrary surface operation machine arm system, comprising an environment perception module, a decision control module, an execution module and a human-computer interaction module, and being suitable for high-altitude mobile platform installation and complex curved surface operation. The environment perception module is used for collecting surface topography, depth and end contact force information; the decision control module is based on an embedded control architecture, and an RGBD reconstruction, path planning and force control integrated collaborative control framework is constructed with the execution module, wherein the RGBD reconstruction is used for constructing a three-dimensional environment model, the path planning is used for generating a surface-adaptive operation path, and an end telescopic force control system realizes independent adjustment of path control and end force control through mechanical decoupling; and the human-computer interaction module is used for remote operation and parameter adjustment. The system can realize accurate perception, stable force control and efficient operation on high-altitude arbitrary surfaces, and improves high-altitude adaptability, safety and engineering practicability.

The invention relates to a system for determining an optimised assignment distribution of a plurality of teleoperators with a respective stationary control state (1) for a plurality of vehicles (3) requesting takeover by teleoperation, said system having a receiving unit (5) designed to receive requests for takeover and to receive real-time traffic data in a traffic area around a respective one of the requesting vehicles (3), and having a computing unit (7) which is connected to the receiving unit (5) and which is designed, by means of the information obtained from the receiving unit (5) and a digital map of the respective traffic area, to determine, by means of simulation and / or by carrying out a pre-trained machine learning model, a measure for the impedance of the traffic flow depending on a time-related non-takeover of the respective vehicle (3) by teleoperation and to assign the teleoperator to the requesting vehicles (3) by minimising a cost function based on the measures for the impedance of the traffic flow.

The present invention enables display, on a terminal device, of information related to control of a control device and quick establishment of a data communication path for operating the control device from the terminal device. This network system comprises a first communication path established between an information processing device and a control device on a network. The information processing device transfers the information to a server via the first communication path in order to store, in the storage unit, the information related to the control transferred from the control device. The server transfers the information in the storage unit to the terminal device for display. The terminal device receives a user operation including a remote operation of the control device, and establishes, on the network, a second communication path for exchanging data of the user operation between the terminal device and the control device via the server and the information processing device.